-- Logs begin at Mon 2022-08-01 11:21:46 UTC, end at Mon 2022-08-01 12:30:59 UTC. -- Aug 01 11:48:54.875619 dv-cinder-850320-2-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 01 11:48:54.883479 dv-cinder-850320-2-smb devstack@keystone.service[80130]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 11:48:54 2022] *** Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: nodename: dv-cinder-850320-2-smb Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: machine: x86_64 Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: clock source: unix Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: pcre jit disabled Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: detected number of CPU cores: 4 Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: current working directory: / Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: detected binary path: /usr/bin/uwsgi-core Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: your processes number limit is 47680 Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: your memory page size is 4096 bytes Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: detected max file descriptor number: 2048 Aug 01 11:48:54.886589 dv-cinder-850320-2-smb devstack@keystone.service[80130]: lock engine: pthread robust mutexes Aug 01 11:48:54.887339 dv-cinder-850320-2-smb devstack@keystone.service[80130]: thunder lock: enabled Aug 01 11:48:54.887339 dv-cinder-850320-2-smb devstack@keystone.service[80130]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 01 11:48:54.887339 dv-cinder-850320-2-smb devstack@keystone.service[80130]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 11:48:54.927298 dv-cinder-850320-2-smb devstack@keystone.service[80130]: Python main interpreter initialized at 0x560cfa1df9c0 Aug 01 11:48:54.927298 dv-cinder-850320-2-smb devstack@keystone.service[80130]: python threads support enabled Aug 01 11:48:54.927298 dv-cinder-850320-2-smb devstack@keystone.service[80130]: your server socket listen backlog is limited to 100 connections Aug 01 11:48:54.927298 dv-cinder-850320-2-smb devstack@keystone.service[80130]: your mercy for graceful operations on workers is 90 seconds Aug 01 11:48:54.927695 dv-cinder-850320-2-smb devstack@keystone.service[80130]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 11:48:54.927773 dv-cinder-850320-2-smb devstack@keystone.service[80130]: *** Operational MODE: preforking *** Aug 01 11:48:54.928001 dv-cinder-850320-2-smb devstack@keystone.service[80130]: *** uWSGI is running in multiple interpreter mode *** Aug 01 11:48:54.928001 dv-cinder-850320-2-smb devstack@keystone.service[80130]: spawned uWSGI master process (pid: 80130) Aug 01 11:48:54.928212 dv-cinder-850320-2-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 01 11:48:54.929312 dv-cinder-850320-2-smb devstack@keystone.service[80130]: spawned uWSGI worker 1 (pid: 80141, cores: 1) Aug 01 11:48:54.929654 dv-cinder-850320-2-smb devstack@keystone.service[80130]: spawned uWSGI worker 2 (pid: 80142, cores: 1) Aug 01 11:48:54.930836 dv-cinder-850320-2-smb devstack@keystone.service[80130]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 11:49:00.393823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 11:49:00.393823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: from cryptography.utils import int_from_bytes Aug 01 11:49:00.394615 dv-cinder-850320-2-smb devstack@keystone.service[80141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 11:49:00.394615 dv-cinder-850320-2-smb devstack@keystone.service[80141]: from cryptography.utils import int_from_bytes Aug 01 11:49:00.407387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 11:49:00.407387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: from cryptography.utils import int_from_bytes Aug 01 11:49:00.407858 dv-cinder-850320-2-smb devstack@keystone.service[80142]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 11:49:00.407858 dv-cinder-850320-2-smb devstack@keystone.service[80142]: from cryptography.utils import int_from_bytes Aug 01 11:49:00.444040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 11:49:00.444232 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 11:49:00.444423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] command line args: [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 11:49:00.444691 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 11:49:00.444865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ================================================================================ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 11:49:00.445119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] admin_token = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.445390 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] config_dir = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.445573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.445752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] config_source = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.445931 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] debug = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.446126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.447504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.447504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.447504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.447504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.447504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.447504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_config_append = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.447945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.447945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_dir = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.448080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_file = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.448206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.448452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.448694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.448939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.449116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.449289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.449559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.449793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.450022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.450250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.450533 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.450710 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.450951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.451193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.451462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.451956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.452147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] publish_errors = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.452360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.452584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.452768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.452999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.453227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.453481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] standard_threads = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.453709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.453947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.454118 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.454292 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] use_journal = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.454464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] use_json = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.454634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] use_stderr = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.454788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] use_syslog = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.455021 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.455170 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 11:49:00.455298 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.455412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 11:49:00.455527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] command line args: [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 11:49:00.455637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.455757 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 11:49:00.455870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.455982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ================================================================================ {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 11:49:00.456100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.456220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] admin_token = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.456333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.456455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] config_dir = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.456597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.456715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.456835 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.456948 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] config_source = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.457066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.457200 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] debug = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.457200 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.457470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.457642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.457760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.457884 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.457998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.458109 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.458227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.458346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.458470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.458585 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.458704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.458838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_config_append = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.458953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.459076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.459076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_dir = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.459347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.459460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_file = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.459578 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.459693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.459874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.459992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.460105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.460223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.460342 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.460455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.460579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.460694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.460694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.460908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.461020 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.461142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.461256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.461395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.461518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.461633 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.461747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.461868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.461983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.462096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.462213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.462333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.462453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.462578 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.462692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.462806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.462806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.463017 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.463130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.463130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.463354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.463467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.463579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] publish_errors = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.463579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.463799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.463911 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.464030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.464143 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.464255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.464375 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.464490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.464608 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.464728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.464849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] standard_threads = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.464963 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.465150 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.465270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.465426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.465547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.465661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.465779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.465900 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] use_journal = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.466016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.466129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] use_json = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.466129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] use_stderr = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.466336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.466448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] use_syslog = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.466572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.466686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 11:49:00.466799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.466912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.467032 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.467154 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.467274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.467388 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.467501 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.467619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.467733 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.467854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.467975 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.468090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.468203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.468314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.468427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.468547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.468661 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.468661 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.468889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.469009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.469130 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.469255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.469392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.469516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.469630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.469742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.469854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.469980 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.470095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.470209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.470322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.470435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.470621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.470746 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.470862 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.470975 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.471094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.471215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.471328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.471449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.471563 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.471676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.471789 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.471901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.472013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.472137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.472253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.472366 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.472479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.472592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.472703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.472827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.472948 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.473062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.473684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.473799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.473911 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.474035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.474157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.474277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.474392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.474504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.474653 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.474783 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.474898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.474994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.475089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.475446 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.475542 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.475645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.475745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.475856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.475959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.476054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.476149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.476251 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.476378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.476495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.476606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.476721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.476834 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.476936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.477056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.477171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.477274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.477433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.477548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.477662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.477784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.477899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.478012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.478125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.478237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.478359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.478481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.478593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.478593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.478813 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.478937 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.479051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.479173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.479277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.479389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.479501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.479616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.479728 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.479849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.479964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.480083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.480197 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.480197 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.480401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.480521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.480637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.480740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.480851 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.external = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.480851 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.481070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.481070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.481310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.481427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.481541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.481654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.481768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.password = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.481893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.482008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.token = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.482122 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.482244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.482244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.482458 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.482646 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.482764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.482885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.482999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.483113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.483226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.483348 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.483472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.483596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.483711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.483827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.483940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.484054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.484175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.484291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.484405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.484519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.484632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.484745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.484868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.484984 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.485097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.485211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.485348 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.485464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.485592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.485709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.485823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.485945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.486061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.486175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.486296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.486296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.486499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.486612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.486725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.486844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.486997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.487125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.487250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.487366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.487488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.487603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.487718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.487832 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.487956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.488072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.488187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.488301 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.488422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.488537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.488663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.488807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.489481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.489602 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.489718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.489833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.489955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.490074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.490190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.490304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.490419 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.490534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.490661 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.490778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.490900 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.491016 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.491133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.491247 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.491371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.491371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.491589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.491704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.491704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.491919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.492045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.492163 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.492279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.492382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.492496 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.492610 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.492733 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.492848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.external = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.492964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.493084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.493201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.493365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.493497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.493497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.493715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.493715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.password = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.493933 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.494048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.token = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.494171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.494288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.494411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.494534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.494650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.494774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.494890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.495006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.495121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.495235 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.495358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.495486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.495603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.495718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.495833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.495948 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.496063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.496063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.496289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.496406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.496520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.496635 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.496750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.496950 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.497069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.497192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.497327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.497457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.497573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.497700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.497817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.497933 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.498048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.498163 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.498277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.498401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.498519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.498635 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.498750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.498866 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.498980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.499104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.499104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.499321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.499437 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.499553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.499668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.499791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.499914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.500030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.500145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.500260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.500375 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.500498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.500617 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.500732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.500849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.500964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.501079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.501202 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.501336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.501454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.501570 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.501685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.501800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.501927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.502051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.502167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.502282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.502397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.502518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.502643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.502760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.502875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.502991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.503105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.503220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.503344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.503461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.503576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.503692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.503807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.503925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.504049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.504166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.504270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.504384 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.504500 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.504614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.504614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.504850 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.504850 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.505067 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.505067 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.505282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.505430 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.505430 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.505649 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.505766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.505766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.505982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.506110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.506228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.506345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.506345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.506550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.506672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.506672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.506891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.507006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.507006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.507222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.507346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.507346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.507564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.507688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.507688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.507906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.508034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.508152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.508267 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.508267 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.508483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.508598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.508598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.508829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.508947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.508947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.509164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.509280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.509485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.509601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.509717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.509832 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.509947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.510063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.510187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.510303 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.510419 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.510534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.510648 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.510763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.510886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.511002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.511119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.511234 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.511374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.511494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.511618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.511735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.511899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.512074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.512194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] role.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.512365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] role.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.512545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.512665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.512825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.512942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.513057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.513320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.513453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.513571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.513801 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.513919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.514034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.514261 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.514393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.514510 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.514721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.514839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.515212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.515331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.515455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.515455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.515676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.515792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.516037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.516156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.516305 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.516527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.516639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.516787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.517023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.517142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.517266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.517476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.517596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.517731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.517850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.517977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.518093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.518209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.518324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.518441 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.518555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.518678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.518794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.518909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.519062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.519181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.519324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.519512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.519639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.519787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.520008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.520127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.520261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.520451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.520572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.520687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.520802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.520944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.521061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.521253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.521413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.521531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.521647 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.521762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.521877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.522004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.522121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.522236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.522351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.522466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.522582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.522706 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.522822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.522938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.523053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.523168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.523283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.523407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.523540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.523682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.523799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.523915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.524030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.524154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.524270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.524386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.524501 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.524615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.524731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.524938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.525069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.525190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.525430 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.525549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.525665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.525896 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.526028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.526145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.526346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.526463 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.526579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.526732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.526860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.527000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.527119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.527254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.527371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.527486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.527615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.527733 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.527851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.527966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.528081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.528197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.528319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.528436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.528602 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.528719 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.528836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.528988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 11:49:00.529114 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.529623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.529985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.530246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.530552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.530898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.531321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.531805 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.532277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.532738 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.533230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.533765 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.534215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.534700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.535172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.536175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.536554 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] role.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.536825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] role.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.537073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.537370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.537639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.537912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.538175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.538517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.538999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.539491 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.539982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.540432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.540768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.541033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.541373 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.541578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.542028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.542277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.542539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.542799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.543060 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.543318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.543561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.543823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.544082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.544328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.544566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.544807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.545047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.545332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.545588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.545842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.546200 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.546659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.547117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.547586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.548047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.548530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.548989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.549391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.549662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.549915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.550173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.550430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.550689 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.551006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.551973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.552419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.552845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.553347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.553715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.554132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.554620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.555049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.connection = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.555445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.555844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.556225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.556612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.556991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.557403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.557779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.558152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.558543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.558917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.559302 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.559675 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.560066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.560205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.560435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.560517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.560660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.560822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.561191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.561611 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.561989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 11:49:00.562252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 11:49:00.569020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.590430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.590660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.590889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.598677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.598907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.599786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.619958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.620191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.650856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.656117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.705986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.706138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.706213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.706310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.771389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.771614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.771701 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.771835 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.771934 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.772053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.772136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.772269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.772352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.772483 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.772575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.772742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.795944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.796173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.796267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.796402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.796488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.796627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.796711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.796845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.796937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.797058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.797140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.797267 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.797371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.797532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.808328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.808923 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.820911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.821140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.821388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.821487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.821610 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.821694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.821826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.821909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.822040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.822125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.822252 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.822335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.822479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.822699 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 11:49:00.839638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.839847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 11:49:00.840102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.840187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.840318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 11:49:00.840415 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 11:49:00.840612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.840698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.840844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 11:49:00.840925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.841103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.841184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.841382 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.841468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.841667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.841901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.851905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.852174 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.852437 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.852711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.852967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.853249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.853543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.853824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.859603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.860799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.864654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.864937 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.865217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.865522 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.865801 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.866056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.866156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.866319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.866399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.866586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.866669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.866850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.866932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.867114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.867194 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.867374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.867463 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.867650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.867924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.868196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.868572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.868899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.890447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.891930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.892205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.892442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.893971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.894251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.897371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.897650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.897930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.899433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.899716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.900001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.904556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.904835 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.906641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.906924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.908939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.909221 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.909534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.909813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.910082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.910364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.910686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.911481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.912007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.912292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.912582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.912863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.913138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.913434 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.913723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.913998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.927347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.927620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.929968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.930249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.931537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.934202 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.934673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.934961 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.937379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.937673 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.939312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.942114 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.942591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.945280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.945756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.946050 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.946333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.946621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.946903 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.947187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.948466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.948767 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.949053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.949376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.949671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.949965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.963525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.963802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.964062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.964318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.968224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.968506 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.968775 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.969039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.971168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.972711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.972982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.976641 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.976804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.976916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.977205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.977516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.977804 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.978404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.978681 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.981545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.981830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.982130 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.982427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.982713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.989156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.989460 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.989735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.990009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.990289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.990560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.990831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.994192 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:00.994473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.994752 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.995031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.995310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.995582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:00.995857 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.006376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:01.009314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:01.011565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:01.012237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.014564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:01.014681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.016249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:01.016527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.016804 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.017540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.020590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.022173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:01.022476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.022784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.023786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.025406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:01.028303 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.028588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.028868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.029139 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.029280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.030904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:01.033869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.034156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.034451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.034738 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.037814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:01.038095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.038370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.043338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:01.043624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.043904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.045149 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:01.045447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.045733 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.046001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.046274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.046554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.046822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.047092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.047457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.047744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.048022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.048279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.048547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.048800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.050797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 11:49:01.051076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.051382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.051660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.051942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.052211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.052480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.052755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.053129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.053432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.053716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.053989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.054265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.054534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 11:49:01.081837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560cfa1df9c0 pid: 80141 (default app) Aug 01 11:49:01.085734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ed2c-8948-4c81-b72d-25e35a8529ac None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:01.086018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ed2c-8948-4c81-b72d-25e35a8529ac None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:01.086286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef83ed2c-8948-4c81-b72d-25e35a8529ac None None] PATH_INFO: `/v3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:01.088790 dv-cinder-850320-2-smb devstack@keystone.service[80142]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x560cfa1df9c0 pid: 80142 (default app) Aug 01 11:49:01.090550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Mon Aug 1 11:49:01 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:08.617468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc98919-bcb0-47c2-923e-d8f5529eb41e None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:08.617995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc98919-bcb0-47c2-923e-d8f5529eb41e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:08.617995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc98919-bcb0-47c2-923e-d8f5529eb41e None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:08.622364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:08.627417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76ffe-3b96-438d-8c3c-9955249ee634 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:08.627841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76ffe-3b96-438d-8c3c-9955249ee634 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:08.627959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d76ffe-3b96-438d-8c3c-9955249ee634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:08.699053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: INFO dbcounter [None req-b6d76ffe-3b96-438d-8c3c-9955249ee634 None None] Registered counter for database keystone Aug 01 11:49:08.718561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG oslo_db.sqlalchemy.engines [None req-b6d76ffe-3b96-438d-8c3c-9955249ee634 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 11:49:08.724731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writer thread running {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 11:49:08.906014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG passlib.handlers.bcrypt [None req-b6d76ffe-3b96-438d-8c3c-9955249ee634 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80141) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 11:49:08.906345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG passlib.handlers.bcrypt [None req-b6d76ffe-3b96-438d-8c3c-9955249ee634 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80141) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 11:49:08.964279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b6d76ffe-3b96-438d-8c3c-9955249ee634 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:08.966187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b6d76ffe-3b96-438d-8c3c-9955249ee634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:09.098261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 472 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 01 11:49:09.217133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc98919-bcb0-47c2-923e-d8f5529eb41e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:09.290101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: INFO dbcounter [None req-adc98919-bcb0-47c2-923e-d8f5529eb41e None None] Registered counter for database keystone Aug 01 11:49:09.311690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG oslo_db.sqlalchemy.engines [None req-adc98919-bcb0-47c2-923e-d8f5529eb41e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 11:49:09.318494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writer thread running {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 11:49:09.436428 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc98919-bcb0-47c2-923e-d8f5529eb41e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:09.440747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01068ced-ad2a-400c-bacc-944bbded875d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:09.441412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01068ced-ad2a-400c-bacc-944bbded875d admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:09.441720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01068ced-ad2a-400c-bacc-944bbded875d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:09.441994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01068ced-ad2a-400c-bacc-944bbded875d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:09.450000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01068ced-ad2a-400c-bacc-944bbded875d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:09.501499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: WARNING keystone.common.rbac_enforcer.enforcer [None req-01068ced-ad2a-400c-bacc-944bbded875d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 11:49:09.501846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01068ced-ad2a-400c-bacc-944bbded875d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:09.511449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Mon Aug 1 11:49:09 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 11:49:09.517979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d76ffe-3b96-438d-8c3c-9955249ee634 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:09.533918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d76ffe-3b96-438d-8c3c-9955249ee634 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:09.538893 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf97db36-c21a-4413-9872-9160a7d0af40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:09.540015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97db36-c21a-4413-9872-9160a7d0af40 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:09.540298 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97db36-c21a-4413-9872-9160a7d0af40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:09.540571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf97db36-c21a-4413-9872-9160a7d0af40 admin admin] PATH_INFO: `/v3/projects/541ab528aad34615a3714dea6d3cccb9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:09.542078 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97db36-c21a-4413-9872-9160a7d0af40 admin admin] RBAC: Authorizing `identity:get_project(project_id=541ab528aad34615a3714dea6d3cccb9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:09.591848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cf97db36-c21a-4413-9872-9160a7d0af40 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 11:49:09.592201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf97db36-c21a-4413-9872-9160a7d0af40 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:09.596804 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Mon Aug 1 11:49:09 2022] GET /identity/v3/projects/541ab528aad34615a3714dea6d3cccb9 => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:11.556100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716591a9-bbfb-44d7-85aa-3d2b06e7e9f3 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:11.556589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716591a9-bbfb-44d7-85aa-3d2b06e7e9f3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:11.556589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716591a9-bbfb-44d7-85aa-3d2b06e7e9f3 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:11.560786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:11.566037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719daf-5653-4c8a-a657-b57ecf7613db None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:11.566418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719daf-5653-4c8a-a657-b57ecf7613db None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:11.566619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d719daf-5653-4c8a-a657-b57ecf7613db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:11.586675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1d719daf-5653-4c8a-a657-b57ecf7613db None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:11.588189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1d719daf-5653-4c8a-a657-b57ecf7613db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:11.595977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:11 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 01 11:49:11.618726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716591a9-bbfb-44d7-85aa-3d2b06e7e9f3 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:11.630639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716591a9-bbfb-44d7-85aa-3d2b06e7e9f3 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:11.634789 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785fdc23-8a92-41d3-84c7-8051cccb1b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:11.635386 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fdc23-8a92-41d3-84c7-8051cccb1b09 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:11.635666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fdc23-8a92-41d3-84c7-8051cccb1b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:11.635934 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785fdc23-8a92-41d3-84c7-8051cccb1b09 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:11.643524 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fdc23-8a92-41d3-84c7-8051cccb1b09 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:11.645357 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785fdc23-8a92-41d3-84c7-8051cccb1b09 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:11.654050 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Mon Aug 1 11:49:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 11:49:11.659293 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d719daf-5653-4c8a-a657-b57ecf7613db None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:11.668621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d719daf-5653-4c8a-a657-b57ecf7613db None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:11.672892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e9fc3-22c2-4255-aa1b-679890549cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:11.673537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e9fc3-22c2-4255-aa1b-679890549cda admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:11.673816 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e9fc3-22c2-4255-aa1b-679890549cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:11.674088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e9fc3-22c2-4255-aa1b-679890549cda admin admin] PATH_INFO: `/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:11.675421 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e9fc3-22c2-4255-aa1b-679890549cda admin admin] RBAC: Authorizing `identity:get_user(user_id=2ba23ee634e9487f8436a5c9c29e0eb9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:11.677923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63e9fc3-22c2-4255-aa1b-679890549cda admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:11.679434 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Mon Aug 1 11:49:11 2022] GET /identity/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:13.737133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1988242-9fdd-4170-b576-acc27a64ddbb None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:13.737660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1988242-9fdd-4170-b576-acc27a64ddbb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:13.737660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1988242-9fdd-4170-b576-acc27a64ddbb None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:13.739496 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:13.744626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee6530-9d49-4c92-8e76-06a065fced76 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:13.745057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee6530-9d49-4c92-8e76-06a065fced76 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:13.745181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee6530-9d49-4c92-8e76-06a065fced76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:13.765005 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3cee6530-9d49-4c92-8e76-06a065fced76 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:13.766235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3cee6530-9d49-4c92-8e76-06a065fced76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:13.766369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abbcc0-626a-4980-a2df-a9cbcc7daa19 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:13.766661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abbcc0-626a-4980-a2df-a9cbcc7daa19 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:13.766938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45abbcc0-626a-4980-a2df-a9cbcc7daa19 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:13.768259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:49:13.773220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcef64c-43f2-4719-99d3-f853cef978c6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:13.773540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcef64c-43f2-4719-99d3-f853cef978c6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:13.773821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcef64c-43f2-4719-99d3-f853cef978c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:13.815889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG passlib.handlers.bcrypt [None req-abcef64c-43f2-4719-99d3-f853cef978c6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80142) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 11:49:13.816440 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG passlib.handlers.bcrypt [None req-abcef64c-43f2-4719-99d3-f853cef978c6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80142) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 11:49:13.844626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:13.862509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-abcef64c-43f2-4719-99d3-f853cef978c6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:13.864669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-abcef64c-43f2-4719-99d3-f853cef978c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:13.868375 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee6530-9d49-4c92-8e76-06a065fced76 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:13.891390 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:13.965110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:13.971872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee6530-9d49-4c92-8e76-06a065fced76 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:13.987264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcef64c-43f2-4719-99d3-f853cef978c6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:14.007119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e69d-7813-4fe8-a4fc-3f13688c7daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:14.007767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e69d-7813-4fe8-a4fc-3f13688c7daf None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:14.008048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e69d-7813-4fe8-a4fc-3f13688c7daf None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:14.008324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f0e69d-7813-4fe8-a4fc-3f13688c7daf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:14.019368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f0e69d-7813-4fe8-a4fc-3f13688c7daf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-93f0e69d-7813-4fe8-a4fc-3f13688c7daf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:14.028227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:14.029186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:14.030052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:49:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:49:14.035063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e69d-7813-4fe8-a4fc-3f13688c7daf None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:14.086653 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcef64c-43f2-4719-99d3-f853cef978c6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:14.088987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:14.117007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:14.125140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53e16d-f1fe-41da-af4e-0a5b767ca6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:14.126029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53e16d-f1fe-41da-af4e-0a5b767ca6d2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:14.126315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53e16d-f1fe-41da-af4e-0a5b767ca6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:14.126591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53e16d-f1fe-41da-af4e-0a5b767ca6d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:14.136513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f0e69d-7813-4fe8-a4fc-3f13688c7daf None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:14.169727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7129b-a0fe-4ad0-89b2-e66b8a18d793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:14.170330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7129b-a0fe-4ad0-89b2-e66b8a18d793 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:14.170609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7129b-a0fe-4ad0-89b2-e66b8a18d793 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:14.170885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e7129b-a0fe-4ad0-89b2-e66b8a18d793 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:14.171603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7129b-a0fe-4ad0-89b2-e66b8a18d793 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:14.171906 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7129b-a0fe-4ad0-89b2-e66b8a18d793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:14.173323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e7129b-a0fe-4ad0-89b2-e66b8a18d793 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:14.185779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:14.191245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7129b-a0fe-4ad0-89b2-e66b8a18d793 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:14.192916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53e16d-f1fe-41da-af4e-0a5b767ca6d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:14.194494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53e16d-f1fe-41da-af4e-0a5b767ca6d2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:14.289835 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e7129b-a0fe-4ad0-89b2-e66b8a18d793 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:14.291019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 8/16] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 11:49:14.296506 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53e16d-f1fe-41da-af4e-0a5b767ca6d2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:14.299517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:14.402289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53e16d-f1fe-41da-af4e-0a5b767ca6d2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:14.429479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1cfc2-dfe3-47e8-b68f-9ee7d4bd3ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:14.430120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1cfc2-dfe3-47e8-b68f-9ee7d4bd3ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:14.430396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1cfc2-dfe3-47e8-b68f-9ee7d4bd3ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:14.430674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f1cfc2-dfe3-47e8-b68f-9ee7d4bd3ce3 None admin] PATH_INFO: `/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:14.431827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1cfc2-dfe3-47e8-b68f-9ee7d4bd3ce3 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba23ee634e9487f8436a5c9c29e0eb9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:14.433322 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f1cfc2-dfe3-47e8-b68f-9ee7d4bd3ce3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:14.434900 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 9/17] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:14 2022] GET /identity/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:14.438214 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efbd21-9f1b-496b-bd2e-fe9db5841804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:14.439078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efbd21-9f1b-496b-bd2e-fe9db5841804 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:14.439363 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efbd21-9f1b-496b-bd2e-fe9db5841804 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:14.439732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efbd21-9f1b-496b-bd2e-fe9db5841804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:14.440313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1cfc2-dfe3-47e8-b68f-9ee7d4bd3ce3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:14.454664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:14.460508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efbd21-9f1b-496b-bd2e-fe9db5841804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:14.462022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efbd21-9f1b-496b-bd2e-fe9db5841804 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-57efbd21-9f1b-496b-bd2e-fe9db5841804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:49:14.480560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:14.481624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:14.482621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:49:14.482621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:49:14.482621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:49:14.482621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:14.482621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 9/18] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:49:14.487611 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efbd21-9f1b-496b-bd2e-fe9db5841804 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:14.542699 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:14.543024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f1cfc2-dfe3-47e8-b68f-9ee7d4bd3ce3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:14.576748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30a964-ce58-464f-9d95-e3f6e0be949b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:14.577411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30a964-ce58-464f-9d95-e3f6e0be949b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:14.577694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30a964-ce58-464f-9d95-e3f6e0be949b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:14.577970 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee30a964-ce58-464f-9d95-e3f6e0be949b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:14.579131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30a964-ce58-464f-9d95-e3f6e0be949b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:14.580585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee30a964-ce58-464f-9d95-e3f6e0be949b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:14.582709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 10/19] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:14.587543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efbd21-9f1b-496b-bd2e-fe9db5841804 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:14.588357 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30a964-ce58-464f-9d95-e3f6e0be949b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:14.620799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d472a68d-3a58-4f51-848a-157125a3ff89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:14.621512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472a68d-3a58-4f51-848a-157125a3ff89 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:14.621797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472a68d-3a58-4f51-848a-157125a3ff89 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:14.622072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d472a68d-3a58-4f51-848a-157125a3ff89 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:14.622761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472a68d-3a58-4f51-848a-157125a3ff89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:14.623066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472a68d-3a58-4f51-848a-157125a3ff89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:14.624453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d472a68d-3a58-4f51-848a-157125a3ff89 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:14.641829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 10/20] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:49:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:14.670363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:14.691050 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee30a964-ce58-464f-9d95-e3f6e0be949b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:14.727642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c427ec9f-0321-4887-8b9a-3bd92201bab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:14.728269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427ec9f-0321-4887-8b9a-3bd92201bab0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:14.728551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427ec9f-0321-4887-8b9a-3bd92201bab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:14.728825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c427ec9f-0321-4887-8b9a-3bd92201bab0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:14.729649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427ec9f-0321-4887-8b9a-3bd92201bab0 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.domain.id=default, user.id=2ba23ee634e9487f8436a5c9c29e0eb9) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:14.729956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427ec9f-0321-4887-8b9a-3bd92201bab0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:14.731424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c427ec9f-0321-4887-8b9a-3bd92201bab0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:14.739118 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 11/21] 10.222.0.42 () {56 vars in 1322 bytes} [Mon Aug 1 11:49:14 2022] GET /identity/v3/role_assignments?user.id=2ba23ee634e9487f8436a5c9c29e0eb9&scope.domain.id=default&role.id=0195bf688a7e464e8ff594afe80b050e => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:17.078376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcda0a-fcd1-4523-bb18-6c49f082933c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.079438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcda0a-fcd1-4523-bb18-6c49f082933c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.079944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afcda0a-fcd1-4523-bb18-6c49f082933c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.081572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 11/22] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:17.091470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a209-826e-4e8c-9dab-e9ad059fc556 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.092520 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a209-826e-4e8c-9dab-e9ad059fc556 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.093000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319a209-826e-4e8c-9dab-e9ad059fc556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.118658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7319a209-826e-4e8c-9dab-e9ad059fc556 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:17.120253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7319a209-826e-4e8c-9dab-e9ad059fc556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:17.125449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc857ebc-7f2f-407c-bab3-7960e784618c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.125978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc857ebc-7f2f-407c-bab3-7960e784618c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.126464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc857ebc-7f2f-407c-bab3-7960e784618c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.127999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 12/23] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:49:17.142434 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52319b-012d-41e1-8e36-b10ba6aaab8d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.143039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52319b-012d-41e1-8e36-b10ba6aaab8d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.143515 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52319b-012d-41e1-8e36-b10ba6aaab8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.170385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-cd52319b-012d-41e1-8e36-b10ba6aaab8d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:17.171939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cd52319b-012d-41e1-8e36-b10ba6aaab8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:17.221236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 12/24] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:17.260163 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319a209-826e-4e8c-9dab-e9ad059fc556 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:17.292927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 13/25] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:17.326938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52319b-012d-41e1-8e36-b10ba6aaab8d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:17.342736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:17.371555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319a209-826e-4e8c-9dab-e9ad059fc556 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:17.413011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8896c-33e1-493a-b11d-11409f29b97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:17.414798 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8896c-33e1-493a-b11d-11409f29b97c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.419824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8896c-33e1-493a-b11d-11409f29b97c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.420273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8896c-33e1-493a-b11d-11409f29b97c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.438294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:17.441071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8896c-33e1-493a-b11d-11409f29b97c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:17.443868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b8896c-33e1-493a-b11d-11409f29b97c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f8b8896c-33e1-493a-b11d-11409f29b97c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:49:17.469713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:17.471151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:17.472194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:49:17.472194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:49:17.472194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:49:17.472194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:17.473729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 13/26] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:49:17.479794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8896c-33e1-493a-b11d-11409f29b97c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:17.548811 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52319b-012d-41e1-8e36-b10ba6aaab8d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:17.612836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b8896c-33e1-493a-b11d-11409f29b97c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:17.620815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6123d-d6a4-4e5f-9fb1-7f37b8a78341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:17.621492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6123d-d6a4-4e5f-9fb1-7f37b8a78341 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.621931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6123d-d6a4-4e5f-9fb1-7f37b8a78341 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.622361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6123d-d6a4-4e5f-9fb1-7f37b8a78341 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.640844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:17.653401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6123d-d6a4-4e5f-9fb1-7f37b8a78341 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-43b6123d-d6a4-4e5f-9fb1-7f37b8a78341 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:17.657624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:17.658628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:17.659398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 14/27] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:49:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:49:17.660028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388adbb-d164-489d-8f25-6b9146564a42 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.661309 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388adbb-d164-489d-8f25-6b9146564a42 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.661744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388adbb-d164-489d-8f25-6b9146564a42 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.662483 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d8ad6-5a9c-422d-a430-289e1dceee43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:17.663273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8ad6-5a9c-422d-a430-289e1dceee43 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.663687 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8ad6-5a9c-422d-a430-289e1dceee43 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.664105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d8ad6-5a9c-422d-a430-289e1dceee43 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.664941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d8ad6-5a9c-422d-a430-289e1dceee43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:17.665401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d8ad6-5a9c-422d-a430-289e1dceee43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:17.666959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d8ad6-5a9c-422d-a430-289e1dceee43 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:17.670404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 15/28] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:17 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:17.671336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388adbb-d164-489d-8f25-6b9146564a42 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:17.688287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 14/29] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:49:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:17.694701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd7b07-3d0a-42ab-8391-8fabb02bd6a6 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.694946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd7b07-3d0a-42ab-8391-8fabb02bd6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.695229 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cd7b07-3d0a-42ab-8391-8fabb02bd6a6 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.696821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 15/30] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:17 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:17.697917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c18d2-e6a5-4521-8200-a30f0762cf1a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.698258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c18d2-e6a5-4521-8200-a30f0762cf1a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.698535 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2c18d2-e6a5-4521-8200-a30f0762cf1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.718399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-dd2c18d2-e6a5-4521-8200-a30f0762cf1a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:17.720440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dd2c18d2-e6a5-4521-8200-a30f0762cf1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:17.798624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9388adbb-d164-489d-8f25-6b9146564a42 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:17.816065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 16/31] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:17.817097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c18d2-e6a5-4521-8200-a30f0762cf1a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:17.924931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:17.942378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2c18d2-e6a5-4521-8200-a30f0762cf1a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:17.953507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7192d9-3cca-4691-a23b-3ec17fdd1164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:17.954293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7192d9-3cca-4691-a23b-3ec17fdd1164 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.954672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7192d9-3cca-4691-a23b-3ec17fdd1164 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.955066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7192d9-3cca-4691-a23b-3ec17fdd1164 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.955941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7192d9-3cca-4691-a23b-3ec17fdd1164 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:17.956349 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7192d9-3cca-4691-a23b-3ec17fdd1164 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:17.957962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7192d9-3cca-4691-a23b-3ec17fdd1164 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:17.961106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:17.970441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 16/32] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:17.971806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9bc09-e161-43fc-85e5-49b98f8148ce None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.977410 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9bc09-e161-43fc-85e5-49b98f8148ce None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.977803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9bc09-e161-43fc-85e5-49b98f8148ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.983800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cba9d9-74ec-42c0-b8e0-591afe72d7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:17.984708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cba9d9-74ec-42c0-b8e0-591afe72d7da None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:17.985145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cba9d9-74ec-42c0-b8e0-591afe72d7da None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:17.985627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cba9d9-74ec-42c0-b8e0-591afe72d7da None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:17.986493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cba9d9-74ec-42c0-b8e0-591afe72d7da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:17.988071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cba9d9-74ec-42c0-b8e0-591afe72d7da None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:17.997650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-dbd9bc09-e161-43fc-85e5-49b98f8148ce None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:17.999079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dbd9bc09-e161-43fc-85e5-49b98f8148ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:18.074575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 17/33] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:18.075698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9bc09-e161-43fc-85e5-49b98f8148ce None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:18.132340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 17/34] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:49:17 2022] POST /identity/v3/projects => generated 301 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:18.133325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cba9d9-74ec-42c0-b8e0-591afe72d7da None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:18.204007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:18.211127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9bc09-e161-43fc-85e5-49b98f8148ce None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:18.264119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70cac08-d66e-40bf-92cf-2ea9c7eb296b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:18.265537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cac08-d66e-40bf-92cf-2ea9c7eb296b None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:18.265846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cac08-d66e-40bf-92cf-2ea9c7eb296b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:18.266125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70cac08-d66e-40bf-92cf-2ea9c7eb296b None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:18.267208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cac08-d66e-40bf-92cf-2ea9c7eb296b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:18.269408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70cac08-d66e-40bf-92cf-2ea9c7eb296b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:18.330642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cba9d9-74ec-42c0-b8e0-591afe72d7da None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:18.373497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c463a23-c89c-4cc4-990c-c677ae22e30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:18.374212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c463a23-c89c-4cc4-990c-c677ae22e30a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:18.374492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c463a23-c89c-4cc4-990c-c677ae22e30a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:18.374800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c463a23-c89c-4cc4-990c-c677ae22e30a None admin] PATH_INFO: `/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:18.376197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c463a23-c89c-4cc4-990c-c677ae22e30a None admin] RBAC: Authorizing `identity:get_user(user_id=2ba23ee634e9487f8436a5c9c29e0eb9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:18.378585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c463a23-c89c-4cc4-990c-c677ae22e30a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:18.381066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 18/35] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:18 2022] GET /identity/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9 => generated 247 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:18.381886 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c463a23-c89c-4cc4-990c-c677ae22e30a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:18.411441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 18/36] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Aug 1 11:49:18 2022] POST /identity/v3/roles => generated 219 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:18.412956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f6a88-82f8-459a-9d4a-688d58282da6 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:18.413253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f6a88-82f8-459a-9d4a-688d58282da6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:18.413612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f6a88-82f8-459a-9d4a-688d58282da6 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:18.419092 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 19/37] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:18.420058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f6a88-82f8-459a-9d4a-688d58282da6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:18.426965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:18.536922 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c463a23-c89c-4cc4-990c-c677ae22e30a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:18.563753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f6a88-82f8-459a-9d4a-688d58282da6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:18.583157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39af39e-ea59-4cf4-9720-6c8a6be22019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:18.584203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39af39e-ea59-4cf4-9720-6c8a6be22019 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:18.584492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39af39e-ea59-4cf4-9720-6c8a6be22019 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:18.585070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39af39e-ea59-4cf4-9720-6c8a6be22019 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:18.587026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39af39e-ea59-4cf4-9720-6c8a6be22019 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:18.589486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39af39e-ea59-4cf4-9720-6c8a6be22019 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:18.609648 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff8845-9cef-4a8b-84a7-6d61cf424352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:18.610241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff8845-9cef-4a8b-84a7-6d61cf424352 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:18.610532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff8845-9cef-4a8b-84a7-6d61cf424352 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:18.610799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ff8845-9cef-4a8b-84a7-6d61cf424352 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:18.611495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 19/38] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Aug 1 11:49:18 2022] POST /identity/v3/roles => generated 225 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:18.613021 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755044d-ed51-4652-a192-6d3c7fd0ff46 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:18.613152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff8845-9cef-4a8b-84a7-6d61cf424352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:18.613975 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755044d-ed51-4652-a192-6d3c7fd0ff46 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:18.614265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5755044d-ed51-4652-a192-6d3c7fd0ff46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:18.615223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ff8845-9cef-4a8b-84a7-6d61cf424352 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:18.617096 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 20/39] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:18.626841 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff8845-9cef-4a8b-84a7-6d61cf424352 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:18.640016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5755044d-ed51-4652-a192-6d3c7fd0ff46 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:18.642096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5755044d-ed51-4652-a192-6d3c7fd0ff46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:18.673030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:18.753651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 20/40] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:18.776864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ff8845-9cef-4a8b-84a7-6d61cf424352 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:18.784092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755044d-ed51-4652-a192-6d3c7fd0ff46 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:18.824446 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:18.828354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8faa276-d9f1-4a3d-9d5c-4fc085fdf5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:18.829038 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faa276-d9f1-4a3d-9d5c-4fc085fdf5ed None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:18.829338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faa276-d9f1-4a3d-9d5c-4fc085fdf5ed None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:18.829621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8faa276-d9f1-4a3d-9d5c-4fc085fdf5ed None admin] PATH_INFO: `/v3/domains/default/users/2ba23ee634e9487f8436a5c9c29e0eb9/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:18.833635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8faa276-d9f1-4a3d-9d5c-4fc085fdf5ed None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=2ba23ee634e9487f8436a5c9c29e0eb9, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:18.835071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8faa276-d9f1-4a3d-9d5c-4fc085fdf5ed None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:18.853595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 21/41] 10.222.0.42 () {58 vars in 1361 bytes} [Mon Aug 1 11:49:18 2022] PUT /identity/v3/domains/default/users/2ba23ee634e9487f8436a5c9c29e0eb9/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:49:18.890569 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5b7a-02cd-42b0-80e0-da9513e3b12c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:18.890870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5b7a-02cd-42b0-80e0-da9513e3b12c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:18.891270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f5b7a-02cd-42b0-80e0-da9513e3b12c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:18.892956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 22/42] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:49:18.899634 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6705bf-8908-4bdf-8e6b-05816c9676f6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:18.900003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6705bf-8908-4bdf-8e6b-05816c9676f6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:18.900451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6705bf-8908-4bdf-8e6b-05816c9676f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:18.926201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3c6705bf-8908-4bdf-8e6b-05816c9676f6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:18.927935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3c6705bf-8908-4bdf-8e6b-05816c9676f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:18.938639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5755044d-ed51-4652-a192-6d3c7fd0ff46 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:18.983560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c7944-f00e-4d15-af52-1540bf6c49e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:18.984207 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c7944-f00e-4d15-af52-1540bf6c49e5 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:18.984493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c7944-f00e-4d15-af52-1540bf6c49e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:18.984771 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c7944-f00e-4d15-af52-1540bf6c49e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:18.985527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c7944-f00e-4d15-af52-1540bf6c49e5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:18.986979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c7944-f00e-4d15-af52-1540bf6c49e5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:19.005113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 21/43] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Aug 1 11:49:18 2022] POST /identity/v3/roles => generated 223 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:19.007411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 23/44] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:19.031237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c7944-f00e-4d15-af52-1540bf6c49e5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:19.131685 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:19.151689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c7944-f00e-4d15-af52-1540bf6c49e5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:19.193351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e3319-9082-4dff-9d07-44a2f581f5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:19.194019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e3319-9082-4dff-9d07-44a2f581f5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:19.195121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e3319-9082-4dff-9d07-44a2f581f5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:19.195121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e3319-9082-4dff-9d07-44a2f581f5e6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:19.196875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e3319-9082-4dff-9d07-44a2f581f5e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:19.198475 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e3319-9082-4dff-9d07-44a2f581f5e6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:19.200709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 22/45] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:19.208049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6705bf-8908-4bdf-8e6b-05816c9676f6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:19.231493 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:19.324702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6705bf-8908-4bdf-8e6b-05816c9676f6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:19.358650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2297e12-a257-4ab7-b0f5-9d10501850fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:19.359280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2297e12-a257-4ab7-b0f5-9d10501850fc None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:19.359560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2297e12-a257-4ab7-b0f5-9d10501850fc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:19.359830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2297e12-a257-4ab7-b0f5-9d10501850fc None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:19.360519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2297e12-a257-4ab7-b0f5-9d10501850fc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:19.362008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2297e12-a257-4ab7-b0f5-9d10501850fc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:19.389387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:49:19 2022] POST /identity/v3/projects => generated 312 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:20.903511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994398bf-4e2e-4b4a-b1c8-2aed3a5a2229 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:20.904054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994398bf-4e2e-4b4a-b1c8-2aed3a5a2229 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:20.904054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994398bf-4e2e-4b4a-b1c8-2aed3a5a2229 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:20.905452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 23/47] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:20.910772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8148-9852-4b9a-90a1-e09c479da1b1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:20.911191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8148-9852-4b9a-90a1-e09c479da1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:20.911337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d8148-9852-4b9a-90a1-e09c479da1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:20.929083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-550d8148-9852-4b9a-90a1-e09c479da1b1 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:20.930306 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-550d8148-9852-4b9a-90a1-e09c479da1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:20.996424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:21.005455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 25/48] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:21.025736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994398bf-4e2e-4b4a-b1c8-2aed3a5a2229 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:21.128574 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994398bf-4e2e-4b4a-b1c8-2aed3a5a2229 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:21.161243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414a3f3-80c6-462c-a5df-7a1368a3f2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:21.161833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414a3f3-80c6-462c-a5df-7a1368a3f2aa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:21.162120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414a3f3-80c6-462c-a5df-7a1368a3f2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:21.162398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414a3f3-80c6-462c-a5df-7a1368a3f2aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:21.173466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414a3f3-80c6-462c-a5df-7a1368a3f2aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-9414a3f3-80c6-462c-a5df-7a1368a3f2aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:21.179228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:21.180115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:21.180941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 24/49] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:49:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:21.186269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8148-9852-4b9a-90a1-e09c479da1b1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:21.282400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d8148-9852-4b9a-90a1-e09c479da1b1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:21.316364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be6eac-1ca9-4281-977d-9b68a3f38cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:21.317616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be6eac-1ca9-4281-977d-9b68a3f38cde None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:21.317897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be6eac-1ca9-4281-977d-9b68a3f38cde None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:21.318165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be6eac-1ca9-4281-977d-9b68a3f38cde None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:21.318883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be6eac-1ca9-4281-977d-9b68a3f38cde None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:21.319187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be6eac-1ca9-4281-977d-9b68a3f38cde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:21.320572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be6eac-1ca9-4281-977d-9b68a3f38cde None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:21.328773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 26/50] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:21.334286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414a3f3-80c6-462c-a5df-7a1368a3f2aa None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:21.350621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:21.394231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966f2cf-9c5c-44ed-b91f-071aa36b43dd None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:21.394524 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966f2cf-9c5c-44ed-b91f-071aa36b43dd None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:21.394944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966f2cf-9c5c-44ed-b91f-071aa36b43dd None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:21.396309 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 27/51] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:49:21.401132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c25301-225b-45e3-9863-d69c447b9b20 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:21.401462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c25301-225b-45e3-9863-d69c447b9b20 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:21.401749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c25301-225b-45e3-9863-d69c447b9b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:21.419962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-71c25301-225b-45e3-9863-d69c447b9b20 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:21.421103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-71c25301-225b-45e3-9863-d69c447b9b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:21.432979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414a3f3-80c6-462c-a5df-7a1368a3f2aa None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:21.465229 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bf910-28db-46ac-a702-b96be5758a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:21.465899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bf910-28db-46ac-a702-b96be5758a19 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:21.466185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bf910-28db-46ac-a702-b96be5758a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:21.466462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362bf910-28db-46ac-a702-b96be5758a19 None admin] PATH_INFO: `/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:21.467643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bf910-28db-46ac-a702-b96be5758a19 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba23ee634e9487f8436a5c9c29e0eb9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:21.469118 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362bf910-28db-46ac-a702-b96be5758a19 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:21.470750 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 25/52] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:21 2022] GET /identity/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:21.476844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bf910-28db-46ac-a702-b96be5758a19 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:21.478704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:21.491379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 28/53] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:21.514609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c25301-225b-45e3-9863-d69c447b9b20 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:21.557275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:21.576180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362bf910-28db-46ac-a702-b96be5758a19 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:21.610066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532d421-f6c8-4cbf-a6bf-e48ebfe481b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:21.610591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c25301-225b-45e3-9863-d69c447b9b20 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:21.610727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532d421-f6c8-4cbf-a6bf-e48ebfe481b2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:21.611011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532d421-f6c8-4cbf-a6bf-e48ebfe481b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:21.611288 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532d421-f6c8-4cbf-a6bf-e48ebfe481b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:21.612455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532d421-f6c8-4cbf-a6bf-e48ebfe481b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:21.614555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532d421-f6c8-4cbf-a6bf-e48ebfe481b2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:21.616143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 26/54] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:21.622060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532d421-f6c8-4cbf-a6bf-e48ebfe481b2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:21.644821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b58d6-8fc6-475f-9ddf-345c2cfe3479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:21.645499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b58d6-8fc6-475f-9ddf-345c2cfe3479 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:21.645786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b58d6-8fc6-475f-9ddf-345c2cfe3479 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:21.646067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b58d6-8fc6-475f-9ddf-345c2cfe3479 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:21.647212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b58d6-8fc6-475f-9ddf-345c2cfe3479 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:21.648663 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82b58d6-8fc6-475f-9ddf-345c2cfe3479 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:21.650275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 29/55] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:21.655746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b58d6-8fc6-475f-9ddf-345c2cfe3479 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:21.711273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:21.718374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532d421-f6c8-4cbf-a6bf-e48ebfe481b2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:21.751952 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b58d6-8fc6-475f-9ddf-345c2cfe3479 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:21.752089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23664455-76ca-4301-82f4-0245731d5dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:21.752654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23664455-76ca-4301-82f4-0245731d5dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:21.752940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23664455-76ca-4301-82f4-0245731d5dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:21.753214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23664455-76ca-4301-82f4-0245731d5dd3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:21.754033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23664455-76ca-4301-82f4-0245731d5dd3 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.domain.id=default, user.id=2ba23ee634e9487f8436a5c9c29e0eb9) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:21.754346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23664455-76ca-4301-82f4-0245731d5dd3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:21.755821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23664455-76ca-4301-82f4-0245731d5dd3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:21.761512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 27/56] 10.222.0.42 () {56 vars in 1322 bytes} [Mon Aug 1 11:49:21 2022] GET /identity/v3/role_assignments?user.id=2ba23ee634e9487f8436a5c9c29e0eb9&scope.domain.id=default&role.id=0195bf688a7e464e8ff594afe80b050e => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:21.786850 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b737499-fd58-41b0-a72d-885dc0db26ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:21.787492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b737499-fd58-41b0-a72d-885dc0db26ea None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:21.787772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b737499-fd58-41b0-a72d-885dc0db26ea None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:21.788042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b737499-fd58-41b0-a72d-885dc0db26ea None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:21.788744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b737499-fd58-41b0-a72d-885dc0db26ea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:21.790270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b737499-fd58-41b0-a72d-885dc0db26ea None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:21.818071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 30/57] 10.222.0.42 () {60 vars in 1140 bytes} [Mon Aug 1 11:49:21 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 11:49:23.819549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19582b-4e82-4e51-a278-745a3e054a97 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:23.820092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19582b-4e82-4e51-a278-745a3e054a97 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:23.820092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19582b-4e82-4e51-a278-745a3e054a97 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:23.821481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 28/58] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:23.826558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a0d7c-c9f9-4d32-b07e-310c6a9bf986 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:23.826956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a0d7c-c9f9-4d32-b07e-310c6a9bf986 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:23.827126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a0d7c-c9f9-4d32-b07e-310c6a9bf986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:23.845477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0a7a0d7c-c9f9-4d32-b07e-310c6a9bf986 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:23.846676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0a7a0d7c-c9f9-4d32-b07e-310c6a9bf986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:23.910969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 31/59] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:23.934712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19582b-4e82-4e51-a278-745a3e054a97 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:23.951191 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:24.037877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19582b-4e82-4e51-a278-745a3e054a97 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:24.070488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a70e90-fd96-4260-acd4-e00b1c4301ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:24.071055 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a70e90-fd96-4260-acd4-e00b1c4301ff None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:24.071343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a70e90-fd96-4260-acd4-e00b1c4301ff None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:24.071620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a70e90-fd96-4260-acd4-e00b1c4301ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:24.072760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a70e90-fd96-4260-acd4-e00b1c4301ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:24.074259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a70e90-fd96-4260-acd4-e00b1c4301ff None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:24.075865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 29/60] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:24.081441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a0d7c-c9f9-4d32-b07e-310c6a9bf986 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:24.121741 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:24.178547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a0d7c-c9f9-4d32-b07e-310c6a9bf986 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:24.211045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e41bdd-42b7-405f-bf4a-b6ddff6c5dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:24.211653 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41bdd-42b7-405f-bf4a-b6ddff6c5dc0 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:24.211933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41bdd-42b7-405f-bf4a-b6ddff6c5dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:24.212204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e41bdd-42b7-405f-bf4a-b6ddff6c5dc0 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:24.212883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e41bdd-42b7-405f-bf4a-b6ddff6c5dc0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:24.214398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e41bdd-42b7-405f-bf4a-b6ddff6c5dc0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:24.241276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 32/61] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:49:24 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:27.223286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57b04d-af36-4af0-a4f8-6e8c11873bea None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:27.224293 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57b04d-af36-4af0-a4f8-6e8c11873bea None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:27.224784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce57b04d-af36-4af0-a4f8-6e8c11873bea None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:27.226748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 30/62] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:27.232115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fc6f8-e665-4aaa-a715-d240e40758eb None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:27.232551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fc6f8-e665-4aaa-a715-d240e40758eb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:27.232658 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3fc6f8-e665-4aaa-a715-d240e40758eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:27.258334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-dc3fc6f8-e665-4aaa-a715-d240e40758eb None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:27.259677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dc3fc6f8-e665-4aaa-a715-d240e40758eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:27.360881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 33/63] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:27.396254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57b04d-af36-4af0-a4f8-6e8c11873bea None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:27.502227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:27.504904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4c101-70d0-4a21-af6a-698a5dfcede5 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:27.505482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4c101-70d0-4a21-af6a-698a5dfcede5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:27.506065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4c101-70d0-4a21-af6a-698a5dfcede5 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:27.507641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 34/64] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:27.526057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fbf14-4936-4c4b-85b4-54d6a66546e4 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:27.526383 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce57b04d-af36-4af0-a4f8-6e8c11873bea None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:27.526924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fbf14-4936-4c4b-85b4-54d6a66546e4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:27.527412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1fbf14-4936-4c4b-85b4-54d6a66546e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:27.560618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-dd1fbf14-4936-4c4b-85b4-54d6a66546e4 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:27.563252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dd1fbf14-4936-4c4b-85b4-54d6a66546e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:27.585644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37f568-e75d-4d9d-b63a-7a26499048b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:27.586299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37f568-e75d-4d9d-b63a-7a26499048b9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:27.586585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37f568-e75d-4d9d-b63a-7a26499048b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:27.586860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37f568-e75d-4d9d-b63a-7a26499048b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:27.608951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37f568-e75d-4d9d-b63a-7a26499048b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:27.609613 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-fe37f568-e75d-4d9d-b63a-7a26499048b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:27.614967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:27.615939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:27.616692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:27.616692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:27.616692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:27.616692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:27.616692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:27.616692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:27.616692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:27.616692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:27.616692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:27.616692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:27.616692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:27.616692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:27.621412 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 31/65] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:27.629846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37f568-e75d-4d9d-b63a-7a26499048b9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:27.685407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 35/66] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:27.687042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5b0fe-97c2-41cb-a1a0-1a12fbc4553b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:27.687474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5b0fe-97c2-41cb-a1a0-1a12fbc4553b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:27.688017 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b5b0fe-97c2-41cb-a1a0-1a12fbc4553b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:27.689464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 36/67] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:27.697681 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b00ec-e197-406e-a5d6-31eec883ca76 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:27.698342 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b00ec-e197-406e-a5d6-31eec883ca76 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:27.698820 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489b00ec-e197-406e-a5d6-31eec883ca76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:27.730308 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-489b00ec-e197-406e-a5d6-31eec883ca76 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:27.731844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-489b00ec-e197-406e-a5d6-31eec883ca76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:27.759282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37f568-e75d-4d9d-b63a-7a26499048b9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:27.795344 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad76d1-8324-4ded-b04c-039ac632a43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:27.796299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad76d1-8324-4ded-b04c-039ac632a43c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:27.796903 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad76d1-8324-4ded-b04c-039ac632a43c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:27.797504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afad76d1-8324-4ded-b04c-039ac632a43c None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:27.798440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad76d1-8324-4ded-b04c-039ac632a43c None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:27.798947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad76d1-8324-4ded-b04c-039ac632a43c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:27.800856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afad76d1-8324-4ded-b04c-039ac632a43c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:27.805058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 37/68] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:27.806015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b00ec-e197-406e-a5d6-31eec883ca76 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:27.810824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 32/69] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:27.822777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad76d1-8324-4ded-b04c-039ac632a43c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:27.833207 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:27.899190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:27.916253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489b00ec-e197-406e-a5d6-31eec883ca76 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:27.949935 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afad76d1-8324-4ded-b04c-039ac632a43c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:27.952760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9245f9d-ebf5-45a5-a632-1829cb8b033c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:27.953568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9245f9d-ebf5-45a5-a632-1829cb8b033c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:27.953877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9245f9d-ebf5-45a5-a632-1829cb8b033c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:27.954159 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9245f9d-ebf5-45a5-a632-1829cb8b033c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:27.965694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9245f9d-ebf5-45a5-a632-1829cb8b033c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-e9245f9d-ebf5-45a5-a632-1829cb8b033c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:27.971052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:27.971917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:27.973272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 38/70] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:27.978604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9245f9d-ebf5-45a5-a632-1829cb8b033c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:27.990955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e2597-06ae-4e9a-a224-3d8aabea50ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:27.991605 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e2597-06ae-4e9a-a224-3d8aabea50ab None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:27.991893 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e2597-06ae-4e9a-a224-3d8aabea50ab None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:27.992173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607e2597-06ae-4e9a-a224-3d8aabea50ab None admin] PATH_INFO: `/v3/users/ede771e5606b4919bb7574deefd0336b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.006089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e2597-06ae-4e9a-a224-3d8aabea50ab None admin] RBAC: Authorizing `identity:get_user(user_id=ede771e5606b4919bb7574deefd0336b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:28.007678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607e2597-06ae-4e9a-a224-3d8aabea50ab None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:28.009261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 33/71] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:27 2022] GET /identity/v3/users/ede771e5606b4919bb7574deefd0336b => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:28.010105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e2597-06ae-4e9a-a224-3d8aabea50ab None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:28.069570 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:28.079714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9245f9d-ebf5-45a5-a632-1829cb8b033c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:28.108692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607e2597-06ae-4e9a-a224-3d8aabea50ab None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:28.113851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9be3b-5495-4db8-b0a2-ccd23c10baec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:28.114484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9be3b-5495-4db8-b0a2-ccd23c10baec None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.114767 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9be3b-5495-4db8-b0a2-ccd23c10baec None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.115046 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9be3b-5495-4db8-b0a2-ccd23c10baec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.124935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9be3b-5495-4db8-b0a2-ccd23c10baec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-eaa9be3b-5495-4db8-b0a2-ccd23c10baec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:28.130416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:28.131257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:28.132015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 39/72] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:49:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:28.132837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ae949-4221-4a85-9b06-b7386177669a None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.133109 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ae949-4221-4a85-9b06-b7386177669a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.133419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ae949-4221-4a85-9b06-b7386177669a None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.134786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 40/73] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:28.135794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96369ee3-d76e-4867-ac04-9fab6d383588 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.136177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96369ee3-d76e-4867-ac04-9fab6d383588 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.136441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96369ee3-d76e-4867-ac04-9fab6d383588 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.138913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 41/74] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:28.139686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96369ee3-d76e-4867-ac04-9fab6d383588 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:28.148597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d8f91f-e8c8-4c7b-9911-9873861f7ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:28.148750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:28.149324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8f91f-e8c8-4c7b-9911-9873861f7ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.149698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8f91f-e8c8-4c7b-9911-9873861f7ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.149982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d8f91f-e8c8-4c7b-9911-9873861f7ac3 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.150913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8f91f-e8c8-4c7b-9911-9873861f7ac3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:28.151274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8f91f-e8c8-4c7b-9911-9873861f7ac3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:28.152662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d8f91f-e8c8-4c7b-9911-9873861f7ac3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:28.160844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 34/75] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:28.162031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6ebfc-7fb9-497a-b146-eec456d4dba9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.162322 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6ebfc-7fb9-497a-b146-eec456d4dba9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.162596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f6ebfc-7fb9-497a-b146-eec456d4dba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.179703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-03f6ebfc-7fb9-497a-b146-eec456d4dba9 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:28.180902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-03f6ebfc-7fb9-497a-b146-eec456d4dba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:28.244473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96369ee3-d76e-4867-ac04-9fab6d383588 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:28.246370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 35/76] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:28.254449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6ebfc-7fb9-497a-b146-eec456d4dba9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:28.277971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37ca67-3b7d-4c68-821f-fa1687ec78ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:28.278523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37ca67-3b7d-4c68-821f-fa1687ec78ff None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.278818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37ca67-3b7d-4c68-821f-fa1687ec78ff None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.279099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37ca67-3b7d-4c68-821f-fa1687ec78ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.310274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:28.347787 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37ca67-3b7d-4c68-821f-fa1687ec78ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:28.349338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37ca67-3b7d-4c68-821f-fa1687ec78ff None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:28.356056 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f6ebfc-7fb9-497a-b146-eec456d4dba9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:28.357090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:28.389872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d4482-768e-45cc-8125-d29d7af4cae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:28.390489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d4482-768e-45cc-8125-d29d7af4cae9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.390773 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d4482-768e-45cc-8125-d29d7af4cae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.391050 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d4482-768e-45cc-8125-d29d7af4cae9 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.391767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d4482-768e-45cc-8125-d29d7af4cae9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:28.392071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d4482-768e-45cc-8125-d29d7af4cae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:28.393601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d4482-768e-45cc-8125-d29d7af4cae9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:28.402321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 36/77] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:49:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:28.407971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aeddb-b08f-4774-bfc8-6aea8045bd0f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.408267 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aeddb-b08f-4774-bfc8-6aea8045bd0f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.408549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69aeddb-b08f-4774-bfc8-6aea8045bd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.425401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f69aeddb-b08f-4774-bfc8-6aea8045bd0f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:28.426630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f69aeddb-b08f-4774-bfc8-6aea8045bd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:28.446092 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 42/78] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:28.447119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37ca67-3b7d-4c68-821f-fa1687ec78ff None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:28.494154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 37/79] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:28.505458 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aeddb-b08f-4774-bfc8-6aea8045bd0f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:28.540033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:28.556296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37ca67-3b7d-4c68-821f-fa1687ec78ff None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:28.563420 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:28.590390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc3d95-f29c-4ed1-9be6-dd3aeeb793fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:28.591031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc3d95-f29c-4ed1-9be6-dd3aeeb793fa None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.591310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc3d95-f29c-4ed1-9be6-dd3aeeb793fa None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.591585 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dc3d95-f29c-4ed1-9be6-dd3aeeb793fa None admin] PATH_INFO: `/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.592690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69aeddb-b08f-4774-bfc8-6aea8045bd0f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:28.592872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc3d95-f29c-4ed1-9be6-dd3aeeb793fa None admin] RBAC: Authorizing `identity:get_user(user_id=2ba23ee634e9487f8436a5c9c29e0eb9)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:28.594226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dc3d95-f29c-4ed1-9be6-dd3aeeb793fa None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:28.595827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 43/80] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:28 2022] GET /identity/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:28.596591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc3d95-f29c-4ed1-9be6-dd3aeeb793fa None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:28.627828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599e91a-db3e-4be8-a261-9ad13881ce71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:28.628467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599e91a-db3e-4be8-a261-9ad13881ce71 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.629331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599e91a-db3e-4be8-a261-9ad13881ce71 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.629625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e599e91a-db3e-4be8-a261-9ad13881ce71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.630774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599e91a-db3e-4be8-a261-9ad13881ce71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:28.632215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e599e91a-db3e-4be8-a261-9ad13881ce71 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:28.633816 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 38/81] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:28.634566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599e91a-db3e-4be8-a261-9ad13881ce71 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:28.696601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dc3d95-f29c-4ed1-9be6-dd3aeeb793fa None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:28.729750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc305742-8451-478b-85c1-c57309bedf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:28.730387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc305742-8451-478b-85c1-c57309bedf39 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.730670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc305742-8451-478b-85c1-c57309bedf39 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.730949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc305742-8451-478b-85c1-c57309bedf39 None admin] PATH_INFO: `/v3/users/ede771e5606b4919bb7574deefd0336b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.732128 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc305742-8451-478b-85c1-c57309bedf39 None admin] RBAC: Authorizing `identity:get_user(user_id=ede771e5606b4919bb7574deefd0336b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:28.732719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e599e91a-db3e-4be8-a261-9ad13881ce71 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:28.733642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc305742-8451-478b-85c1-c57309bedf39 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:28.735236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 44/82] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:28 2022] GET /identity/v3/users/ede771e5606b4919bb7574deefd0336b => generated 275 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:28.735996 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc305742-8451-478b-85c1-c57309bedf39 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:28.748326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:28.771518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f9bd7-78bc-4993-b353-c5c23feec91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:28.772153 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9bd7-78bc-4993-b353-c5c23feec91e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.772459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9bd7-78bc-4993-b353-c5c23feec91e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.772713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f9bd7-78bc-4993-b353-c5c23feec91e None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.773915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f9bd7-78bc-4993-b353-c5c23feec91e None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:28.775368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f9bd7-78bc-4993-b353-c5c23feec91e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:28.782898 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 39/83] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:28 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:28.782898 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f9bd7-78bc-4993-b353-c5c23feec91e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:28.783129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:28.838046 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc305742-8451-478b-85c1-c57309bedf39 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:28.873525 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaddaf-800f-4e7a-8ecb-78c720c7c82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:28.874170 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaddaf-800f-4e7a-8ecb-78c720c7c82f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.874484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaddaf-800f-4e7a-8ecb-78c720c7c82f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.874765 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdaddaf-800f-4e7a-8ecb-78c720c7c82f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.877493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f9bd7-78bc-4993-b353-c5c23feec91e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:28.887237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdaddaf-800f-4e7a-8ecb-78c720c7c82f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-3bdaddaf-800f-4e7a-8ecb-78c720c7c82f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:28.892203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:28.893045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 45/84] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:28.894225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaddaf-800f-4e7a-8ecb-78c720c7c82f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:28.921539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1127da-f708-4f57-b4d7-10aa2d6ce743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:28.922174 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1127da-f708-4f57-b4d7-10aa2d6ce743 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:28.922471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1127da-f708-4f57-b4d7-10aa2d6ce743 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:28.922744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1127da-f708-4f57-b4d7-10aa2d6ce743 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:28.973205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:28.993149 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1127da-f708-4f57-b4d7-10aa2d6ce743 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:28.994659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1127da-f708-4f57-b4d7-10aa2d6ce743 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:28.999865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdaddaf-800f-4e7a-8ecb-78c720c7c82f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:29.001402 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:29.033131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f34bd7-4bbc-4627-90fc-2bced67d2ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:29.033792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f34bd7-4bbc-4627-90fc-2bced67d2ca5 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:29.034068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f34bd7-4bbc-4627-90fc-2bced67d2ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:29.034338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f34bd7-4bbc-4627-90fc-2bced67d2ca5 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:29.035546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f34bd7-4bbc-4627-90fc-2bced67d2ca5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:29.037039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f34bd7-4bbc-4627-90fc-2bced67d2ca5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:29.057991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 46/85] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:49:28 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:29.057991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f34bd7-4bbc-4627-90fc-2bced67d2ca5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:29.102929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 40/86] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:29.102929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1127da-f708-4f57-b4d7-10aa2d6ce743 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:29.185991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f34bd7-4bbc-4627-90fc-2bced67d2ca5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:29.195557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:29.221216 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1127da-f708-4f57-b4d7-10aa2d6ce743 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:29.224371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ef002-04f3-4b4c-88fc-e9e098e1a720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:29.225380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ef002-04f3-4b4c-88fc-e9e098e1a720 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:29.225380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ef002-04f3-4b4c-88fc-e9e098e1a720 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:29.225888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4ef002-04f3-4b4c-88fc-e9e098e1a720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:29.262166 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:29.262763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69921950-038f-4418-9553-2356fb922780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:29.263359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69921950-038f-4418-9553-2356fb922780 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:29.263673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69921950-038f-4418-9553-2356fb922780 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:29.263937 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69921950-038f-4418-9553-2356fb922780 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:29.265034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69921950-038f-4418-9553-2356fb922780 None admin] RBAC: Adding query filter params (role.id=251e50fd870c48f3a02b69587144b7bf, scope.project.id=de598ff4856d4edc9937647ebb5aa468, user.id=ede771e5606b4919bb7574deefd0336b) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:29.265490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69921950-038f-4418-9553-2356fb922780 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:29.267850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69921950-038f-4418-9553-2356fb922780 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:29.275438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 41/87] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:29 2022] GET /identity/v3/role_assignments?user.id=ede771e5606b4919bb7574deefd0336b&scope.project.id=de598ff4856d4edc9937647ebb5aa468&role.id=251e50fd870c48f3a02b69587144b7bf => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:29.276080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69921950-038f-4418-9553-2356fb922780 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:29.326678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ef002-04f3-4b4c-88fc-e9e098e1a720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:29.329582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4ef002-04f3-4b4c-88fc-e9e098e1a720 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:29.441385 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69921950-038f-4418-9553-2356fb922780 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:29.466878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 47/88] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:29.467625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ef002-04f3-4b4c-88fc-e9e098e1a720 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:29.481247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368af51-b11c-43e6-a233-541a4b13a140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:29.481911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368af51-b11c-43e6-a233-541a4b13a140 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:29.482204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368af51-b11c-43e6-a233-541a4b13a140 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:29.482485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9368af51-b11c-43e6-a233-541a4b13a140 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:29.483213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368af51-b11c-43e6-a233-541a4b13a140 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:29.483608 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368af51-b11c-43e6-a233-541a4b13a140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:29.485146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9368af51-b11c-43e6-a233-541a4b13a140 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:29.494675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 42/89] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:29.495942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368af51-b11c-43e6-a233-541a4b13a140 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:29.509674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:29.542075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:29.617689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9368af51-b11c-43e6-a233-541a4b13a140 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:29.637796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4ef002-04f3-4b4c-88fc-e9e098e1a720 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:29.654226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42983c-c556-4e3e-bc53-bd3538e358b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:29.654882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42983c-c556-4e3e-bc53-bd3538e358b4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:29.655171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42983c-c556-4e3e-bc53-bd3538e358b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:29.655448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42983c-c556-4e3e-bc53-bd3538e358b4 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:29.656644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42983c-c556-4e3e-bc53-bd3538e358b4 None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:29.658284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42983c-c556-4e3e-bc53-bd3538e358b4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:29.660184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 43/90] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:29 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:29.660796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42983c-c556-4e3e-bc53-bd3538e358b4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:29.731033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d3ac5-ae9b-4f6c-850a-5eba9ae9a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:29.731625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d3ac5-ae9b-4f6c-850a-5eba9ae9a563 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:29.731909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d3ac5-ae9b-4f6c-850a-5eba9ae9a563 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:29.732184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d3ac5-ae9b-4f6c-850a-5eba9ae9a563 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:29.738074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d3ac5-ae9b-4f6c-850a-5eba9ae9a563 None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:29.739549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d3ac5-ae9b-4f6c-850a-5eba9ae9a563 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:29.741239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 48/91] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:29 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:29.742115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d3ac5-ae9b-4f6c-850a-5eba9ae9a563 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:29.770279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:29.798374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42983c-c556-4e3e-bc53-bd3538e358b4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:29.863313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b749f-4117-4d90-b4c5-88cfc25b4c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:29.864018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b749f-4117-4d90-b4c5-88cfc25b4c3f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:29.864301 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b749f-4117-4d90-b4c5-88cfc25b4c3f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:29.864574 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3b749f-4117-4d90-b4c5-88cfc25b4c3f None admin] PATH_INFO: `/v3/users/ede771e5606b4919bb7574deefd0336b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:29.865960 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b749f-4117-4d90-b4c5-88cfc25b4c3f None admin] RBAC: Authorizing `identity:get_user(user_id=ede771e5606b4919bb7574deefd0336b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:29.867424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3b749f-4117-4d90-b4c5-88cfc25b4c3f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:29.870784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 44/92] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:29 2022] GET /identity/v3/users/ede771e5606b4919bb7574deefd0336b => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:29.877701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b749f-4117-4d90-b4c5-88cfc25b4c3f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:29.920784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d3ac5-ae9b-4f6c-850a-5eba9ae9a563 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:29.966861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:29.991019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8cbdc-4932-486d-9892-93e88bf8db6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:29.991578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8cbdc-4932-486d-9892-93e88bf8db6b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:29.991869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8cbdc-4932-486d-9892-93e88bf8db6b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:29.992147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8cbdc-4932-486d-9892-93e88bf8db6b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:29.993133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8cbdc-4932-486d-9892-93e88bf8db6b None admin] RBAC: Adding query filter params (role.id=d0262ce715f7448babe9cef93dc25e9d, scope.project.id=de598ff4856d4edc9937647ebb5aa468, user.id=ede771e5606b4919bb7574deefd0336b) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:29.993472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8cbdc-4932-486d-9892-93e88bf8db6b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:29.995060 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8cbdc-4932-486d-9892-93e88bf8db6b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:30.022555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 49/93] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:29 2022] GET /identity/v3/role_assignments?user.id=ede771e5606b4919bb7574deefd0336b&scope.project.id=de598ff4856d4edc9937647ebb5aa468&role.id=d0262ce715f7448babe9cef93dc25e9d => generated 259 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:30.023569 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8cbdc-4932-486d-9892-93e88bf8db6b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:30.033075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3b749f-4117-4d90-b4c5-88cfc25b4c3f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:30.102803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52005848-bb80-4ac2-8fa8-927ceb154f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:30.103444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52005848-bb80-4ac2-8fa8-927ceb154f26 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:30.103730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52005848-bb80-4ac2-8fa8-927ceb154f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:30.104010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52005848-bb80-4ac2-8fa8-927ceb154f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:30.108468 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52005848-bb80-4ac2-8fa8-927ceb154f26 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=de598ff4856d4edc9937647ebb5aa468, user.id=2ba23ee634e9487f8436a5c9c29e0eb9) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:30.108791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52005848-bb80-4ac2-8fa8-927ceb154f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:30.110283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52005848-bb80-4ac2-8fa8-927ceb154f26 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:30.124363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 45/94] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:29 2022] GET /identity/v3/role_assignments?user.id=2ba23ee634e9487f8436a5c9c29e0eb9&scope.project.id=de598ff4856d4edc9937647ebb5aa468&role.id=0195bf688a7e464e8ff594afe80b050e => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:30.202273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8cbdc-4932-486d-9892-93e88bf8db6b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:30.253268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300ef23-1d39-4343-8648-0b4f0ae1cc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:30.254650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300ef23-1d39-4343-8648-0b4f0ae1cc1a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:30.254936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300ef23-1d39-4343-8648-0b4f0ae1cc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:30.255211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300ef23-1d39-4343-8648-0b4f0ae1cc1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:30.330772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:30.342389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300ef23-1d39-4343-8648-0b4f0ae1cc1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:30.343881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1300ef23-1d39-4343-8648-0b4f0ae1cc1a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:30.450291 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 50/95] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:30.455941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52005848-bb80-4ac2-8fa8-927ceb154f26 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:30.480553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:30.604876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52005848-bb80-4ac2-8fa8-927ceb154f26 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:30.639211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ceb3bb-2fcc-425b-a909-c59cb8bec4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:30.639861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ceb3bb-2fcc-425b-a909-c59cb8bec4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:30.640148 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ceb3bb-2fcc-425b-a909-c59cb8bec4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:30.640431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ceb3bb-2fcc-425b-a909-c59cb8bec4d0 None admin] PATH_INFO: `/v3/projects/af0ef20d4bdd4c1183a8148e4eb1a9a3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:30.641651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ceb3bb-2fcc-425b-a909-c59cb8bec4d0 None admin] RBAC: Authorizing `identity:get_project(project_id=af0ef20d4bdd4c1183a8148e4eb1a9a3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:30.643136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ceb3bb-2fcc-425b-a909-c59cb8bec4d0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:30.645389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 46/96] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:30 2022] GET /identity/v3/projects/af0ef20d4bdd4c1183a8148e4eb1a9a3 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:30.651416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300ef23-1d39-4343-8648-0b4f0ae1cc1a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:30.744837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:30.755563 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1300ef23-1d39-4343-8648-0b4f0ae1cc1a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:30.790771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cb970-b0ff-42b4-a74f-553ecde05328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:30.791456 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cb970-b0ff-42b4-a74f-553ecde05328 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:30.791743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cb970-b0ff-42b4-a74f-553ecde05328 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:30.792022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cb970-b0ff-42b4-a74f-553ecde05328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:30.792881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cb970-b0ff-42b4-a74f-553ecde05328 None admin] RBAC: Adding query filter params (role.id=251e50fd870c48f3a02b69587144b7bf, scope.project.id=af0ef20d4bdd4c1183a8148e4eb1a9a3, user.id=ede771e5606b4919bb7574deefd0336b) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:30.793205 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cb970-b0ff-42b4-a74f-553ecde05328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:30.794689 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cb970-b0ff-42b4-a74f-553ecde05328 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:30.801137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 51/97] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:30 2022] GET /identity/v3/role_assignments?user.id=ede771e5606b4919bb7574deefd0336b&scope.project.id=af0ef20d4bdd4c1183a8148e4eb1a9a3&role.id=251e50fd870c48f3a02b69587144b7bf => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:31.681660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74afb-bf98-4ffd-a028-a0780c7c4781 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:31.682667 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74afb-bf98-4ffd-a028-a0780c7c4781 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:31.683159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e74afb-bf98-4ffd-a028-a0780c7c4781 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:31.684727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 47/98] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:31.690522 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c22b1-c898-4ad3-a2a1-e5c3e52b2c48 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:31.692015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c22b1-c898-4ad3-a2a1-e5c3e52b2c48 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:31.692514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c22b1-c898-4ad3-a2a1-e5c3e52b2c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:31.711223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b86c22b1-c898-4ad3-a2a1-e5c3e52b2c48 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:31.712755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b86c22b1-c898-4ad3-a2a1-e5c3e52b2c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:31.799746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 52/99] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:31.838891 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e74afb-bf98-4ffd-a028-a0780c7c4781 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:31.926483 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:31.959672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e74afb-bf98-4ffd-a028-a0780c7c4781 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:32.003523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c752e55-ee69-4e2a-a000-dd32c865ef4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:32.004212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c752e55-ee69-4e2a-a000-dd32c865ef4d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:32.004497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c752e55-ee69-4e2a-a000-dd32c865ef4d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:32.004775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c752e55-ee69-4e2a-a000-dd32c865ef4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:32.024082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c752e55-ee69-4e2a-a000-dd32c865ef4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8c752e55-ee69-4e2a-a000-dd32c865ef4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:32.030169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:32.031029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:32.032218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 48/100] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:32.039500 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c22b1-c898-4ad3-a2a1-e5c3e52b2c48 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:32.156564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58fe45-d1df-4f77-be79-edcefd780919 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:32.156878 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58fe45-d1df-4f77-be79-edcefd780919 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:32.157130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a58fe45-d1df-4f77-be79-edcefd780919 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:32.158704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 49/101] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:49:32.164998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:32.165205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bb221-ef9b-4ec5-8280-043d42f2eb79 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:32.165472 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bb221-ef9b-4ec5-8280-043d42f2eb79 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:32.165758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5bb221-ef9b-4ec5-8280-043d42f2eb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:32.187293 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ed5bb221-ef9b-4ec5-8280-043d42f2eb79 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:32.188658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ed5bb221-ef9b-4ec5-8280-043d42f2eb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:32.194076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86c22b1-c898-4ad3-a2a1-e5c3e52b2c48 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:32.261454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378a4176-00fd-4d8e-bf5d-ab4d2c5f3f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:32.261937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a4176-00fd-4d8e-bf5d-ab4d2c5f3f3c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:32.262239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a4176-00fd-4d8e-bf5d-ab4d2c5f3f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:32.262517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a4176-00fd-4d8e-bf5d-ab4d2c5f3f3c None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:32.263251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a4176-00fd-4d8e-bf5d-ab4d2c5f3f3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:32.263617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a4176-00fd-4d8e-bf5d-ab4d2c5f3f3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:32.264948 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378a4176-00fd-4d8e-bf5d-ab4d2c5f3f3c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:32.278131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 53/102] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:32.278131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b807cb-1231-4cb5-9d10-a34a61ce5d6c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:32.278131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b807cb-1231-4cb5-9d10-a34a61ce5d6c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:32.278131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b807cb-1231-4cb5-9d10-a34a61ce5d6c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:32.278131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 54/103] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:32.281414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b807cb-1231-4cb5-9d10-a34a61ce5d6c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:32.300178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 50/104] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:32.301765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df57954-9aae-45cb-8e52-7560378b4e6e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:32.301940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df57954-9aae-45cb-8e52-7560378b4e6e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:32.303809 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df57954-9aae-45cb-8e52-7560378b4e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:32.341460 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9df57954-9aae-45cb-8e52-7560378b4e6e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:32.342936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9df57954-9aae-45cb-8e52-7560378b4e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:32.442726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b807cb-1231-4cb5-9d10-a34a61ce5d6c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:32.479968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:32.487703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f23a8-f44f-46f3-8b44-969479f0fccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:32.488746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f23a8-f44f-46f3-8b44-969479f0fccf None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:32.489031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f23a8-f44f-46f3-8b44-969479f0fccf None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:32.489378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f23a8-f44f-46f3-8b44-969479f0fccf None admin] PATH_INFO: `/v3/users/6b4bc018f4674c9aa66691e4ef4e8e45` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:32.504471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 51/105] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:32.505471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df57954-9aae-45cb-8e52-7560378b4e6e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:32.512194 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f23a8-f44f-46f3-8b44-969479f0fccf None admin] RBAC: Authorizing `identity:get_user(user_id=6b4bc018f4674c9aa66691e4ef4e8e45)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:32.513707 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821f23a8-f44f-46f3-8b44-969479f0fccf None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:32.516659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 55/106] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:32 2022] GET /identity/v3/users/6b4bc018f4674c9aa66691e4ef4e8e45 => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:32.523302 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f23a8-f44f-46f3-8b44-969479f0fccf None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:32.527173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:32.640261 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821f23a8-f44f-46f3-8b44-969479f0fccf None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:32.675502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf407d-e874-41cf-b156-3a948c29246a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:32.676132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf407d-e874-41cf-b156-3a948c29246a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:32.676417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf407d-e874-41cf-b156-3a948c29246a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:32.676696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cf407d-e874-41cf-b156-3a948c29246a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:32.685826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df57954-9aae-45cb-8e52-7560378b4e6e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:32.753413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0d3fb-76d3-4e26-8c4a-40951058f1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:32.755594 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0d3fb-76d3-4e26-8c4a-40951058f1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:32.756910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0d3fb-76d3-4e26-8c4a-40951058f1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:32.757419 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0d3fb-76d3-4e26-8c4a-40951058f1a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:32.780689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df0d3fb-76d3-4e26-8c4a-40951058f1a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8df0d3fb-76d3-4e26-8c4a-40951058f1a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:32.791134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:32.792004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:32.792793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:32.792793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:32.792793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:32.792793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:32.792793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:32.792793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:32.792793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:32.792793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:32.792793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:32.792793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:32.792793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:32.792793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:32.797548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 52/107] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:32.799417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0d3fb-76d3-4e26-8c4a-40951058f1a5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:32.803589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf407d-e874-41cf-b156-3a948c29246a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:32.807572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cf407d-e874-41cf-b156-3a948c29246a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:32.821645 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:32.877706 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:32.921453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0d3fb-76d3-4e26-8c4a-40951058f1a5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:32.964908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 56/108] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 11:49:32.966544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956b810-9420-4190-9cc7-68546e0faa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:32.967426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b810-9420-4190-9cc7-68546e0faa4d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:32.967945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b810-9420-4190-9cc7-68546e0faa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:32.968415 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e956b810-9420-4190-9cc7-68546e0faa4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:32.973327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf407d-e874-41cf-b156-3a948c29246a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:32.975035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956b810-9420-4190-9cc7-68546e0faa4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:32.977528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e956b810-9420-4190-9cc7-68546e0faa4d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:32.979753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 53/109] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:32.980737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956b810-9420-4190-9cc7-68546e0faa4d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:33.090394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e956b810-9420-4190-9cc7-68546e0faa4d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:33.126962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37b79-6f9b-409d-a78d-4f2ca9830e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:33.127979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37b79-6f9b-409d-a78d-4f2ca9830e54 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.128482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37b79-6f9b-409d-a78d-4f2ca9830e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.128995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b37b79-6f9b-409d-a78d-4f2ca9830e54 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.130414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b37b79-6f9b-409d-a78d-4f2ca9830e54 None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:33.132135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b37b79-6f9b-409d-a78d-4f2ca9830e54 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:33.134210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 54/110] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:32 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:33.135165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37b79-6f9b-409d-a78d-4f2ca9830e54 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:33.157703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:33.175273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cf407d-e874-41cf-b156-3a948c29246a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:33.182453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:33.242565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b37b79-6f9b-409d-a78d-4f2ca9830e54 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:33.278763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92992fbc-6f01-4ab6-b7a4-458dae2d3a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:33.279748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992fbc-6f01-4ab6-b7a4-458dae2d3a79 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.280226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992fbc-6f01-4ab6-b7a4-458dae2d3a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.280694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992fbc-6f01-4ab6-b7a4-458dae2d3a79 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.281609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92992fbc-6f01-4ab6-b7a4-458dae2d3a79 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:33.283275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92992fbc-6f01-4ab6-b7a4-458dae2d3a79 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:33.286210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20788b8-3470-47b1-9ee5-41c286ed0c98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:33.286875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20788b8-3470-47b1-9ee5-41c286ed0c98 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.287162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20788b8-3470-47b1-9ee5-41c286ed0c98 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.287438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20788b8-3470-47b1-9ee5-41c286ed0c98 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.288183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20788b8-3470-47b1-9ee5-41c286ed0c98 None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:33.288492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20788b8-3470-47b1-9ee5-41c286ed0c98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:33.289935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20788b8-3470-47b1-9ee5-41c286ed0c98 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:33.307965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 57/111] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:33.314338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20788b8-3470-47b1-9ee5-41c286ed0c98 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:33.317873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 55/112] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:49:33 2022] POST /identity/v3/projects => generated 302 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:33.319218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92992fbc-6f01-4ab6-b7a4-458dae2d3a79 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:33.409816 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:33.525064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92992fbc-6f01-4ab6-b7a4-458dae2d3a79 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:33.541959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20788b8-3470-47b1-9ee5-41c286ed0c98 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:33.571304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e21f26-d214-46a3-8f31-08ec239e8662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:33.572221 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e21f26-d214-46a3-8f31-08ec239e8662 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.572505 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e21f26-d214-46a3-8f31-08ec239e8662 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.573109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e21f26-d214-46a3-8f31-08ec239e8662 None admin] PATH_INFO: `/v3/users/ede771e5606b4919bb7574deefd0336b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.574632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e21f26-d214-46a3-8f31-08ec239e8662 None admin] RBAC: Authorizing `identity:get_user(user_id=ede771e5606b4919bb7574deefd0336b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:33.576616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e21f26-d214-46a3-8f31-08ec239e8662 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:33.578745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 56/113] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:33 2022] GET /identity/v3/users/ede771e5606b4919bb7574deefd0336b => generated 275 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:33.583273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddea16-f199-4f52-9500-73fd561333c5 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.583856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddea16-f199-4f52-9500-73fd561333c5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.584306 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beddea16-f199-4f52-9500-73fd561333c5 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.584872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d9287-8090-4764-bd4b-ef7331936bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:33.585650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d9287-8090-4764-bd4b-ef7331936bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.585938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d9287-8090-4764-bd4b-ef7331936bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.586228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d9287-8090-4764-bd4b-ef7331936bb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.586598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 57/114] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:33.587038 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d9287-8090-4764-bd4b-ef7331936bb3 None admin] RBAC: Adding query filter params (role.id=fce6359ef8b8407a9887ee97701093a8, scope.project.id=de598ff4856d4edc9937647ebb5aa468, user.id=6b4bc018f4674c9aa66691e4ef4e8e45) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:33.587356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d9287-8090-4764-bd4b-ef7331936bb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:33.588177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ad18e-b8e5-41d8-ad45-f9ab1d6e6624 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.588600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ad18e-b8e5-41d8-ad45-f9ab1d6e6624 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.588884 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d9287-8090-4764-bd4b-ef7331936bb3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:33.589178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0ad18e-b8e5-41d8-ad45-f9ab1d6e6624 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.591100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 58/115] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:33.591995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ad18e-b8e5-41d8-ad45-f9ab1d6e6624 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:33.595514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 58/116] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:33 2022] GET /identity/v3/role_assignments?user.id=6b4bc018f4674c9aa66691e4ef4e8e45&scope.project.id=de598ff4856d4edc9937647ebb5aa468&role.id=fce6359ef8b8407a9887ee97701093a8 => generated 259 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:33.598175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23c83f-3f66-4be4-bf26-fde3940a69e7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.599025 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23c83f-3f66-4be4-bf26-fde3940a69e7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.599420 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23c83f-3f66-4be4-bf26-fde3940a69e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.621902 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1e23c83f-3f66-4be4-bf26-fde3940a69e7 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:33.623153 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1e23c83f-3f66-4be4-bf26-fde3940a69e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:33.653552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:33.713743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 59/117] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:33.715497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209a379-bb84-44fc-aa8b-9cd6100c0fb6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.715998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209a379-bb84-44fc-aa8b-9cd6100c0fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.716498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209a379-bb84-44fc-aa8b-9cd6100c0fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.730634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0ad18e-b8e5-41d8-ad45-f9ab1d6e6624 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:33.738715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a209a379-bb84-44fc-aa8b-9cd6100c0fb6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:33.740384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a209a379-bb84-44fc-aa8b-9cd6100c0fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:33.746323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:33.772874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223b9fc4-d5e4-4a0b-8975-4ae9925c0bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:33.773883 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b9fc4-d5e4-4a0b-8975-4ae9925c0bff None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.774364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b9fc4-d5e4-4a0b-8975-4ae9925c0bff None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.774944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b9fc4-d5e4-4a0b-8975-4ae9925c0bff None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.776337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b9fc4-d5e4-4a0b-8975-4ae9925c0bff None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:33.778130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223b9fc4-d5e4-4a0b-8975-4ae9925c0bff None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:33.780367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 59/118] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:33 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:33.781847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bd2cf-60d3-48ad-8de5-11cbaa2e8ece None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.782334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bd2cf-60d3-48ad-8de5-11cbaa2e8ece None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.782787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8bd2cf-60d3-48ad-8de5-11cbaa2e8ece None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.784195 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 60/119] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:33.789084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bd2cf-60d3-48ad-8de5-11cbaa2e8ece None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:33.817551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 60/120] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:33.818493 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209a379-bb84-44fc-aa8b-9cd6100c0fb6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:33.905086 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8bd2cf-60d3-48ad-8de5-11cbaa2e8ece None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:33.939222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:33.945778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fc7f76-e19a-4cc8-ad59-9c8d18da2ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:33.946550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7f76-e19a-4cc8-ad59-9c8d18da2ffe None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.946901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7f76-e19a-4cc8-ad59-9c8d18da2ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.947238 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fc7f76-e19a-4cc8-ad59-9c8d18da2ffe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.951337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209a379-bb84-44fc-aa8b-9cd6100c0fb6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:33.960147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fc7f76-e19a-4cc8-ad59-9c8d18da2ffe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b9fc7f76-e19a-4cc8-ad59-9c8d18da2ffe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:33.965882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:33.966762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 61/121] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:49:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:33.971994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c670d-8fbf-4d8b-9946-65e28d826cdd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:33.972736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c670d-8fbf-4d8b-9946-65e28d826cdd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:33.972736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c670d-8fbf-4d8b-9946-65e28d826cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:33.990020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f29c670d-8fbf-4d8b-9946-65e28d826cdd None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:33.991226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f29c670d-8fbf-4d8b-9946-65e28d826cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:33.999155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75370348-d84d-45d5-817e-419ee576bd5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:34.000127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75370348-d84d-45d5-817e-419ee576bd5f None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:34.000637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75370348-d84d-45d5-817e-419ee576bd5f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:34.001125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75370348-d84d-45d5-817e-419ee576bd5f None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468/users/ede771e5606b4919bb7574deefd0336b/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:34.003584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75370348-d84d-45d5-817e-419ee576bd5f None admin] RBAC: Authorizing `identity:create_grant(project_id=de598ff4856d4edc9937647ebb5aa468, user_id=ede771e5606b4919bb7574deefd0336b, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:34.006108 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75370348-d84d-45d5-817e-419ee576bd5f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:34.021482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 61/122] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:49:33 2022] PUT /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468/users/ede771e5606b4919bb7574deefd0336b/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:49:34.023036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75370348-d84d-45d5-817e-419ee576bd5f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:34.029120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:34.064893 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 62/123] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:34.065816 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c670d-8fbf-4d8b-9946-65e28d826cdd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:34.149745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75370348-d84d-45d5-817e-419ee576bd5f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:34.173885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c670d-8fbf-4d8b-9946-65e28d826cdd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:34.191693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfac22-f573-425a-b250-117e728e671a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:34.192916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfac22-f573-425a-b250-117e728e671a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:34.193485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfac22-f573-425a-b250-117e728e671a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:34.194047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccfac22-f573-425a-b250-117e728e671a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:34.206828 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccfac22-f573-425a-b250-117e728e671a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:34.211339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb83249-4aca-4c6f-ab00-e14c0d262250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:34.211962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb83249-4aca-4c6f-ab00-e14c0d262250 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:34.212243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb83249-4aca-4c6f-ab00-e14c0d262250 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:34.212510 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb83249-4aca-4c6f-ab00-e14c0d262250 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:34.213230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb83249-4aca-4c6f-ab00-e14c0d262250 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:34.213570 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb83249-4aca-4c6f-ab00-e14c0d262250 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-1ccfac22-f573-425a-b250-117e728e671a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:34.214217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:34.215019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:34.215779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:34.215779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:34.215779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:34.215779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:34.215779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:34.215779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:34.215779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:34.215779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:34.215779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:34.215779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:34.215779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:34.215779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:34.216453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb83249-4aca-4c6f-ab00-e14c0d262250 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:34.218968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 62/124] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:49:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:34.220236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfac22-f573-425a-b250-117e728e671a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:34.227793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 63/125] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:49:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:34.227793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb83249-4aca-4c6f-ab00-e14c0d262250 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:34.247664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:34.259040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:34.341122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb83249-4aca-4c6f-ab00-e14c0d262250 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:34.374020 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccfac22-f573-425a-b250-117e728e671a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:34.379385 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb737bb0-979f-43fe-893f-98fd70b77e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:34.380017 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb737bb0-979f-43fe-893f-98fd70b77e27 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:34.380295 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb737bb0-979f-43fe-893f-98fd70b77e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:34.380566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb737bb0-979f-43fe-893f-98fd70b77e27 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:34.381288 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb737bb0-979f-43fe-893f-98fd70b77e27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:34.381612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb737bb0-979f-43fe-893f-98fd70b77e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:34.383003 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb737bb0-979f-43fe-893f-98fd70b77e27 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:34.391809 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 64/126] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:34.392690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb737bb0-979f-43fe-893f-98fd70b77e27 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:34.413780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0e925-c1c0-4222-b045-955c7c5b1838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:34.414778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0e925-c1c0-4222-b045-955c7c5b1838 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:34.415258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0e925-c1c0-4222-b045-955c7c5b1838 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:34.415729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b0e925-c1c0-4222-b045-955c7c5b1838 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:34.427407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b0e925-c1c0-4222-b045-955c7c5b1838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-91b0e925-c1c0-4222-b045-955c7c5b1838 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:34.432672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:34.433560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:34.434320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:34.434320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:34.434320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:34.434320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:34.434320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:34.434320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:34.434320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:34.434320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:34.434320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:34.434320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:34.434320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:34.434320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:34.436617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 63/127] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:34.437804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0e925-c1c0-4222-b045-955c7c5b1838 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:34.494480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb737bb0-979f-43fe-893f-98fd70b77e27 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:34.497623 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:34.514436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:34.549155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b0e925-c1c0-4222-b045-955c7c5b1838 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:34.560357 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d739f-345c-4d77-b91b-fbb8cc1b6c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:34.561035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d739f-345c-4d77-b91b-fbb8cc1b6c38 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:34.561282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d739f-345c-4d77-b91b-fbb8cc1b6c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:34.561577 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536d739f-345c-4d77-b91b-fbb8cc1b6c38 None admin] PATH_INFO: `/v3/users/ede771e5606b4919bb7574deefd0336b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:34.562765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d739f-345c-4d77-b91b-fbb8cc1b6c38 None admin] RBAC: Authorizing `identity:get_user(user_id=ede771e5606b4919bb7574deefd0336b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:34.564253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536d739f-345c-4d77-b91b-fbb8cc1b6c38 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:34.565855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 65/128] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:34 2022] GET /identity/v3/users/ede771e5606b4919bb7574deefd0336b => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:34.566672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d739f-345c-4d77-b91b-fbb8cc1b6c38 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:34.595440 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a68f3-7429-430c-9cd0-4f49f2075400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:34.597107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a68f3-7429-430c-9cd0-4f49f2075400 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:34.598416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a68f3-7429-430c-9cd0-4f49f2075400 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:34.600072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a68f3-7429-430c-9cd0-4f49f2075400 None admin] PATH_INFO: `/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:34.602910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a68f3-7429-430c-9cd0-4f49f2075400 None admin] RBAC: Authorizing `identity:get_user(user_id=2ba23ee634e9487f8436a5c9c29e0eb9)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:34.604587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92a68f3-7429-430c-9cd0-4f49f2075400 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:34.608905 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 64/129] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:34 2022] GET /identity/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:34.610679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a68f3-7429-430c-9cd0-4f49f2075400 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:34.713322 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536d739f-345c-4d77-b91b-fbb8cc1b6c38 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:34.744367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6189b-4b70-4501-bc4d-970053931efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:34.745144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6189b-4b70-4501-bc4d-970053931efc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:34.745380 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6189b-4b70-4501-bc4d-970053931efc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:34.745659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6189b-4b70-4501-bc4d-970053931efc None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:34.754411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6189b-4b70-4501-bc4d-970053931efc None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:34.754729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6189b-4b70-4501-bc4d-970053931efc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:34.756174 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6189b-4b70-4501-bc4d-970053931efc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:34.768649 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92a68f3-7429-430c-9cd0-4f49f2075400 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:34.768969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 66/130] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:34.769867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6189b-4b70-4501-bc4d-970053931efc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:34.802965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:34.830109 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe33ac2-0f71-4769-a652-2f72f41d8e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:34.830776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe33ac2-0f71-4769-a652-2f72f41d8e1d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:34.831065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe33ac2-0f71-4769-a652-2f72f41d8e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:34.831346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe33ac2-0f71-4769-a652-2f72f41d8e1d None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:34.832784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe33ac2-0f71-4769-a652-2f72f41d8e1d None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:34.834336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe33ac2-0f71-4769-a652-2f72f41d8e1d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:34.836492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 65/131] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:34 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:34.841549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe33ac2-0f71-4769-a652-2f72f41d8e1d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:34.855756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:34.882046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6189b-4b70-4501-bc4d-970053931efc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:34.934441 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e579d-5513-4387-9601-0fbb95952aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:34.935114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e579d-5513-4387-9601-0fbb95952aae None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:34.935398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e579d-5513-4387-9601-0fbb95952aae None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:34.935685 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46e579d-5513-4387-9601-0fbb95952aae None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:34.936913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e579d-5513-4387-9601-0fbb95952aae None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:34.939313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46e579d-5513-4387-9601-0fbb95952aae None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:34.941093 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 67/132] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:34 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:34.944716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e579d-5513-4387-9601-0fbb95952aae None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:35.038370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe33ac2-0f71-4769-a652-2f72f41d8e1d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:35.103314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba5f01-c09f-49e2-ac85-e91974741bfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:35.103983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba5f01-c09f-49e2-ac85-e91974741bfb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:35.104262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba5f01-c09f-49e2-ac85-e91974741bfb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:35.104614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba5f01-c09f-49e2-ac85-e91974741bfb None admin] PATH_INFO: `/v3/users/ede771e5606b4919bb7574deefd0336b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:35.106994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba5f01-c09f-49e2-ac85-e91974741bfb None admin] RBAC: Authorizing `identity:get_user(user_id=ede771e5606b4919bb7574deefd0336b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:35.108480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba5f01-c09f-49e2-ac85-e91974741bfb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:35.110178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 66/133] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:34 2022] GET /identity/v3/users/ede771e5606b4919bb7574deefd0336b => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:35.110941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba5f01-c09f-49e2-ac85-e91974741bfb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:35.133676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:35.146266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46e579d-5513-4387-9601-0fbb95952aae None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:35.214690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d248bea-8f0b-41cf-9961-43daa57ca88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:35.215377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d248bea-8f0b-41cf-9961-43daa57ca88e None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:35.215657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d248bea-8f0b-41cf-9961-43daa57ca88e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:35.216159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d248bea-8f0b-41cf-9961-43daa57ca88e None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468/users/ede771e5606b4919bb7574deefd0336b/roles/d0262ce715f7448babe9cef93dc25e9d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:35.220234 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d248bea-8f0b-41cf-9961-43daa57ca88e None admin] RBAC: Authorizing `identity:create_grant(project_id=de598ff4856d4edc9937647ebb5aa468, user_id=ede771e5606b4919bb7574deefd0336b, role_id=d0262ce715f7448babe9cef93dc25e9d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:35.221728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d248bea-8f0b-41cf-9961-43daa57ca88e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:35.253364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 68/134] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:49:34 2022] PUT /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468/users/ede771e5606b4919bb7574deefd0336b/roles/d0262ce715f7448babe9cef93dc25e9d => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:49:35.258464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d248bea-8f0b-41cf-9961-43daa57ca88e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:35.267679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:35.326443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba5f01-c09f-49e2-ac85-e91974741bfb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:35.425797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d248bea-8f0b-41cf-9961-43daa57ca88e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:35.446023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c4f92-7047-46a4-ac94-6b2ca73fbc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:35.447075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c4f92-7047-46a4-ac94-6b2ca73fbc99 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:35.447597 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c4f92-7047-46a4-ac94-6b2ca73fbc99 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:35.448073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c4f92-7047-46a4-ac94-6b2ca73fbc99 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468/users/2ba23ee634e9487f8436a5c9c29e0eb9/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:35.454137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c4f92-7047-46a4-ac94-6b2ca73fbc99 None admin] RBAC: Authorizing `identity:create_grant(project_id=de598ff4856d4edc9937647ebb5aa468, user_id=2ba23ee634e9487f8436a5c9c29e0eb9, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:35.455890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c4f92-7047-46a4-ac94-6b2ca73fbc99 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:35.474651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8577eca3-e0d0-4d3e-98a2-a10d3618247b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:35.483492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577eca3-e0d0-4d3e-98a2-a10d3618247b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:35.483793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577eca3-e0d0-4d3e-98a2-a10d3618247b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:35.485698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577eca3-e0d0-4d3e-98a2-a10d3618247b None admin] PATH_INFO: `/v3/projects/af0ef20d4bdd4c1183a8148e4eb1a9a3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:35.488192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577eca3-e0d0-4d3e-98a2-a10d3618247b None admin] RBAC: Authorizing `identity:get_project(project_id=af0ef20d4bdd4c1183a8148e4eb1a9a3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:35.491979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8577eca3-e0d0-4d3e-98a2-a10d3618247b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:35.492763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 67/135] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:49:35 2022] PUT /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468/users/2ba23ee634e9487f8436a5c9c29e0eb9/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:49:35.494014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 69/136] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:35 2022] GET /identity/v3/projects/af0ef20d4bdd4c1183a8148e4eb1a9a3 => generated 312 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:35.500286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c4f92-7047-46a4-ac94-6b2ca73fbc99 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:35.630294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c4f92-7047-46a4-ac94-6b2ca73fbc99 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:35.668606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2322b854-873e-4399-9091-6fc62027d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:35.669386 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322b854-873e-4399-9091-6fc62027d347 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:35.669672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322b854-873e-4399-9091-6fc62027d347 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:35.669949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2322b854-873e-4399-9091-6fc62027d347 None admin] PATH_INFO: `/v3/projects/af0ef20d4bdd4c1183a8148e4eb1a9a3/users/ede771e5606b4919bb7574deefd0336b/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:35.672040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322b854-873e-4399-9091-6fc62027d347 None admin] RBAC: Authorizing `identity:create_grant(project_id=af0ef20d4bdd4c1183a8148e4eb1a9a3, user_id=ede771e5606b4919bb7574deefd0336b, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:35.673554 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2322b854-873e-4399-9091-6fc62027d347 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:35.675991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:35.693632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 68/137] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:49:35 2022] PUT /identity/v3/projects/af0ef20d4bdd4c1183a8148e4eb1a9a3/users/ede771e5606b4919bb7574deefd0336b/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:49:36.199579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689f8e4-a869-4e55-9ac6-c51ad115c140 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:36.200090 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689f8e4-a869-4e55-9ac6-c51ad115c140 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:36.200090 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b689f8e4-a869-4e55-9ac6-c51ad115c140 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:36.201735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 70/138] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:36.211420 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21000051-e011-482c-849a-3c2764197a00 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:36.211894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21000051-e011-482c-849a-3c2764197a00 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:36.211969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21000051-e011-482c-849a-3c2764197a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:36.237348 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-21000051-e011-482c-849a-3c2764197a00 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:36.238591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-21000051-e011-482c-849a-3c2764197a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:36.321595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 69/139] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:36.356832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689f8e4-a869-4e55-9ac6-c51ad115c140 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:36.384296 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:36.441561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f7204-9f17-43a7-83f9-40e7f09297fe None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:36.441850 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f7204-9f17-43a7-83f9-40e7f09297fe None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:36.442126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260f7204-9f17-43a7-83f9-40e7f09297fe None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:36.444379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 70/140] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:36.449700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba67f-9ada-4abb-8174-6211910e1ade None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:36.449927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba67f-9ada-4abb-8174-6211910e1ade None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:36.450203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dba67f-9ada-4abb-8174-6211910e1ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:36.481163 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-25dba67f-9ada-4abb-8174-6211910e1ade None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:36.482388 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-25dba67f-9ada-4abb-8174-6211910e1ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:36.489678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b689f8e4-a869-4e55-9ac6-c51ad115c140 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:36.544438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2f245-ad16-4398-a539-26e911364f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:36.545445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2f245-ad16-4398-a539-26e911364f08 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:36.545907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2f245-ad16-4398-a539-26e911364f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:36.546370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de2f245-ad16-4398-a539-26e911364f08 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:36.567176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de2f245-ad16-4398-a539-26e911364f08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-2de2f245-ad16-4398-a539-26e911364f08 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:36.572928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:36.573791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:36.574561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:36.574561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:36.574561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:36.574561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:36.574561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:36.574561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:36.574561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:36.574561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:36.574561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:36.574561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:36.574561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:36.574561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:36.584112 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 71/141] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:36.589981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2f245-ad16-4398-a539-26e911364f08 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:36.647510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 71/142] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:36.678756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:36.698404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dba67f-9ada-4abb-8174-6211910e1ade None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:36.704443 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de2f245-ad16-4398-a539-26e911364f08 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:36.756881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033b114-4099-4dd3-adaf-d7cefe01f448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:36.757819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033b114-4099-4dd3-adaf-d7cefe01f448 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:36.758283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033b114-4099-4dd3-adaf-d7cefe01f448 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:36.758760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033b114-4099-4dd3-adaf-d7cefe01f448 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:36.759659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033b114-4099-4dd3-adaf-d7cefe01f448 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:36.760141 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033b114-4099-4dd3-adaf-d7cefe01f448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:36.761734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033b114-4099-4dd3-adaf-d7cefe01f448 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:36.770428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 72/143] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:36.771819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766771f7-285a-4c05-93f9-18dad70869e4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:36.772277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766771f7-285a-4c05-93f9-18dad70869e4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:36.772715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766771f7-285a-4c05-93f9-18dad70869e4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:36.774141 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 73/144] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:36.782137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766771f7-285a-4c05-93f9-18dad70869e4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:36.822865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:36.905953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766771f7-285a-4c05-93f9-18dad70869e4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:36.936971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dba67f-9ada-4abb-8174-6211910e1ade None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:36.978926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af077d20-94ff-4124-97d9-b97e25da8dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:36.979503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af077d20-94ff-4124-97d9-b97e25da8dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:36.979783 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af077d20-94ff-4124-97d9-b97e25da8dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:36.980091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af077d20-94ff-4124-97d9-b97e25da8dd6 None admin] PATH_INFO: `/v3/users/6b4bc018f4674c9aa66691e4ef4e8e45` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:36.986009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af077d20-94ff-4124-97d9-b97e25da8dd6 None admin] RBAC: Authorizing `identity:get_user(user_id=6b4bc018f4674c9aa66691e4ef4e8e45)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:36.987474 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af077d20-94ff-4124-97d9-b97e25da8dd6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:36.990134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 74/145] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:36 2022] GET /identity/v3/users/6b4bc018f4674c9aa66691e4ef4e8e45 => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:36.991376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f179e-3a33-4c1f-b644-0722174cbae2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:36.991708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f179e-3a33-4c1f-b644-0722174cbae2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:36.991980 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39f179e-3a33-4c1f-b644-0722174cbae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:37.007570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8dca1-d03e-4053-b742-89e7b369fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:37.008232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8dca1-d03e-4053-b742-89e7b369fe47 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:37.008514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8dca1-d03e-4053-b742-89e7b369fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:37.008786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f8dca1-d03e-4053-b742-89e7b369fe47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:37.010622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b39f179e-3a33-4c1f-b644-0722174cbae2 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:37.011922 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b39f179e-3a33-4c1f-b644-0722174cbae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:37.014176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8dca1-d03e-4053-b742-89e7b369fe47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:37.016460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f8dca1-d03e-4053-b742-89e7b369fe47 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:37.018232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 72/146] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:37.019102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8dca1-d03e-4053-b742-89e7b369fe47 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:37.029710 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:37.162694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f8dca1-d03e-4053-b742-89e7b369fe47 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:37.186638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 75/147] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:37.187808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f179e-3a33-4c1f-b644-0722174cbae2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:37.199775 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:37.213425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8dd2e-d6e8-463d-ae76-d27df7d11404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:37.214773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8dd2e-d6e8-463d-ae76-d27df7d11404 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:37.215255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8dd2e-d6e8-463d-ae76-d27df7d11404 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:37.215751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b8dd2e-d6e8-463d-ae76-d27df7d11404 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:37.217127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8dd2e-d6e8-463d-ae76-d27df7d11404 None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:37.218789 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b8dd2e-d6e8-463d-ae76-d27df7d11404 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:37.221848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 73/148] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:37 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:37.228387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8dd2e-d6e8-463d-ae76-d27df7d11404 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:37.355188 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39f179e-3a33-4c1f-b644-0722174cbae2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:37.417983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b8dd2e-d6e8-463d-ae76-d27df7d11404 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:37.421579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cb869-d730-45a1-8f69-544f0cbc6a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:37.422432 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cb869-d730-45a1-8f69-544f0cbc6a9f None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:37.422936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cb869-d730-45a1-8f69-544f0cbc6a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:37.423405 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20cb869-d730-45a1-8f69-544f0cbc6a9f None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:37.424297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cb869-d730-45a1-8f69-544f0cbc6a9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:37.426619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20cb869-d730-45a1-8f69-544f0cbc6a9f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:37.457591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:37.464714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14899f59-fb99-4582-a8d6-390072d60d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:37.465872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14899f59-fb99-4582-a8d6-390072d60d24 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:37.466362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14899f59-fb99-4582-a8d6-390072d60d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:37.467581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14899f59-fb99-4582-a8d6-390072d60d24 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468/users/6b4bc018f4674c9aa66691e4ef4e8e45/roles/fce6359ef8b8407a9887ee97701093a8` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:37.470843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14899f59-fb99-4582-a8d6-390072d60d24 None admin] RBAC: Authorizing `identity:create_grant(project_id=de598ff4856d4edc9937647ebb5aa468, user_id=6b4bc018f4674c9aa66691e4ef4e8e45, role_id=fce6359ef8b8407a9887ee97701093a8)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:37.473642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14899f59-fb99-4582-a8d6-390072d60d24 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:37.479159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 76/149] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:49:37 2022] POST /identity/v3/users => generated 283 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:37.480409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cb869-d730-45a1-8f69-544f0cbc6a9f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:37.494859 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 74/150] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:49:37 2022] PUT /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468/users/6b4bc018f4674c9aa66691e4ef4e8e45/roles/fce6359ef8b8407a9887ee97701093a8 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:49:37.614837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20cb869-d730-45a1-8f69-544f0cbc6a9f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:37.661312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2ee67-ef8c-40d7-9013-e7d9debfffd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:37.662401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ee67-ef8c-40d7-9013-e7d9debfffd2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:37.662881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ee67-ef8c-40d7-9013-e7d9debfffd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:37.663372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2ee67-ef8c-40d7-9013-e7d9debfffd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:37.688294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2ee67-ef8c-40d7-9013-e7d9debfffd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-9cc2ee67-ef8c-40d7-9013-e7d9debfffd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:37.693934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:37.694831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:37.695607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:37.695607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:37.695607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:37.695607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:37.695607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:37.695607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:37.695607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:37.695607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:37.695607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:37.695607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:37.695607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:37.695607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:37.698185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 77/151] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:37.706492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14899f59-fb99-4582-a8d6-390072d60d24 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:37.763337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:37.821148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14899f59-fb99-4582-a8d6-390072d60d24 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:37.860220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45436456-fb12-4f64-a823-78d9c4157bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:37.860858 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45436456-fb12-4f64-a823-78d9c4157bbf None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:37.861153 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45436456-fb12-4f64-a823-78d9c4157bbf None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:37.861484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45436456-fb12-4f64-a823-78d9c4157bbf None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:37.862564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45436456-fb12-4f64-a823-78d9c4157bbf None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:37.862564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45436456-fb12-4f64-a823-78d9c4157bbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:37.865211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45436456-fb12-4f64-a823-78d9c4157bbf None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:37.873168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 75/152] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:37.879210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2ee67-ef8c-40d7-9013-e7d9debfffd2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:37.943046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:37.992923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2ee67-ef8c-40d7-9013-e7d9debfffd2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:38.030182 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ef17c-e1ad-4ce6-8ead-4edacba6ac12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:38.030837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef17c-e1ad-4ce6-8ead-4edacba6ac12 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:38.031117 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef17c-e1ad-4ce6-8ead-4edacba6ac12 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:38.031389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ef17c-e1ad-4ce6-8ead-4edacba6ac12 None admin] PATH_INFO: `/v3/users/ede771e5606b4919bb7574deefd0336b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:38.032588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ef17c-e1ad-4ce6-8ead-4edacba6ac12 None admin] RBAC: Authorizing `identity:get_user(user_id=ede771e5606b4919bb7574deefd0336b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:38.034102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ef17c-e1ad-4ce6-8ead-4edacba6ac12 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:38.035758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 78/153] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:37 2022] GET /identity/v3/users/ede771e5606b4919bb7574deefd0336b => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:38.041537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45436456-fb12-4f64-a823-78d9c4157bbf None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:38.184469 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45436456-fb12-4f64-a823-78d9c4157bbf None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:38.202377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:38.230023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dc9ac-efbc-4522-be1d-460ab8518e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:38.230781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dc9ac-efbc-4522-be1d-460ab8518e87 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:38.230992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dc9ac-efbc-4522-be1d-460ab8518e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:38.231270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618dc9ac-efbc-4522-be1d-460ab8518e87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:38.315148 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18fb75-d30a-425f-8b9c-c3e71e89cbdf None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:38.315432 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18fb75-d30a-425f-8b9c-c3e71e89cbdf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:38.315707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e18fb75-d30a-425f-8b9c-c3e71e89cbdf None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:38.317679 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 79/154] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:38.320433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618dc9ac-efbc-4522-be1d-460ab8518e87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:38.321986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618dc9ac-efbc-4522-be1d-460ab8518e87 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:38.328744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d8a1d-05b0-4b3d-8076-4d3a372ba074 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:38.329028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d8a1d-05b0-4b3d-8076-4d3a372ba074 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:38.329365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d8a1d-05b0-4b3d-8076-4d3a372ba074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:38.357313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ca8d8a1d-05b0-4b3d-8076-4d3a372ba074 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:38.358557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ca8d8a1d-05b0-4b3d-8076-4d3a372ba074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:38.443152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 80/155] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:38.444553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679d60b-8097-46b9-a9f6-0754b9b60842 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:38.444840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679d60b-8097-46b9-a9f6-0754b9b60842 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:38.445107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5679d60b-8097-46b9-a9f6-0754b9b60842 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:38.446527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 81/156] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:38.451843 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f18e7-8008-4ed7-92e6-ae4f6f892b5c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:38.452119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f18e7-8008-4ed7-92e6-ae4f6f892b5c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:38.452388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f18e7-8008-4ed7-92e6-ae4f6f892b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:38.463239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 76/157] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:38.468792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dc9ac-efbc-4522-be1d-460ab8518e87 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:38.472561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e90f18e7-8008-4ed7-92e6-ae4f6f892b5c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:38.474487 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e90f18e7-8008-4ed7-92e6-ae4f6f892b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:38.490415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:38.541010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:38.569515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 82/158] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:38.570479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f18e7-8008-4ed7-92e6-ae4f6f892b5c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:38.638252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618dc9ac-efbc-4522-be1d-460ab8518e87 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:38.684897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3936fa9f-434e-4e45-9575-b47b7456320d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:38.684897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936fa9f-434e-4e45-9575-b47b7456320d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:38.684897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936fa9f-434e-4e45-9575-b47b7456320d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:38.684897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3936fa9f-434e-4e45-9575-b47b7456320d None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:38.685500 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936fa9f-434e-4e45-9575-b47b7456320d None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:38.687793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3936fa9f-434e-4e45-9575-b47b7456320d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:38.689927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 77/159] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:38 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:38.691329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b4196-e81b-4c03-afa5-00cf44218ec6 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:38.691669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b4196-e81b-4c03-afa5-00cf44218ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:38.692008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545b4196-e81b-4c03-afa5-00cf44218ec6 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:38.696983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 78/160] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:38.696983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b4196-e81b-4c03-afa5-00cf44218ec6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:38.740319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90f18e7-8008-4ed7-92e6-ae4f6f892b5c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:38.789517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc88c253-040f-4ec9-91cc-d529c4fd369d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:38.790473 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88c253-040f-4ec9-91cc-d529c4fd369d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:38.791661 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88c253-040f-4ec9-91cc-d529c4fd369d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:38.792122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc88c253-040f-4ec9-91cc-d529c4fd369d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:38.807275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc88c253-040f-4ec9-91cc-d529c4fd369d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:38.808123 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-dc88c253-040f-4ec9-91cc-d529c4fd369d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:38.814831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:38.815800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:38.816873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 83/161] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:49:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:38.817865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852df230-3ab1-452b-840c-caab5701efdc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:38.817938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852df230-3ab1-452b-840c-caab5701efdc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:38.818448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852df230-3ab1-452b-840c-caab5701efdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:38.838832 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545b4196-e81b-4c03-afa5-00cf44218ec6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:38.842379 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-852df230-3ab1-452b-840c-caab5701efdc None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:38.843825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-852df230-3ab1-452b-840c-caab5701efdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:38.879950 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e90f6-b6b4-4864-a87e-1a5384f03de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:38.880962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e90f6-b6b4-4864-a87e-1a5384f03de5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:38.881505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e90f6-b6b4-4864-a87e-1a5384f03de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:38.881968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e90f6-b6b4-4864-a87e-1a5384f03de5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:38.893828 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7e90f6-b6b4-4864-a87e-1a5384f03de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:38.898494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-1a7e90f6-b6b4-4864-a87e-1a5384f03de5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:38.904098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:38.906664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:38.907997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:38.907997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:38.907997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:38.907997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:38.907997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:38.907997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:38.907997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:38.907997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:38.907997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:38.907997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:38.907997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:38.907997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:38.911519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 79/162] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:49:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:38.913154 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e90f6-b6b4-4864-a87e-1a5384f03de5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:38.937967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 84/163] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:38.939236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852df230-3ab1-452b-840c-caab5701efdc None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:39.040632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e90f6-b6b4-4864-a87e-1a5384f03de5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:39.088936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa2f12-781e-4dcc-9a5e-fbbe71ddc429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:39.089885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa2f12-781e-4dcc-9a5e-fbbe71ddc429 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:39.090443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa2f12-781e-4dcc-9a5e-fbbe71ddc429 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:39.090910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa2f12-781e-4dcc-9a5e-fbbe71ddc429 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:39.091920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa2f12-781e-4dcc-9a5e-fbbe71ddc429 None admin] RBAC: Adding query filter params (role.id=251e50fd870c48f3a02b69587144b7bf, scope.project.id=de598ff4856d4edc9937647ebb5aa468, user.id=ede771e5606b4919bb7574deefd0336b) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:39.092414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa2f12-781e-4dcc-9a5e-fbbe71ddc429 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:39.094815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa2f12-781e-4dcc-9a5e-fbbe71ddc429 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:39.102273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 80/164] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:38 2022] GET /identity/v3/role_assignments?user.id=ede771e5606b4919bb7574deefd0336b&scope.project.id=de598ff4856d4edc9937647ebb5aa468&role.id=251e50fd870c48f3a02b69587144b7bf => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:39.103437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa2f12-781e-4dcc-9a5e-fbbe71ddc429 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:39.103553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852df230-3ab1-452b-840c-caab5701efdc None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:39.107461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:39.193209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ddfac-bb7e-4d6e-be86-a1bc3211eea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:39.193876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ddfac-bb7e-4d6e-be86-a1bc3211eea1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:39.194158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ddfac-bb7e-4d6e-be86-a1bc3211eea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:39.194430 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ddfac-bb7e-4d6e-be86-a1bc3211eea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:39.195169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ddfac-bb7e-4d6e-be86-a1bc3211eea1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:39.195470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ddfac-bb7e-4d6e-be86-a1bc3211eea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:39.196889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ddfac-bb7e-4d6e-be86-a1bc3211eea1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:39.213060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 85/165] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:49:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:39.213957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ddfac-bb7e-4d6e-be86-a1bc3211eea1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:39.237537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa2f12-781e-4dcc-9a5e-fbbe71ddc429 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:39.308047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf3b25-48ee-4188-97de-fc9afb4b7845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:39.309105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf3b25-48ee-4188-97de-fc9afb4b7845 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:39.309630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf3b25-48ee-4188-97de-fc9afb4b7845 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:39.310258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daf3b25-48ee-4188-97de-fc9afb4b7845 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:39.311894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf3b25-48ee-4188-97de-fc9afb4b7845 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:39.312917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf3b25-48ee-4188-97de-fc9afb4b7845 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:39.314979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5daf3b25-48ee-4188-97de-fc9afb4b7845 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:39.322524 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:39.333798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 81/166] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:39.335125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf3b25-48ee-4188-97de-fc9afb4b7845 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:39.446884 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ddfac-bb7e-4d6e-be86-a1bc3211eea1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:39.481281 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:39.538552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daf3b25-48ee-4188-97de-fc9afb4b7845 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:39.541655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6e968-5abc-48eb-882e-9c06e4997201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:39.542324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6e968-5abc-48eb-882e-9c06e4997201 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:39.542609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6e968-5abc-48eb-882e-9c06e4997201 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:39.542880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f6e968-5abc-48eb-882e-9c06e4997201 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:39.567490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f6e968-5abc-48eb-882e-9c06e4997201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b8f6e968-5abc-48eb-882e-9c06e4997201 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:39.573953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:39.574826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 86/167] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:39.577015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6e968-5abc-48eb-882e-9c06e4997201 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:39.622910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ce8cc-3f74-4887-874d-38b86ad61835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:39.624083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ce8cc-3f74-4887-874d-38b86ad61835 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:39.624919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ce8cc-3f74-4887-874d-38b86ad61835 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:39.625430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ce8cc-3f74-4887-874d-38b86ad61835 None admin] PATH_INFO: `/v3/users/ede771e5606b4919bb7574deefd0336b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:39.626842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ce8cc-3f74-4887-874d-38b86ad61835 None admin] RBAC: Authorizing `identity:get_user(user_id=ede771e5606b4919bb7574deefd0336b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:39.629097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ce8cc-3f74-4887-874d-38b86ad61835 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:39.630997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 82/168] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:39 2022] GET /identity/v3/users/ede771e5606b4919bb7574deefd0336b => generated 275 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:39.632102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ce8cc-3f74-4887-874d-38b86ad61835 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:39.751337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ce8cc-3f74-4887-874d-38b86ad61835 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:39.794246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41298d39-8666-4c90-b003-4db66ad4e2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:39.795257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41298d39-8666-4c90-b003-4db66ad4e2ec None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:39.795732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41298d39-8666-4c90-b003-4db66ad4e2ec None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:39.796352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41298d39-8666-4c90-b003-4db66ad4e2ec None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:39.797502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41298d39-8666-4c90-b003-4db66ad4e2ec None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:39.798081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41298d39-8666-4c90-b003-4db66ad4e2ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:39.799962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41298d39-8666-4c90-b003-4db66ad4e2ec None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:39.807609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:39.812241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 83/169] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:39.817142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41298d39-8666-4c90-b003-4db66ad4e2ec None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:39.889009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:39.896140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f6e968-5abc-48eb-882e-9c06e4997201 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:39.961657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f377d-176c-4188-81f0-16181e5975bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:39.962680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f377d-176c-4188-81f0-16181e5975bd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:39.963356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f377d-176c-4188-81f0-16181e5975bd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:39.964756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0f377d-176c-4188-81f0-16181e5975bd None admin] PATH_INFO: `/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:39.966411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f377d-176c-4188-81f0-16181e5975bd None admin] RBAC: Authorizing `identity:get_user(user_id=2ba23ee634e9487f8436a5c9c29e0eb9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:39.969024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0f377d-176c-4188-81f0-16181e5975bd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:39.975819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 87/170] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:39 2022] GET /identity/v3/users/2ba23ee634e9487f8436a5c9c29e0eb9 => generated 247 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:39.976962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f377d-176c-4188-81f0-16181e5975bd None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:40.017700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41298d39-8666-4c90-b003-4db66ad4e2ec None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:40.087819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7456a1b-c26a-4c5f-b7c3-7469a189ec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:40.087819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7456a1b-c26a-4c5f-b7c3-7469a189ec06 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:40.087819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7456a1b-c26a-4c5f-b7c3-7469a189ec06 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:40.087819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7456a1b-c26a-4c5f-b7c3-7469a189ec06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:40.172162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0f377d-176c-4188-81f0-16181e5975bd None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:40.213676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:40.233282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7456a1b-c26a-4c5f-b7c3-7469a189ec06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:40.235098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7456a1b-c26a-4c5f-b7c3-7469a189ec06 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:40.235989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b31b7-847f-415c-88a8-13a475e4a45d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:40.236942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b31b7-847f-415c-88a8-13a475e4a45d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:40.237513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b31b7-847f-415c-88a8-13a475e4a45d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:40.238562 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5b31b7-847f-415c-88a8-13a475e4a45d None admin] PATH_INFO: `/v3/users/ede771e5606b4919bb7574deefd0336b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:40.246102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b31b7-847f-415c-88a8-13a475e4a45d None admin] RBAC: Authorizing `identity:get_user(user_id=ede771e5606b4919bb7574deefd0336b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:40.247904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5b31b7-847f-415c-88a8-13a475e4a45d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:40.249834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 88/171] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:39 2022] GET /identity/v3/users/ede771e5606b4919bb7574deefd0336b => generated 275 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:40.254338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b31b7-847f-415c-88a8-13a475e4a45d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:40.341547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:40.445467 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 84/172] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:40.445467 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7456a1b-c26a-4c5f-b7c3-7469a189ec06 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:40.465398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5b31b7-847f-415c-88a8-13a475e4a45d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:40.527942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1718a31-78ee-4cc0-8c13-e5f25d46fb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:40.528971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1718a31-78ee-4cc0-8c13-e5f25d46fb59 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:40.529536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1718a31-78ee-4cc0-8c13-e5f25d46fb59 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:40.530025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1718a31-78ee-4cc0-8c13-e5f25d46fb59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:40.598063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:40.610182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7456a1b-c26a-4c5f-b7c3-7469a189ec06 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:40.667262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1ba1e-7ec1-4e7b-b83f-972c5f703726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:40.667891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1ba1e-7ec1-4e7b-b83f-972c5f703726 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:40.668168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1ba1e-7ec1-4e7b-b83f-972c5f703726 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:40.668437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1ba1e-7ec1-4e7b-b83f-972c5f703726 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:40.692459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1718a31-78ee-4cc0-8c13-e5f25d46fb59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:40.694403 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1718a31-78ee-4cc0-8c13-e5f25d46fb59 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:40.765581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:40.787284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1ba1e-7ec1-4e7b-b83f-972c5f703726 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:40.788739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1ba1e-7ec1-4e7b-b83f-972c5f703726 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:40.904160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 89/173] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:40.905647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1718a31-78ee-4cc0-8c13-e5f25d46fb59 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:40.968007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:40.980913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 85/174] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:40.982203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369b393-9735-4e71-9389-32dab5d971f1 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:40.982483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369b393-9735-4e71-9389-32dab5d971f1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:40.982751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f369b393-9735-4e71-9389-32dab5d971f1 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:40.987345 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 86/175] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:40.988128 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369b393-9735-4e71-9389-32dab5d971f1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:41.059048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1718a31-78ee-4cc0-8c13-e5f25d46fb59 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:41.092368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:41.095708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bdf38-7539-46e7-8f0d-74ddfd09daec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:41.096346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bdf38-7539-46e7-8f0d-74ddfd09daec None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:41.096932 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bdf38-7539-46e7-8f0d-74ddfd09daec None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:41.097039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bdf38-7539-46e7-8f0d-74ddfd09daec None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:41.098881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bdf38-7539-46e7-8f0d-74ddfd09daec None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:41.100824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753bdf38-7539-46e7-8f0d-74ddfd09daec None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:41.105366 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 90/176] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:40 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:41.106169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bdf38-7539-46e7-8f0d-74ddfd09daec None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:41.163776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f369b393-9735-4e71-9389-32dab5d971f1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:41.209831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea9dd5-998c-4949-9f1d-36e14a8e01e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:41.210472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9dd5-998c-4949-9f1d-36e14a8e01e9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:41.211159 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9dd5-998c-4949-9f1d-36e14a8e01e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:41.211441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea9dd5-998c-4949-9f1d-36e14a8e01e9 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:41.212865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea9dd5-998c-4949-9f1d-36e14a8e01e9 None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:41.214818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea9dd5-998c-4949-9f1d-36e14a8e01e9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:41.221248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 87/177] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:40 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:41.222615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d18fa-7b1a-4cf8-a1bc-6138929ebc50 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:41.222907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d18fa-7b1a-4cf8-a1bc-6138929ebc50 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:41.223173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226d18fa-7b1a-4cf8-a1bc-6138929ebc50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:41.232547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bdf38-7539-46e7-8f0d-74ddfd09daec None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:41.242453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-226d18fa-7b1a-4cf8-a1bc-6138929ebc50 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:41.243631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-226d18fa-7b1a-4cf8-a1bc-6138929ebc50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:41.281739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1a69c-2b8f-4fdd-8c62-baff552ff814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:41.282547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1a69c-2b8f-4fdd-8c62-baff552ff814 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:41.282928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1a69c-2b8f-4fdd-8c62-baff552ff814 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:41.283300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da1a69c-2b8f-4fdd-8c62-baff552ff814 None admin] PATH_INFO: `/v3/projects/af0ef20d4bdd4c1183a8148e4eb1a9a3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:41.284861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1a69c-2b8f-4fdd-8c62-baff552ff814 None admin] RBAC: Authorizing `identity:get_project(project_id=af0ef20d4bdd4c1183a8148e4eb1a9a3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:41.293554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da1a69c-2b8f-4fdd-8c62-baff552ff814 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:41.296161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 91/178] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:41 2022] GET /identity/v3/projects/af0ef20d4bdd4c1183a8148e4eb1a9a3 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:41.297088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1a69c-2b8f-4fdd-8c62-baff552ff814 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:41.316486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:41.335223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 88/179] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:41.337654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1d90-b429-4697-bca0-d8bddceec3db None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:41.338165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1d90-b429-4697-bca0-d8bddceec3db None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:41.338880 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c1d90-b429-4697-bca0-d8bddceec3db None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:41.341557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 89/180] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:41.342518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1d90-b429-4697-bca0-d8bddceec3db None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:41.384997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:41.420670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da1a69c-2b8f-4fdd-8c62-baff552ff814 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:41.456763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c1d90-b429-4697-bca0-d8bddceec3db None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:41.457480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc84af5-4b56-44d2-8573-9542b616aaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:41.458042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc84af5-4b56-44d2-8573-9542b616aaa7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:41.458322 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc84af5-4b56-44d2-8573-9542b616aaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:41.458594 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc84af5-4b56-44d2-8573-9542b616aaa7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:41.459372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc84af5-4b56-44d2-8573-9542b616aaa7 None admin] RBAC: Adding query filter params (role.id=d0262ce715f7448babe9cef93dc25e9d, scope.project.id=de598ff4856d4edc9937647ebb5aa468, user.id=ede771e5606b4919bb7574deefd0336b) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:41.459683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc84af5-4b56-44d2-8573-9542b616aaa7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:41.461926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc84af5-4b56-44d2-8573-9542b616aaa7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:41.473399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 92/181] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:41 2022] GET /identity/v3/role_assignments?user.id=ede771e5606b4919bb7574deefd0336b&scope.project.id=de598ff4856d4edc9937647ebb5aa468&role.id=d0262ce715f7448babe9cef93dc25e9d => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:41.474465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc84af5-4b56-44d2-8573-9542b616aaa7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:41.499019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd88a593-ee25-4e94-84b0-9f7911ff972f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:41.500045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a593-ee25-4e94-84b0-9f7911ff972f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:41.500520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a593-ee25-4e94-84b0-9f7911ff972f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:41.501000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd88a593-ee25-4e94-84b0-9f7911ff972f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:41.502037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a593-ee25-4e94-84b0-9f7911ff972f None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=de598ff4856d4edc9937647ebb5aa468, user.id=2ba23ee634e9487f8436a5c9c29e0eb9) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:41.502543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a593-ee25-4e94-84b0-9f7911ff972f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:41.504949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd88a593-ee25-4e94-84b0-9f7911ff972f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:41.517512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 90/182] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:41 2022] GET /identity/v3/role_assignments?user.id=2ba23ee634e9487f8436a5c9c29e0eb9&scope.project.id=de598ff4856d4edc9937647ebb5aa468&role.id=0195bf688a7e464e8ff594afe80b050e => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:41.519412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d28ed-adc7-4fe9-8573-1db2d40bc923 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:41.519944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d28ed-adc7-4fe9-8573-1db2d40bc923 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:41.520461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d28ed-adc7-4fe9-8573-1db2d40bc923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:41.545794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-443d28ed-adc7-4fe9-8573-1db2d40bc923 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:41.547392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-443d28ed-adc7-4fe9-8573-1db2d40bc923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:41.596918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc84af5-4b56-44d2-8573-9542b616aaa7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:41.631997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:41.639056 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cc7c8-3a92-4dac-afe9-01317e397b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:41.639737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cc7c8-3a92-4dac-afe9-01317e397b26 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:41.640015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cc7c8-3a92-4dac-afe9-01317e397b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:41.640296 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950cc7c8-3a92-4dac-afe9-01317e397b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:41.641105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cc7c8-3a92-4dac-afe9-01317e397b26 None admin] RBAC: Adding query filter params (role.id=251e50fd870c48f3a02b69587144b7bf, scope.project.id=af0ef20d4bdd4c1183a8148e4eb1a9a3, user.id=ede771e5606b4919bb7574deefd0336b) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:41.641449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cc7c8-3a92-4dac-afe9-01317e397b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:41.642962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950cc7c8-3a92-4dac-afe9-01317e397b26 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:41.650678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 93/183] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:41 2022] GET /identity/v3/role_assignments?user.id=ede771e5606b4919bb7574deefd0336b&scope.project.id=af0ef20d4bdd4c1183a8148e4eb1a9a3&role.id=251e50fd870c48f3a02b69587144b7bf => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:41.651341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cc7c8-3a92-4dac-afe9-01317e397b26 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:41.658721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:41.719731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 91/184] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:41.763988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d28ed-adc7-4fe9-8573-1db2d40bc923 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:41.794254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950cc7c8-3a92-4dac-afe9-01317e397b26 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:41.844613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f33007-fa0b-4d44-bdc3-3e27403936e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:41.845905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f33007-fa0b-4d44-bdc3-3e27403936e2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:41.846478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f33007-fa0b-4d44-bdc3-3e27403936e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:41.847003 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f33007-fa0b-4d44-bdc3-3e27403936e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:41.861368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f33007-fa0b-4d44-bdc3-3e27403936e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-37f33007-fa0b-4d44-bdc3-3e27403936e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:41.868165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:41.869150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:41.869974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:41.869974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:41.869974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:41.869974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:41.869974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:41.869974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:41.869974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:41.869974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:41.869974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:41.869974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:41.869974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:41.869974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:41.873262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 94/185] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:41.885085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f33007-fa0b-4d44-bdc3-3e27403936e2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:41.983444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:42.000681 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d28ed-adc7-4fe9-8573-1db2d40bc923 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:42.052949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012e4dce-4b9b-4913-8b28-e4922d34f6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:42.053624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e4dce-4b9b-4913-8b28-e4922d34f6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.053904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e4dce-4b9b-4913-8b28-e4922d34f6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.054188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012e4dce-4b9b-4913-8b28-e4922d34f6b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.056402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f33007-fa0b-4d44-bdc3-3e27403936e2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:42.068256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012e4dce-4b9b-4913-8b28-e4922d34f6b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-012e4dce-4b9b-4913-8b28-e4922d34f6b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:42.073372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:42.074347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:42.075157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 92/186] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:49:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:49:42.075804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26863361-67fe-4302-bc6d-89c65214a2de None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.079473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26863361-67fe-4302-bc6d-89c65214a2de None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.079473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26863361-67fe-4302-bc6d-89c65214a2de None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.079473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 93/187] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:42.084632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26863361-67fe-4302-bc6d-89c65214a2de None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:42.110306 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f94d505-c10c-4729-8bfe-3068bc107c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:42.111279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94d505-c10c-4729-8bfe-3068bc107c59 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.111569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94d505-c10c-4729-8bfe-3068bc107c59 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.111849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f94d505-c10c-4729-8bfe-3068bc107c59 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.112583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94d505-c10c-4729-8bfe-3068bc107c59 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:42.114332 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94d505-c10c-4729-8bfe-3068bc107c59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:42.118400 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f94d505-c10c-4729-8bfe-3068bc107c59 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:42.133986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 95/188] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:42.135240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c75fb4-1537-443e-9a3b-f4b8e08db53d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.135529 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c75fb4-1537-443e-9a3b-f4b8e08db53d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.135806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c75fb4-1537-443e-9a3b-f4b8e08db53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.155028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:42.163427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-10c75fb4-1537-443e-9a3b-f4b8e08db53d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:42.164637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-10c75fb4-1537-443e-9a3b-f4b8e08db53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:42.212704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26863361-67fe-4302-bc6d-89c65214a2de None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:42.232575 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 96/189] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:42.233447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c75fb4-1537-443e-9a3b-f4b8e08db53d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:42.247650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7499ec-c3cb-401b-aec5-6161bc4f02d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:42.248274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7499ec-c3cb-401b-aec5-6161bc4f02d0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.248555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7499ec-c3cb-401b-aec5-6161bc4f02d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.248829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7499ec-c3cb-401b-aec5-6161bc4f02d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.249591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7499ec-c3cb-401b-aec5-6161bc4f02d0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:42.249895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7499ec-c3cb-401b-aec5-6161bc4f02d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:42.251287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7499ec-c3cb-401b-aec5-6161bc4f02d0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:42.260454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 94/190] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:42.261712 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cac104-eb1d-4915-ab84-48d58b9ae572 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.262002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cac104-eb1d-4915-ab84-48d58b9ae572 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.262274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cac104-eb1d-4915-ab84-48d58b9ae572 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.265447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 95/191] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:42.265447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cac104-eb1d-4915-ab84-48d58b9ae572 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:42.302395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:42.361762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c75fb4-1537-443e-9a3b-f4b8e08db53d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:42.371351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cac104-eb1d-4915-ab84-48d58b9ae572 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:42.381574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:42.395068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39822c-4455-4675-a599-0f6bd1aa86a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:42.395710 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39822c-4455-4675-a599-0f6bd1aa86a2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.395990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39822c-4455-4675-a599-0f6bd1aa86a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.396265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef39822c-4455-4675-a599-0f6bd1aa86a2 None admin] PATH_INFO: `/v3/users/6b4bc018f4674c9aa66691e4ef4e8e45` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.397474 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39822c-4455-4675-a599-0f6bd1aa86a2 None admin] RBAC: Authorizing `identity:get_user(user_id=6b4bc018f4674c9aa66691e4ef4e8e45)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:42.398981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef39822c-4455-4675-a599-0f6bd1aa86a2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:42.400753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 97/192] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:42 2022] GET /identity/v3/users/6b4bc018f4674c9aa66691e4ef4e8e45 => generated 289 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:42.401375 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39822c-4455-4675-a599-0f6bd1aa86a2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:42.405282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8e6cc9-fb13-4833-84a1-8abdd742abd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:42.405952 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e6cc9-fb13-4833-84a1-8abdd742abd5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.406232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e6cc9-fb13-4833-84a1-8abdd742abd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.406502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8e6cc9-fb13-4833-84a1-8abdd742abd5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.417050 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8e6cc9-fb13-4833-84a1-8abdd742abd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-8b8e6cc9-fb13-4833-84a1-8abdd742abd5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:42.422395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:42.423400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 96/193] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:49:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:42.429922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11386323-07e0-4807-8819-3e63eb93d9b1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.430626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11386323-07e0-4807-8819-3e63eb93d9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.430626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11386323-07e0-4807-8819-3e63eb93d9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.443855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-11386323-07e0-4807-8819-3e63eb93d9b1 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:42.445030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-11386323-07e0-4807-8819-3e63eb93d9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:42.502035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef39822c-4455-4675-a599-0f6bd1aa86a2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:42.508548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 97/194] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:42.509397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11386323-07e0-4807-8819-3e63eb93d9b1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:42.521838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:42.537238 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5193-48bc-470b-9d81-8132fe29e036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:42.537904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5193-48bc-470b-9d81-8132fe29e036 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.538181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5193-48bc-470b-9d81-8132fe29e036 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.538451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5e5193-48bc-470b-9d81-8132fe29e036 None admin] PATH_INFO: `/v3/users/23436fc664774831bd54dc387a93696c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.552262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e5193-48bc-470b-9d81-8132fe29e036 None admin] RBAC: Authorizing `identity:get_user(user_id=23436fc664774831bd54dc387a93696c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:42.553764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5e5193-48bc-470b-9d81-8132fe29e036 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:42.555388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 98/195] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:42 2022] GET /identity/v3/users/23436fc664774831bd54dc387a93696c => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:42.556135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5193-48bc-470b-9d81-8132fe29e036 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:42.620988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:42.624132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11386323-07e0-4807-8819-3e63eb93d9b1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:42.654762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5e5193-48bc-470b-9d81-8132fe29e036 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:42.659485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4dc48-6dea-4606-b1d1-1f82ba088880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:42.660608 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4dc48-6dea-4606-b1d1-1f82ba088880 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.660888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4dc48-6dea-4606-b1d1-1f82ba088880 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.661158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac4dc48-6dea-4606-b1d1-1f82ba088880 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.689177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e76f9f-7fb8-4c38-9ea7-71bd4f076ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:42.689839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e76f9f-7fb8-4c38-9ea7-71bd4f076ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.690121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e76f9f-7fb8-4c38-9ea7-71bd4f076ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.690397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e76f9f-7fb8-4c38-9ea7-71bd4f076ed7 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.691116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e76f9f-7fb8-4c38-9ea7-71bd4f076ed7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:42.691424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e76f9f-7fb8-4c38-9ea7-71bd4f076ed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:42.692853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e76f9f-7fb8-4c38-9ea7-71bd4f076ed7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:42.701529 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 99/196] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:49:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:42.702315 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e76f9f-7fb8-4c38-9ea7-71bd4f076ed7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:42.730304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4dc48-6dea-4606-b1d1-1f82ba088880 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:42.731766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac4dc48-6dea-4606-b1d1-1f82ba088880 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:42.737045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:42.803143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e76f9f-7fb8-4c38-9ea7-71bd4f076ed7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:42.824683 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:42.833099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 98/197] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:42.833099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4dc48-6dea-4606-b1d1-1f82ba088880 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:42.841207 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643b62c-d249-4782-a4c4-c288ad00cebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:42.841877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643b62c-d249-4782-a4c4-c288ad00cebb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.842184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643b62c-d249-4782-a4c4-c288ad00cebb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.842460 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6643b62c-d249-4782-a4c4-c288ad00cebb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.843607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643b62c-d249-4782-a4c4-c288ad00cebb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:42.845076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6643b62c-d249-4782-a4c4-c288ad00cebb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:42.846683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 100/198] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:42.848078 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643b62c-d249-4782-a4c4-c288ad00cebb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:42.930621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac4dc48-6dea-4606-b1d1-1f82ba088880 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:42.954548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6643b62c-d249-4782-a4c4-c288ad00cebb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:42.957399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:42.966576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba849e-8936-41c1-9a1b-047167de576b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:42.967189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba849e-8936-41c1-9a1b-047167de576b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.967462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba849e-8936-41c1-9a1b-047167de576b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.967726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cba849e-8936-41c1-9a1b-047167de576b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.989215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea67a75-a167-41b9-815a-1a0667e9c9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:42.989871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea67a75-a167-41b9-815a-1a0667e9c9b5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:42.990156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea67a75-a167-41b9-815a-1a0667e9c9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:42.990428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea67a75-a167-41b9-815a-1a0667e9c9b5 None admin] PATH_INFO: `/v3/users/23436fc664774831bd54dc387a93696c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:42.991621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea67a75-a167-41b9-815a-1a0667e9c9b5 None admin] RBAC: Authorizing `identity:get_user(user_id=23436fc664774831bd54dc387a93696c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:42.993084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea67a75-a167-41b9-815a-1a0667e9c9b5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:42.994717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 101/199] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:42 2022] GET /identity/v3/users/23436fc664774831bd54dc387a93696c => generated 283 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:42.995481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea67a75-a167-41b9-815a-1a0667e9c9b5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:43.036010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:43.038777 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba849e-8936-41c1-9a1b-047167de576b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:43.040894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cba849e-8936-41c1-9a1b-047167de576b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:43.092482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea67a75-a167-41b9-815a-1a0667e9c9b5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:43.131930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f1b79-28e8-41f6-8240-5d5e8bacba61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:43.132568 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f1b79-28e8-41f6-8240-5d5e8bacba61 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:43.132850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f1b79-28e8-41f6-8240-5d5e8bacba61 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:43.133122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2f1b79-28e8-41f6-8240-5d5e8bacba61 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:43.134373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f1b79-28e8-41f6-8240-5d5e8bacba61 None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:43.135820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2f1b79-28e8-41f6-8240-5d5e8bacba61 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:43.137503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 102/200] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:42 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:43.138243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f1b79-28e8-41f6-8240-5d5e8bacba61 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:43.141115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 99/201] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:43.141967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba849e-8936-41c1-9a1b-047167de576b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:43.183718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:43.235802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:43.238975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cba849e-8936-41c1-9a1b-047167de576b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:43.241777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2f1b79-28e8-41f6-8240-5d5e8bacba61 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:43.273728 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2b5da-8fd5-4e3e-93d0-fe4561a977c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:43.274341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2b5da-8fd5-4e3e-93d0-fe4561a977c5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:43.274620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2b5da-8fd5-4e3e-93d0-fe4561a977c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:43.274871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad9156-4ab2-41bf-98ee-9aaa4db76db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:43.274987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc2b5da-8fd5-4e3e-93d0-fe4561a977c5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:43.275480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad9156-4ab2-41bf-98ee-9aaa4db76db2 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:43.275760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad9156-4ab2-41bf-98ee-9aaa4db76db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:43.276033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad9156-4ab2-41bf-98ee-9aaa4db76db2 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:43.276714 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad9156-4ab2-41bf-98ee-9aaa4db76db2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:43.278202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad9156-4ab2-41bf-98ee-9aaa4db76db2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:43.301640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 103/202] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:49:43 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:43.302295 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad9156-4ab2-41bf-98ee-9aaa4db76db2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:43.360182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2b5da-8fd5-4e3e-93d0-fe4561a977c5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:43.361721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc2b5da-8fd5-4e3e-93d0-fe4561a977c5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:43.417424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:43.426377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad9156-4ab2-41bf-98ee-9aaa4db76db2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:43.467920 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1db0fc-4c17-4206-8b03-f9f9c76d8ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:43.468480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1db0fc-4c17-4206-8b03-f9f9c76d8ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:43.468763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1db0fc-4c17-4206-8b03-f9f9c76d8ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:43.469037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1db0fc-4c17-4206-8b03-f9f9c76d8ba2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:43.469870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1db0fc-4c17-4206-8b03-f9f9c76d8ba2 None admin] RBAC: Adding query filter params (role.id=fce6359ef8b8407a9887ee97701093a8, scope.project.id=de598ff4856d4edc9937647ebb5aa468, user.id=6b4bc018f4674c9aa66691e4ef4e8e45) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:43.470179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1db0fc-4c17-4206-8b03-f9f9c76d8ba2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:43.471651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1db0fc-4c17-4206-8b03-f9f9c76d8ba2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:43.474927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:43.479698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 104/203] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:43 2022] GET /identity/v3/role_assignments?user.id=6b4bc018f4674c9aa66691e4ef4e8e45&scope.project.id=de598ff4856d4edc9937647ebb5aa468&role.id=fce6359ef8b8407a9887ee97701093a8 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:43.480128 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 100/204] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:43.480750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2b5da-8fd5-4e3e-93d0-fe4561a977c5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:43.485877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1db0fc-4c17-4206-8b03-f9f9c76d8ba2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:43.614752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1db0fc-4c17-4206-8b03-f9f9c76d8ba2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:43.633088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc2b5da-8fd5-4e3e-93d0-fe4561a977c5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:43.662785 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446a45d-ba4f-4b6e-a4db-6b19bf628191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:43.663438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446a45d-ba4f-4b6e-a4db-6b19bf628191 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:43.663718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446a45d-ba4f-4b6e-a4db-6b19bf628191 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:43.663991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b446a45d-ba4f-4b6e-a4db-6b19bf628191 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:43.666262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446a45d-ba4f-4b6e-a4db-6b19bf628191 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:43.667756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b446a45d-ba4f-4b6e-a4db-6b19bf628191 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:43.670502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 105/205] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:43 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:43.676858 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdeb18-2c6f-4dd7-b448-d012e4c44d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:43.677886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdeb18-2c6f-4dd7-b448-d012e4c44d76 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:43.678387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdeb18-2c6f-4dd7-b448-d012e4c44d76 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:43.678796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446a45d-ba4f-4b6e-a4db-6b19bf628191 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:43.679069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cdeb18-2c6f-4dd7-b448-d012e4c44d76 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:43.680557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdeb18-2c6f-4dd7-b448-d012e4c44d76 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:43.682543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cdeb18-2c6f-4dd7-b448-d012e4c44d76 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:43.685799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 101/206] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:43 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:43.693654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdeb18-2c6f-4dd7-b448-d012e4c44d76 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:43.722917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:43.789176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:43.818376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b446a45d-ba4f-4b6e-a4db-6b19bf628191 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:43.835918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cdeb18-2c6f-4dd7-b448-d012e4c44d76 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:43.864985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e1a8cb-7cdd-486b-81df-c711c44df46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:43.865983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1a8cb-7cdd-486b-81df-c711c44df46a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:43.866475 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1a8cb-7cdd-486b-81df-c711c44df46a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:43.866952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e1a8cb-7cdd-486b-81df-c711c44df46a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:43.867951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1a8cb-7cdd-486b-81df-c711c44df46a None admin] RBAC: Adding query filter params (role.id=d0262ce715f7448babe9cef93dc25e9d, scope.project.id=50a4f8b5734d4771ab600161af000c0d, user.id=23436fc664774831bd54dc387a93696c) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:43.868471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1a8cb-7cdd-486b-81df-c711c44df46a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:43.870175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e1a8cb-7cdd-486b-81df-c711c44df46a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:43.876790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 106/207] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:43 2022] GET /identity/v3/role_assignments?user.id=23436fc664774831bd54dc387a93696c&scope.project.id=50a4f8b5734d4771ab600161af000c0d&role.id=d0262ce715f7448babe9cef93dc25e9d => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:43.888156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512ccc8-bb5f-4abd-a7e4-847dbb57ae32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:43.888803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ccc8-bb5f-4abd-a7e4-847dbb57ae32 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:43.889084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ccc8-bb5f-4abd-a7e4-847dbb57ae32 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:43.889400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512ccc8-bb5f-4abd-a7e4-847dbb57ae32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:43.890217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ccc8-bb5f-4abd-a7e4-847dbb57ae32 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=50a4f8b5734d4771ab600161af000c0d, user.id=23436fc664774831bd54dc387a93696c) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:43.890527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ccc8-bb5f-4abd-a7e4-847dbb57ae32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:43.893021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512ccc8-bb5f-4abd-a7e4-847dbb57ae32 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:43.903836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 102/208] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:43 2022] GET /identity/v3/role_assignments?user.id=23436fc664774831bd54dc387a93696c&scope.project.id=50a4f8b5734d4771ab600161af000c0d&role.id=0195bf688a7e464e8ff594afe80b050e => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:45.571085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbb6ae-7e15-4606-bee9-d017a0fba07a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:45.571571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbb6ae-7e15-4606-bee9-d017a0fba07a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:45.571571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dbb6ae-7e15-4606-bee9-d017a0fba07a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:45.572885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 107/209] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:45.578035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c35bc-b932-4fe3-bce1-d91ec28de0ae None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:45.578441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c35bc-b932-4fe3-bce1-d91ec28de0ae None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:45.578630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c35bc-b932-4fe3-bce1-d91ec28de0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:45.597802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6b5c35bc-b932-4fe3-bce1-d91ec28de0ae None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:45.598996 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6b5c35bc-b932-4fe3-bce1-d91ec28de0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:45.619835 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929116b-f4e0-46f7-8283-bb2d068f764e None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:45.620118 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929116b-f4e0-46f7-8283-bb2d068f764e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:45.620393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929116b-f4e0-46f7-8283-bb2d068f764e None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:45.622673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 108/210] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:49:45.628420 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b735eb-b041-48a9-8411-b03d8e1ef263 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:45.628697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b735eb-b041-48a9-8411-b03d8e1ef263 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:45.628965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b735eb-b041-48a9-8411-b03d8e1ef263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:45.647229 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-92b735eb-b041-48a9-8411-b03d8e1ef263 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:45.648410 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-92b735eb-b041-48a9-8411-b03d8e1ef263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:45.682061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 103/211] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:45.704852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c35bc-b932-4fe3-bce1-d91ec28de0ae None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:45.736154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 109/212] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:45.760829 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b735eb-b041-48a9-8411-b03d8e1ef263 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:45.776983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:45.789659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:45.827080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c35bc-b932-4fe3-bce1-d91ec28de0ae None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:45.874247 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4504b-f98f-4e66-9f94-49d37968d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:45.874907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4504b-f98f-4e66-9f94-49d37968d035 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:45.875187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4504b-f98f-4e66-9f94-49d37968d035 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:45.875459 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a4504b-f98f-4e66-9f94-49d37968d035 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:45.876275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b735eb-b041-48a9-8411-b03d8e1ef263 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:45.888761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a4504b-f98f-4e66-9f94-49d37968d035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-f6a4504b-f98f-4e66-9f94-49d37968d035 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:45.897651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:45.898532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:45.899315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 104/213] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:49:45.906308 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4504b-f98f-4e66-9f94-49d37968d035 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:45.918867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0aab4-dda5-4a68-88c0-d3ce7f34c006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:45.919504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0aab4-dda5-4a68-88c0-d3ce7f34c006 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:45.919778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0aab4-dda5-4a68-88c0-d3ce7f34c006 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:45.920046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0aab4-dda5-4a68-88c0-d3ce7f34c006 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:45.921171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0aab4-dda5-4a68-88c0-d3ce7f34c006 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:45.922654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0aab4-dda5-4a68-88c0-d3ce7f34c006 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:45.924215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 110/214] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:45.925367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6875d-ad9c-4c0f-be23-25b3174ae131 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:45.925643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6875d-ad9c-4c0f-be23-25b3174ae131 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:45.925909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6875d-ad9c-4c0f-be23-25b3174ae131 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:45.927100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 111/215] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:45.929338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bd02a-7456-4bd0-83ba-3debdb88e356 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:45.929338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bd02a-7456-4bd0-83ba-3debdb88e356 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:45.929338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29bd02a-7456-4bd0-83ba-3debdb88e356 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:45.930268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 112/216] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:45.931118 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bd02a-7456-4bd0-83ba-3debdb88e356 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:46.018653 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a4504b-f98f-4e66-9f94-49d37968d035 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:46.023645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:46.035224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29bd02a-7456-4bd0-83ba-3debdb88e356 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:46.041922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:46.053521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f958f27-74a7-41ba-bbe4-9e2737b58d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:46.054133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f958f27-74a7-41ba-bbe4-9e2737b58d88 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:46.054411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f958f27-74a7-41ba-bbe4-9e2737b58d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:46.054683 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f958f27-74a7-41ba-bbe4-9e2737b58d88 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:46.055398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f958f27-74a7-41ba-bbe4-9e2737b58d88 None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:46.055700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f958f27-74a7-41ba-bbe4-9e2737b58d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:46.057100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f958f27-74a7-41ba-bbe4-9e2737b58d88 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:46.064938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 105/217] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:46.066118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43949b-785c-4953-8080-353c87decaaf None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:46.066373 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43949b-785c-4953-8080-353c87decaaf None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:46.066647 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43949b-785c-4953-8080-353c87decaaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:46.073000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a0595b-28a8-4886-8a0d-357b8176441c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:46.073649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0595b-28a8-4886-8a0d-357b8176441c None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:46.073927 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0595b-28a8-4886-8a0d-357b8176441c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:46.074194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a0595b-28a8-4886-8a0d-357b8176441c None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:46.074866 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0595b-28a8-4886-8a0d-357b8176441c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:46.076304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a0595b-28a8-4886-8a0d-357b8176441c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:46.083974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8b43949b-785c-4953-8080-353c87decaaf None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:46.085089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8b43949b-785c-4953-8080-353c87decaaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:46.098927 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 113/218] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:49:45 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 11:49:46.100147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ff5fe-7999-4760-a352-97e490135024 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:46.100428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ff5fe-7999-4760-a352-97e490135024 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:46.100948 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8ff5fe-7999-4760-a352-97e490135024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:46.121659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9a8ff5fe-7999-4760-a352-97e490135024 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:46.123030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9a8ff5fe-7999-4760-a352-97e490135024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:46.173308 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 106/219] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:46.186347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43949b-785c-4953-8080-353c87decaaf None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:46.208445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 114/220] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:46.209336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ff5fe-7999-4760-a352-97e490135024 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:46.304090 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:46.320087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43949b-785c-4953-8080-353c87decaaf None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:46.332118 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8ff5fe-7999-4760-a352-97e490135024 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:46.340422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:46.366651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63f61f-603f-4167-b81e-cd8ad7a0c987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:46.367941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f61f-603f-4167-b81e-cd8ad7a0c987 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:46.368409 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f61f-603f-4167-b81e-cd8ad7a0c987 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:46.368827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa63f61f-603f-4167-b81e-cd8ad7a0c987 None admin] PATH_INFO: `/v3/users/315e459a707d4df8a2dfa39e9fc6856a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:46.375736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7ffef-23f9-4657-b8e3-ace70a8c9469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:46.376378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7ffef-23f9-4657-b8e3-ace70a8c9469 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:46.376650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7ffef-23f9-4657-b8e3-ace70a8c9469 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:46.376919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7ffef-23f9-4657-b8e3-ace70a8c9469 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:46.385838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63f61f-603f-4167-b81e-cd8ad7a0c987 None admin] RBAC: Authorizing `identity:get_user(user_id=315e459a707d4df8a2dfa39e9fc6856a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:46.387449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa63f61f-603f-4167-b81e-cd8ad7a0c987 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:46.390925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7ffef-23f9-4657-b8e3-ace70a8c9469 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:46.392771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 107/221] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:46 2022] GET /identity/v3/users/315e459a707d4df8a2dfa39e9fc6856a => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:46.393658 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63f61f-603f-4167-b81e-cd8ad7a0c987 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c7a7ffef-23f9-4657-b8e3-ace70a8c9469 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:46.396465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:46.397404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:46.398184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:46.398184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:46.398184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:46.398184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:46.398184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:46.398184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:46.398184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:46.398184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:46.398184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:46.398184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:46.398184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:49:46.398184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:46.399219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 115/222] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:49:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:46.399978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7ffef-23f9-4657-b8e3-ace70a8c9469 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:46.514471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7ffef-23f9-4657-b8e3-ace70a8c9469 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:46.518214 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa63f61f-603f-4167-b81e-cd8ad7a0c987 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:46.551859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e97dd-2cf4-45e7-b493-f9ccca4b0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:46.552825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e97dd-2cf4-45e7-b493-f9ccca4b0ffa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:46.553358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e97dd-2cf4-45e7-b493-f9ccca4b0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:46.553847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e97dd-2cf4-45e7-b493-f9ccca4b0ffa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:46.558426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:46.562879 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc08513-f9c9-43ae-8eb3-dff382bd0c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:46.563535 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc08513-f9c9-43ae-8eb3-dff382bd0c0d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:46.563816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc08513-f9c9-43ae-8eb3-dff382bd0c0d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:46.564089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc08513-f9c9-43ae-8eb3-dff382bd0c0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:46.579400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc08513-f9c9-43ae-8eb3-dff382bd0c0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-4fc08513-f9c9-43ae-8eb3-dff382bd0c0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:46.586688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:46.587614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:46.588427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 108/223] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:49:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:46.589097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc08513-f9c9-43ae-8eb3-dff382bd0c0d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:46.633953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e97dd-2cf4-45e7-b493-f9ccca4b0ffa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:46.636029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e97dd-2cf4-45e7-b493-f9ccca4b0ffa None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:46.649726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:46.721637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc08513-f9c9-43ae-8eb3-dff382bd0c0d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:46.749791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 116/224] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:46.751172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e97dd-2cf4-45e7-b493-f9ccca4b0ffa None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:46.761778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d6baa-6756-4527-befd-952def7bfff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:46.762656 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d6baa-6756-4527-befd-952def7bfff4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:46.762932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d6baa-6756-4527-befd-952def7bfff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:46.763305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d6baa-6756-4527-befd-952def7bfff4 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:46.764136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d6baa-6756-4527-befd-952def7bfff4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:46.764537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d6baa-6756-4527-befd-952def7bfff4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:46.766049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7d6baa-6756-4527-befd-952def7bfff4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:46.774828 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 109/225] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:49:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:46.779738 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d6baa-6756-4527-befd-952def7bfff4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:46.803074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:46.892692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e97dd-2cf4-45e7-b493-f9ccca4b0ffa None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:46.910753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:46.922373 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d6baa-6756-4527-befd-952def7bfff4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:46.932073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1da34-3111-4b55-9e46-c6582d809dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:46.932980 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1da34-3111-4b55-9e46-c6582d809dcc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:46.933452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1da34-3111-4b55-9e46-c6582d809dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:46.933920 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1da34-3111-4b55-9e46-c6582d809dcc None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:46.934779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1da34-3111-4b55-9e46-c6582d809dcc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:46.935224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1da34-3111-4b55-9e46-c6582d809dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:46.936856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1da34-3111-4b55-9e46-c6582d809dcc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:46.946002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 117/226] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:46.947220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1da34-3111-4b55-9e46-c6582d809dcc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:46.967833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5c4be-5d94-4c76-890e-a16b78e4ee56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:46.968580 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5c4be-5d94-4c76-890e-a16b78e4ee56 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:46.968930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5c4be-5d94-4c76-890e-a16b78e4ee56 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:46.969283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b5c4be-5d94-4c76-890e-a16b78e4ee56 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:46.970564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5c4be-5d94-4c76-890e-a16b78e4ee56 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:46.973150 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b5c4be-5d94-4c76-890e-a16b78e4ee56 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:46.976453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 110/227] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:46 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:46.977454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5c4be-5d94-4c76-890e-a16b78e4ee56 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:47.053884 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:47.058002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1da34-3111-4b55-9e46-c6582d809dcc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:47.095693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91167a4-d596-4fe5-aa9f-0ceadad00b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:47.096665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91167a4-d596-4fe5-aa9f-0ceadad00b49 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:47.097193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91167a4-d596-4fe5-aa9f-0ceadad00b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:47.097686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91167a4-d596-4fe5-aa9f-0ceadad00b49 None admin] PATH_INFO: `/v3/users/23436fc664774831bd54dc387a93696c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:47.099062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91167a4-d596-4fe5-aa9f-0ceadad00b49 None admin] RBAC: Authorizing `identity:get_user(user_id=23436fc664774831bd54dc387a93696c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:47.100963 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91167a4-d596-4fe5-aa9f-0ceadad00b49 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:47.103272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 118/228] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:46 2022] GET /identity/v3/users/23436fc664774831bd54dc387a93696c => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:47.104246 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91167a4-d596-4fe5-aa9f-0ceadad00b49 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:47.125975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b5c4be-5d94-4c76-890e-a16b78e4ee56 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:47.167296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1f8f4-a5d3-48d2-b513-05ec69822a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:47.167861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1f8f4-a5d3-48d2-b513-05ec69822a1f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:47.168141 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1f8f4-a5d3-48d2-b513-05ec69822a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:47.168415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b1f8f4-a5d3-48d2-b513-05ec69822a1f None admin] PATH_INFO: `/v3/users/23436fc664774831bd54dc387a93696c` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:47.169638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1f8f4-a5d3-48d2-b513-05ec69822a1f None admin] RBAC: Authorizing `identity:get_user(user_id=23436fc664774831bd54dc387a93696c)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:47.171707 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b1f8f4-a5d3-48d2-b513-05ec69822a1f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:47.173697 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 111/229] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:46 2022] GET /identity/v3/users/23436fc664774831bd54dc387a93696c => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:47.174204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1f8f4-a5d3-48d2-b513-05ec69822a1f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:47.215545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:47.267572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91167a4-d596-4fe5-aa9f-0ceadad00b49 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:47.310298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b1f8f4-a5d3-48d2-b513-05ec69822a1f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:47.318770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac641bbe-71f7-49e1-a14c-b838f53e90a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:47.319390 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac641bbe-71f7-49e1-a14c-b838f53e90a1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:47.319674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac641bbe-71f7-49e1-a14c-b838f53e90a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:47.320483 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac641bbe-71f7-49e1-a14c-b838f53e90a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:47.321287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac641bbe-71f7-49e1-a14c-b838f53e90a1 None admin] RBAC: Adding query filter params (role.id=251e50fd870c48f3a02b69587144b7bf, scope.project.id=50a4f8b5734d4771ab600161af000c0d, user.id=315e459a707d4df8a2dfa39e9fc6856a) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:47.321636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac641bbe-71f7-49e1-a14c-b838f53e90a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:47.324003 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac641bbe-71f7-49e1-a14c-b838f53e90a1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:47.332220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 119/230] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:47 2022] GET /identity/v3/role_assignments?user.id=315e459a707d4df8a2dfa39e9fc6856a&scope.project.id=50a4f8b5734d4771ab600161af000c0d&role.id=251e50fd870c48f3a02b69587144b7bf => generated 259 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:47.333132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac641bbe-71f7-49e1-a14c-b838f53e90a1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:47.380978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7ebc6-810f-4488-b791-4edcefb61517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:47.381723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7ebc6-810f-4488-b791-4edcefb61517 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:47.382002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7ebc6-810f-4488-b791-4edcefb61517 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:47.382274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a7ebc6-810f-4488-b791-4edcefb61517 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:47.384903 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7ebc6-810f-4488-b791-4edcefb61517 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:47.386511 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a7ebc6-810f-4488-b791-4edcefb61517 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:47.392031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 112/231] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:47 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:47.394348 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7ebc6-810f-4488-b791-4edcefb61517 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:47.409734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:47.552566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac641bbe-71f7-49e1-a14c-b838f53e90a1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:47.587232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:47.594540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a7ebc6-810f-4488-b791-4edcefb61517 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:47.630880 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6b2d3-3c64-4e49-b7c8-18899b7e8e74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:47.631671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6b2d3-3c64-4e49-b7c8-18899b7e8e74 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:47.631958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6b2d3-3c64-4e49-b7c8-18899b7e8e74 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:47.632231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec6b2d3-3c64-4e49-b7c8-18899b7e8e74 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d/users/23436fc664774831bd54dc387a93696c/roles/d0262ce715f7448babe9cef93dc25e9d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:47.634481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6b2d3-3c64-4e49-b7c8-18899b7e8e74 None admin] RBAC: Authorizing `identity:create_grant(project_id=50a4f8b5734d4771ab600161af000c0d, user_id=23436fc664774831bd54dc387a93696c, role_id=d0262ce715f7448babe9cef93dc25e9d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:47.635933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec6b2d3-3c64-4e49-b7c8-18899b7e8e74 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:47.649784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca2b691-b4ce-4ef1-bea2-3d625a58c88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:47.650437 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2b691-b4ce-4ef1-bea2-3d625a58c88b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:47.651643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2b691-b4ce-4ef1-bea2-3d625a58c88b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:47.651923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca2b691-b4ce-4ef1-bea2-3d625a58c88b None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:47.656409 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 113/232] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:49:47 2022] PUT /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d/users/23436fc664774831bd54dc387a93696c/roles/d0262ce715f7448babe9cef93dc25e9d => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:49:47.656545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2b691-b4ce-4ef1-bea2-3d625a58c88b None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:47.658081 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca2b691-b4ce-4ef1-bea2-3d625a58c88b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:47.660154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 120/233] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:47 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:47.666046 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6b2d3-3c64-4e49-b7c8-18899b7e8e74 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:47.812512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec6b2d3-3c64-4e49-b7c8-18899b7e8e74 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:47.848781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177dba7f-d925-4d39-b3d6-af997835e2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:47.849505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dba7f-d925-4d39-b3d6-af997835e2f0 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:47.849786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dba7f-d925-4d39-b3d6-af997835e2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:47.850058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177dba7f-d925-4d39-b3d6-af997835e2f0 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d/users/23436fc664774831bd54dc387a93696c/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:47.852463 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dba7f-d925-4d39-b3d6-af997835e2f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=50a4f8b5734d4771ab600161af000c0d, user_id=23436fc664774831bd54dc387a93696c, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:47.853972 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177dba7f-d925-4d39-b3d6-af997835e2f0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:47.881451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 114/234] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:49:47 2022] PUT /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d/users/23436fc664774831bd54dc387a93696c/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:49:48.392415 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01100d76-780a-41d7-b09d-798ae16c947c None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:48.392736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01100d76-780a-41d7-b09d-798ae16c947c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:48.392969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01100d76-780a-41d7-b09d-798ae16c947c None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:48.394743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 121/235] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:48.399745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de9db9-fad8-4a47-8be6-96b996be34c6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:48.400035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de9db9-fad8-4a47-8be6-96b996be34c6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:48.400314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8de9db9-fad8-4a47-8be6-96b996be34c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:48.426580 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a8de9db9-fad8-4a47-8be6-96b996be34c6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:48.427798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a8de9db9-fad8-4a47-8be6-96b996be34c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:48.441892 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:48.507644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 115/236] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:48.530632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01100d76-780a-41d7-b09d-798ae16c947c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:48.621406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbabc1-26cd-4dbe-9e0f-ecd93a939785 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:48.621894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbabc1-26cd-4dbe-9e0f-ecd93a939785 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:48.621894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edbabc1-26cd-4dbe-9e0f-ecd93a939785 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:48.623596 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 116/237] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:48.628558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fa85a-b423-43b9-abcc-d77b283bc308 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:48.628903 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fa85a-b423-43b9-abcc-d77b283bc308 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:48.629248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257fa85a-b423-43b9-abcc-d77b283bc308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:48.639682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01100d76-780a-41d7-b09d-798ae16c947c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:48.647446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-257fa85a-b423-43b9-abcc-d77b283bc308 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:48.648803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-257fa85a-b423-43b9-abcc-d77b283bc308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:48.657996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:48.681206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb84958-0f59-4a41-82d9-9c193bc84c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:48.682632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb84958-0f59-4a41-82d9-9c193bc84c66 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:48.683085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb84958-0f59-4a41-82d9-9c193bc84c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:48.683522 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb84958-0f59-4a41-82d9-9c193bc84c66 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:48.695576 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb84958-0f59-4a41-82d9-9c193bc84c66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6eb84958-0f59-4a41-82d9-9c193bc84c66 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:48.701132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:48.702048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:48.702853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:48.702853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:48.702853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:48.702853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:48.702853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:48.702853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:48.702853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:48.702853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:48.702853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:48.702853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:48.702853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:48.702853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:48.706036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 122/238] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:48.712145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb84958-0f59-4a41-82d9-9c193bc84c66 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:48.823370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb84958-0f59-4a41-82d9-9c193bc84c66 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:48.846620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 117/239] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:48.860247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43357a-7b7e-4079-b878-c9332c4f02af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:48.861096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43357a-7b7e-4079-b878-c9332c4f02af None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:48.861594 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43357a-7b7e-4079-b878-c9332c4f02af None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:48.862065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd43357a-7b7e-4079-b878-c9332c4f02af None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:48.863050 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43357a-7b7e-4079-b878-c9332c4f02af None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:48.863529 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43357a-7b7e-4079-b878-c9332c4f02af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:48.865082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd43357a-7b7e-4079-b878-c9332c4f02af None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:48.873867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 123/240] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:48.882374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fa85a-b423-43b9-abcc-d77b283bc308 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:48.885505 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43357a-7b7e-4079-b878-c9332c4f02af None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:48.917732 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:48.995580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd43357a-7b7e-4079-b878-c9332c4f02af None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:49.032213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68042b3a-64e2-46ae-a0cd-fcaee972f622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:49.033116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68042b3a-64e2-46ae-a0cd-fcaee972f622 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:49.033908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68042b3a-64e2-46ae-a0cd-fcaee972f622 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:49.034970 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68042b3a-64e2-46ae-a0cd-fcaee972f622 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:49.036538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68042b3a-64e2-46ae-a0cd-fcaee972f622 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:49.038216 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68042b3a-64e2-46ae-a0cd-fcaee972f622 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:49.039985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 124/241] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:49.045943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68042b3a-64e2-46ae-a0cd-fcaee972f622 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:49.130500 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:49.157705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:49.177689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68042b3a-64e2-46ae-a0cd-fcaee972f622 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:49.182324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257fa85a-b423-43b9-abcc-d77b283bc308 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:49.214734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c53e10-cc98-42f7-b9fb-d1c5730b2aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:49.215810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c53e10-cc98-42f7-b9fb-d1c5730b2aea None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:49.216290 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c53e10-cc98-42f7-b9fb-d1c5730b2aea None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:49.216762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c53e10-cc98-42f7-b9fb-d1c5730b2aea None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:49.217671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c53e10-cc98-42f7-b9fb-d1c5730b2aea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:49.219464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c53e10-cc98-42f7-b9fb-d1c5730b2aea None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:49.248014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 125/242] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:49:49 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 11:49:49.257806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84715ec0-4fe5-4905-8c53-8369c8386c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:49.258823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715ec0-4fe5-4905-8c53-8369c8386c57 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:49.259332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715ec0-4fe5-4905-8c53-8369c8386c57 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:49.259818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84715ec0-4fe5-4905-8c53-8369c8386c57 None admin] PATH_INFO: `/v3/users/2050cc97153541d996daef4a9f63a6c1` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:49.279708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84715ec0-4fe5-4905-8c53-8369c8386c57 None admin] RBAC: Authorizing `identity:get_user(user_id=2050cc97153541d996daef4a9f63a6c1)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:49.281557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84715ec0-4fe5-4905-8c53-8369c8386c57 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:49.283765 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 118/243] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:48 2022] GET /identity/v3/users/2050cc97153541d996daef4a9f63a6c1 => generated 297 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:49.294770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c53e10-cc98-42f7-b9fb-d1c5730b2aea None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:49.468995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c53e10-cc98-42f7-b9fb-d1c5730b2aea None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:49.517746 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9183e41-b278-45aa-abc8-1836c2b2aa8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:49.518784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9183e41-b278-45aa-abc8-1836c2b2aa8e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:49.519283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9183e41-b278-45aa-abc8-1836c2b2aa8e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:49.519754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9183e41-b278-45aa-abc8-1836c2b2aa8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:49.541788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:49.609154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9183e41-b278-45aa-abc8-1836c2b2aa8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:49.610767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9183e41-b278-45aa-abc8-1836c2b2aa8e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:49.738665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 126/244] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:49.744190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84715ec0-4fe5-4905-8c53-8369c8386c57 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:49.853039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84715ec0-4fe5-4905-8c53-8369c8386c57 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:49.883315 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b45f-2750-4127-9e2a-7576f3603037 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:49.883626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b45f-2750-4127-9e2a-7576f3603037 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:49.883875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483b45f-2750-4127-9e2a-7576f3603037 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:49.885740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 127/245] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:49:49.890838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df824b-91b6-4866-94e0-81d6cb0097cf None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:49.891125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df824b-91b6-4866-94e0-81d6cb0097cf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:49.891399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df824b-91b6-4866-94e0-81d6cb0097cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:49.892814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84f12c-12d3-4334-bb26-d96b0de50053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:49.893512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84f12c-12d3-4334-bb26-d96b0de50053 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:49.893829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84f12c-12d3-4334-bb26-d96b0de50053 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:49.894192 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec84f12c-12d3-4334-bb26-d96b0de50053 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:49.895519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84f12c-12d3-4334-bb26-d96b0de50053 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:49.897238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec84f12c-12d3-4334-bb26-d96b0de50053 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:49.900330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 119/246] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:49 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:49.906398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84f12c-12d3-4334-bb26-d96b0de50053 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:49.911350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:49.918443 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-63df824b-91b6-4866-94e0-81d6cb0097cf None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:49.922353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-63df824b-91b6-4866-94e0-81d6cb0097cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:49.974774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:50.019551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 128/247] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:50.042380 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df824b-91b6-4866-94e0-81d6cb0097cf None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:50.054310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec84f12c-12d3-4334-bb26-d96b0de50053 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:50.094179 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b588e-5c1c-4584-b1ef-0f60e2deef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:50.095041 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b588e-5c1c-4584-b1ef-0f60e2deef5d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:50.095497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b588e-5c1c-4584-b1ef-0f60e2deef5d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:50.095932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b588e-5c1c-4584-b1ef-0f60e2deef5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:50.097467 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b588e-5c1c-4584-b1ef-0f60e2deef5d None admin] RBAC: Adding query filter params (role.id=fce6359ef8b8407a9887ee97701093a8, scope.project.id=50a4f8b5734d4771ab600161af000c0d, user.id=2050cc97153541d996daef4a9f63a6c1) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:50.097917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b588e-5c1c-4584-b1ef-0f60e2deef5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:50.099517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b588e-5c1c-4584-b1ef-0f60e2deef5d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:50.108587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 120/248] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:49 2022] GET /identity/v3/role_assignments?user.id=2050cc97153541d996daef4a9f63a6c1&scope.project.id=50a4f8b5734d4771ab600161af000c0d&role.id=fce6359ef8b8407a9887ee97701093a8 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:50.165837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df824b-91b6-4866-94e0-81d6cb0097cf None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:50.207247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1691901-08fd-46f5-80c9-bed20a7589fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:50.207913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1691901-08fd-46f5-80c9-bed20a7589fb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:50.208192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1691901-08fd-46f5-80c9-bed20a7589fb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:50.208459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1691901-08fd-46f5-80c9-bed20a7589fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:50.214104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27e5b-245a-49a2-b737-2f9ee698f6dc None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:50.214715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27e5b-245a-49a2-b737-2f9ee698f6dc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:50.215182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e27e5b-245a-49a2-b737-2f9ee698f6dc None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:50.216975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 121/249] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:50.221218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1691901-08fd-46f5-80c9-bed20a7589fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:50.224830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43995b-7414-41d7-b46e-c17b8e0fad4a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:50.225392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43995b-7414-41d7-b46e-c17b8e0fad4a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:50.226113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43995b-7414-41d7-b46e-c17b8e0fad4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e1691901-08fd-46f5-80c9-bed20a7589fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:50.227029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:50.227915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:50.228709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 129/250] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:50.235434 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1691901-08fd-46f5-80c9-bed20a7589fb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:50.254151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8c43995b-7414-41d7-b46e-c17b8e0fad4a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:50.256676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8c43995b-7414-41d7-b46e-c17b8e0fad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:50.274934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:50.352341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:50.353189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1691901-08fd-46f5-80c9-bed20a7589fb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:50.360608 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 122/251] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:50.363131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8023b9a-aa95-4388-9d6c-dc72d8df89fc None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:50.363564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8023b9a-aa95-4388-9d6c-dc72d8df89fc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:50.364441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8023b9a-aa95-4388-9d6c-dc72d8df89fc None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:50.366476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 123/252] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:50.371911 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd2575-e087-4af0-9854-be97dc902774 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:50.372627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd2575-e087-4af0-9854-be97dc902774 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:50.373048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbd2575-e087-4af0-9854-be97dc902774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:50.396531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160452e2-464d-41a7-b4ee-62332f089512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:50.397204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160452e2-464d-41a7-b4ee-62332f089512 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:50.397584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160452e2-464d-41a7-b4ee-62332f089512 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:50.397861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160452e2-464d-41a7-b4ee-62332f089512 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:50.398645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160452e2-464d-41a7-b4ee-62332f089512 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:50.398829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6fbd2575-e087-4af0-9854-be97dc902774 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:50.398951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160452e2-464d-41a7-b4ee-62332f089512 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:50.400432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6fbd2575-e087-4af0-9854-be97dc902774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:50.400548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160452e2-464d-41a7-b4ee-62332f089512 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:50.410646 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 130/253] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:50.411563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160452e2-464d-41a7-b4ee-62332f089512 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:50.524828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:50.533083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160452e2-464d-41a7-b4ee-62332f089512 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:50.576523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef930561-92ee-483c-9b06-bd6976cd0df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:50.577441 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef930561-92ee-483c-9b06-bd6976cd0df5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:50.578017 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef930561-92ee-483c-9b06-bd6976cd0df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:50.578517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef930561-92ee-483c-9b06-bd6976cd0df5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:50.590658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef930561-92ee-483c-9b06-bd6976cd0df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:50.594083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 124/254] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:50.594947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd2575-e087-4af0-9854-be97dc902774 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ef930561-92ee-483c-9b06-bd6976cd0df5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:50.597828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:50.598912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:50.599910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:50.599910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:50.599910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:50.599910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:50.599910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:50.599910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:50.599910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:50.599910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:50.599910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:50.599910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:50.599910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:49:50.599910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:50.602316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 131/255] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:49:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:50.612850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef930561-92ee-483c-9b06-bd6976cd0df5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:50.768421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbd2575-e087-4af0-9854-be97dc902774 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:50.804587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef930561-92ee-483c-9b06-bd6976cd0df5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:50.822434 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:50.836369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392138ad-8313-4c16-ae2d-90b8269126e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:50.837081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392138ad-8313-4c16-ae2d-90b8269126e2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:50.837386 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392138ad-8313-4c16-ae2d-90b8269126e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:50.837664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392138ad-8313-4c16-ae2d-90b8269126e2 None admin] PATH_INFO: `/v3/users/315e459a707d4df8a2dfa39e9fc6856a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:50.839894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392138ad-8313-4c16-ae2d-90b8269126e2 None admin] RBAC: Authorizing `identity:get_user(user_id=315e459a707d4df8a2dfa39e9fc6856a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:50.841374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392138ad-8313-4c16-ae2d-90b8269126e2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:50.843171 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 125/256] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:50 2022] GET /identity/v3/users/315e459a707d4df8a2dfa39e9fc6856a => generated 297 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:50.845287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392138ad-8313-4c16-ae2d-90b8269126e2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:50.866168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f47a4-f363-4611-9d63-9ae8dff0b1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:50.866803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f47a4-f363-4611-9d63-9ae8dff0b1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:50.867085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f47a4-f363-4611-9d63-9ae8dff0b1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:50.867359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1f47a4-f363-4611-9d63-9ae8dff0b1c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:50.868148 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f47a4-f363-4611-9d63-9ae8dff0b1c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:50.868454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f47a4-f363-4611-9d63-9ae8dff0b1c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:50.871167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1f47a4-f363-4611-9d63-9ae8dff0b1c4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:50.887977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 132/257] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:49:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:50.889245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f47a4-f363-4611-9d63-9ae8dff0b1c4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:50.941667 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:51.014134 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392138ad-8313-4c16-ae2d-90b8269126e2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:51.057077 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76268e-b8a5-40e5-9680-06e70660e8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:51.058605 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76268e-b8a5-40e5-9680-06e70660e8fb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:51.059034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76268e-b8a5-40e5-9680-06e70660e8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:51.059314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76268e-b8a5-40e5-9680-06e70660e8fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:51.073256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c76268e-b8a5-40e5-9680-06e70660e8fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-6c76268e-b8a5-40e5-9680-06e70660e8fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:51.082464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:51.083333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:51.084121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:51.084121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:51.084121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:51.084121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:51.084121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:51.084121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:51.084121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:51.084121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:51.084121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:51.084121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:51.084121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:49:51.084121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:51.085402 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 126/258] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:49:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:51.089334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76268e-b8a5-40e5-9680-06e70660e8fb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:51.091654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1f47a4-f363-4611-9d63-9ae8dff0b1c4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:51.155694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:51.189994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb616e-8488-4c1b-9344-5c77566e6496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:51.191071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb616e-8488-4c1b-9344-5c77566e6496 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:51.191563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb616e-8488-4c1b-9344-5c77566e6496 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:51.192031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bb616e-8488-4c1b-9344-5c77566e6496 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:51.193523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb616e-8488-4c1b-9344-5c77566e6496 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:51.195279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bb616e-8488-4c1b-9344-5c77566e6496 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:51.197467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 133/259] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:50 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:51.198412 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb616e-8488-4c1b-9344-5c77566e6496 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:51.205476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c76268e-b8a5-40e5-9680-06e70660e8fb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:51.243389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1efe94-64ab-4364-bc77-7f658a47fd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:51.246630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1efe94-64ab-4364-bc77-7f658a47fd19 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:51.246630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1efe94-64ab-4364-bc77-7f658a47fd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:51.246630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1efe94-64ab-4364-bc77-7f658a47fd19 None admin] PATH_INFO: `/v3/users/23436fc664774831bd54dc387a93696c` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:51.247643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1efe94-64ab-4364-bc77-7f658a47fd19 None admin] RBAC: Authorizing `identity:get_user(user_id=23436fc664774831bd54dc387a93696c)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:51.249541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1efe94-64ab-4364-bc77-7f658a47fd19 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:51.255549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 127/260] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:51 2022] GET /identity/v3/users/23436fc664774831bd54dc387a93696c => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:51.256472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1efe94-64ab-4364-bc77-7f658a47fd19 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:51.333778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:51.346080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bb616e-8488-4c1b-9344-5c77566e6496 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:51.386877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f4978-308e-40dc-a3d4-70d64da3e67f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:51.387613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f4978-308e-40dc-a3d4-70d64da3e67f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:51.387966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f4978-308e-40dc-a3d4-70d64da3e67f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:51.388367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7f4978-308e-40dc-a3d4-70d64da3e67f None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:51.389431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f4978-308e-40dc-a3d4-70d64da3e67f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:51.389746 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f4978-308e-40dc-a3d4-70d64da3e67f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:51.391320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7f4978-308e-40dc-a3d4-70d64da3e67f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:51.403063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 134/261] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:51.403932 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f4978-308e-40dc-a3d4-70d64da3e67f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:51.515803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7f4978-308e-40dc-a3d4-70d64da3e67f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:51.552352 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df33c63-1f67-44d4-b7fc-9c2e1d5af38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:51.552973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df33c63-1f67-44d4-b7fc-9c2e1d5af38c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:51.553254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df33c63-1f67-44d4-b7fc-9c2e1d5af38c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:51.553561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df33c63-1f67-44d4-b7fc-9c2e1d5af38c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:51.589777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:51.630528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df33c63-1f67-44d4-b7fc-9c2e1d5af38c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:51.632074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df33c63-1f67-44d4-b7fc-9c2e1d5af38c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:51.663322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1efe94-64ab-4364-bc77-7f658a47fd19 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:51.743380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:51.746127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 135/262] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:51.748068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df33c63-1f67-44d4-b7fc-9c2e1d5af38c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:51.789212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5797daa-8b9d-437b-b667-4159bb9727c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:51.790077 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5797daa-8b9d-437b-b667-4159bb9727c1 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:51.790456 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5797daa-8b9d-437b-b667-4159bb9727c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:51.790828 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5797daa-8b9d-437b-b667-4159bb9727c1 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d/users/315e459a707d4df8a2dfa39e9fc6856a/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:51.793001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5797daa-8b9d-437b-b667-4159bb9727c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=50a4f8b5734d4771ab600161af000c0d, user_id=315e459a707d4df8a2dfa39e9fc6856a, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:51.794599 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5797daa-8b9d-437b-b667-4159bb9727c1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:51.811577 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:51.828969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 128/263] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:49:51 2022] PUT /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d/users/315e459a707d4df8a2dfa39e9fc6856a/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 573 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:49:51.829984 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5797daa-8b9d-437b-b667-4159bb9727c1 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:51.864260 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df33c63-1f67-44d4-b7fc-9c2e1d5af38c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:51.907717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b31b9-9046-4f79-8eaf-bff95a399ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:51.908951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b31b9-9046-4f79-8eaf-bff95a399ad0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:51.909544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b31b9-9046-4f79-8eaf-bff95a399ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:51.910024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b31b9-9046-4f79-8eaf-bff95a399ad0 None admin] PATH_INFO: `/v3/users/23436fc664774831bd54dc387a93696c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:51.911763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b31b9-9046-4f79-8eaf-bff95a399ad0 None admin] RBAC: Authorizing `identity:get_user(user_id=23436fc664774831bd54dc387a93696c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:51.914453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b31b9-9046-4f79-8eaf-bff95a399ad0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:51.916532 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 136/264] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:51 2022] GET /identity/v3/users/23436fc664774831bd54dc387a93696c => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:51.934719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b31b9-9046-4f79-8eaf-bff95a399ad0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:52.117236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b31b9-9046-4f79-8eaf-bff95a399ad0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:52.119623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5797daa-8b9d-437b-b667-4159bb9727c1 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:52.139193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:52.162142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9e356-5b4f-4ae2-ac18-4c03f936405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:52.163138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9e356-5b4f-4ae2-ac18-4c03f936405a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:52.163622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9e356-5b4f-4ae2-ac18-4c03f936405a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:52.164096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea9e356-5b4f-4ae2-ac18-4c03f936405a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:52.203121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed1b8f-40dc-49c4-983c-a5edb9e5bb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:52.203815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed1b8f-40dc-49c4-983c-a5edb9e5bb3c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:52.204100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed1b8f-40dc-49c4-983c-a5edb9e5bb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:52.204333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed1b8f-40dc-49c4-983c-a5edb9e5bb3c None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:52.206485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed1b8f-40dc-49c4-983c-a5edb9e5bb3c None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:52.208050 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed1b8f-40dc-49c4-983c-a5edb9e5bb3c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:52.209745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 129/265] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:51 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:52.215809 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed1b8f-40dc-49c4-983c-a5edb9e5bb3c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:52.311396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9e356-5b4f-4ae2-ac18-4c03f936405a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:52.312896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea9e356-5b4f-4ae2-ac18-4c03f936405a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:52.334152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:52.429594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed1b8f-40dc-49c4-983c-a5edb9e5bb3c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:52.492778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df56bca2-8bd5-4b06-bf1b-785d98f3d482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:52.493425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56bca2-8bd5-4b06-bf1b-785d98f3d482 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:52.493706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56bca2-8bd5-4b06-bf1b-785d98f3d482 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:52.493975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df56bca2-8bd5-4b06-bf1b-785d98f3d482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:52.494764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56bca2-8bd5-4b06-bf1b-785d98f3d482 None admin] RBAC: Adding query filter params (role.id=d0262ce715f7448babe9cef93dc25e9d, scope.project.id=50a4f8b5734d4771ab600161af000c0d, user.id=23436fc664774831bd54dc387a93696c) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:52.495070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56bca2-8bd5-4b06-bf1b-785d98f3d482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:52.496503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df56bca2-8bd5-4b06-bf1b-785d98f3d482 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:52.508288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 130/266] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:52 2022] GET /identity/v3/role_assignments?user.id=23436fc664774831bd54dc387a93696c&scope.project.id=50a4f8b5734d4771ab600161af000c0d&role.id=d0262ce715f7448babe9cef93dc25e9d => generated 608 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:52.509543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649bc21-7730-4ed5-a367-0448b76244ba None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:52.509826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649bc21-7730-4ed5-a367-0448b76244ba None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:52.510097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649bc21-7730-4ed5-a367-0448b76244ba None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:52.512334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 131/267] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:52.521137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 137/268] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 11:49:52.522514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cd5b5-210e-4e85-8122-48ebb689daae None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:52.522801 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cd5b5-210e-4e85-8122-48ebb689daae None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:52.523078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cd5b5-210e-4e85-8122-48ebb689daae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:52.535217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9e356-5b4f-4ae2-ac18-4c03f936405a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:52.564385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9f9cd5b5-210e-4e85-8122-48ebb689daae None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:52.567176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9f9cd5b5-210e-4e85-8122-48ebb689daae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:52.577757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:52.670926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 132/269] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:52.694475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cd5b5-210e-4e85-8122-48ebb689daae None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:52.709326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea9e356-5b4f-4ae2-ac18-4c03f936405a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:52.745065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:52.774416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b239b1c-663a-42b4-830b-3353ee12f8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:52.775054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b239b1c-663a-42b4-830b-3353ee12f8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:52.775330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b239b1c-663a-42b4-830b-3353ee12f8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:52.775597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b239b1c-663a-42b4-830b-3353ee12f8e4 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:52.776936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b239b1c-663a-42b4-830b-3353ee12f8e4 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:52.778433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b239b1c-663a-42b4-830b-3353ee12f8e4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:52.780386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 138/270] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:52 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:52.781563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828978a-d372-4fd1-a5e1-1910dbeeae3a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:52.781840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828978a-d372-4fd1-a5e1-1910dbeeae3a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:52.782112 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4828978a-d372-4fd1-a5e1-1910dbeeae3a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:52.783662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 139/271] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:52.784737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b236a9-8459-419b-b19a-a1877115ac71 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:52.785056 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b236a9-8459-419b-b19a-a1877115ac71 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:52.785365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b236a9-8459-419b-b19a-a1877115ac71 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:52.787078 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 140/272] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:52.787785 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b236a9-8459-419b-b19a-a1877115ac71 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:52.809242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cd5b5-210e-4e85-8122-48ebb689daae None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:52.848263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da207df-213e-406d-9e30-958b8f61183f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:52.849215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da207df-213e-406d-9e30-958b8f61183f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:52.849699 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da207df-213e-406d-9e30-958b8f61183f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:52.850162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da207df-213e-406d-9e30-958b8f61183f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:52.861935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da207df-213e-406d-9e30-958b8f61183f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-2da207df-213e-406d-9e30-958b8f61183f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:52.867424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:52.868294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:52.869075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 133/273] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:49:52.870347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eba702-b1dc-454c-9c71-dd646dc2506e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:52.870347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eba702-b1dc-454c-9c71-dd646dc2506e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:52.870347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eba702-b1dc-454c-9c71-dd646dc2506e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:52.888338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-18eba702-b1dc-454c-9c71-dd646dc2506e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:52.889565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-18eba702-b1dc-454c-9c71-dd646dc2506e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:52.905499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:52.925784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b236a9-8459-419b-b19a-a1877115ac71 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:52.965064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa47f28-f1bd-4a36-9b85-38832ef4a8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:52.965616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 134/274] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:52.965726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa47f28-f1bd-4a36-9b85-38832ef4a8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:52.965948 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa47f28-f1bd-4a36-9b85-38832ef4a8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:52.966227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa47f28-f1bd-4a36-9b85-38832ef4a8e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:52.967006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa47f28-f1bd-4a36-9b85-38832ef4a8e0 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=50a4f8b5734d4771ab600161af000c0d, user.id=23436fc664774831bd54dc387a93696c) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:52.967317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa47f28-f1bd-4a36-9b85-38832ef4a8e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:52.967909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680894ea-b95a-45d9-8c6e-aef0c9f310bb None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:52.968313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680894ea-b95a-45d9-8c6e-aef0c9f310bb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:52.968716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680894ea-b95a-45d9-8c6e-aef0c9f310bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:52.968809 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa47f28-f1bd-4a36-9b85-38832ef4a8e0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:52.975952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 141/275] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:52 2022] GET /identity/v3/role_assignments?user.id=23436fc664774831bd54dc387a93696c&scope.project.id=50a4f8b5734d4771ab600161af000c0d&role.id=0195bf688a7e464e8ff594afe80b050e => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:52.986431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa47f28-f1bd-4a36-9b85-38832ef4a8e0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:52.990868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-680894ea-b95a-45d9-8c6e-aef0c9f310bb None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:52.992488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-680894ea-b95a-45d9-8c6e-aef0c9f310bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:53.034833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:53.098013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 135/276] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:53.098013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680894ea-b95a-45d9-8c6e-aef0c9f310bb None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:53.120628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa47f28-f1bd-4a36-9b85-38832ef4a8e0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:53.172297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4496f9-9455-46ef-b0f6-bbc9361bd050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:53.172923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4496f9-9455-46ef-b0f6-bbc9361bd050 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:53.173204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4496f9-9455-46ef-b0f6-bbc9361bd050 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:53.173524 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4496f9-9455-46ef-b0f6-bbc9361bd050 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:53.174633 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4496f9-9455-46ef-b0f6-bbc9361bd050 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:53.174633 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4496f9-9455-46ef-b0f6-bbc9361bd050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:53.176693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4496f9-9455-46ef-b0f6-bbc9361bd050 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:53.186771 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 142/277] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:53.187590 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4496f9-9455-46ef-b0f6-bbc9361bd050 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:53.203105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:53.246839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680894ea-b95a-45d9-8c6e-aef0c9f310bb None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:53.285259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622fa64-1cb3-465d-98e1-9083dd32da81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:53.285932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622fa64-1cb3-465d-98e1-9083dd32da81 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:53.286203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622fa64-1cb3-465d-98e1-9083dd32da81 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:53.286483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622fa64-1cb3-465d-98e1-9083dd32da81 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:53.289748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622fa64-1cb3-465d-98e1-9083dd32da81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:53.289748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622fa64-1cb3-465d-98e1-9083dd32da81 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:53.290812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 136/278] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:53.291405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622fa64-1cb3-465d-98e1-9083dd32da81 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:53.320841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4496f9-9455-46ef-b0f6-bbc9361bd050 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:53.327587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:53.359971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69a606-f725-42c6-b0c3-0813c59612cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:53.360628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69a606-f725-42c6-b0c3-0813c59612cd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:53.361006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69a606-f725-42c6-b0c3-0813c59612cd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:53.361269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69a606-f725-42c6-b0c3-0813c59612cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:53.375811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69a606-f725-42c6-b0c3-0813c59612cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-fb69a606-f725-42c6-b0c3-0813c59612cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:53.383007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:53.384080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:53.384901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 143/279] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:53.385603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69a606-f725-42c6-b0c3-0813c59612cd None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:53.407719 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622fa64-1cb3-465d-98e1-9083dd32da81 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:53.442015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b0529-9dd4-4155-8e91-f48062fc5133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:53.442662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0529-9dd4-4155-8e91-f48062fc5133 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:53.442938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0529-9dd4-4155-8e91-f48062fc5133 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:53.443203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b0529-9dd4-4155-8e91-f48062fc5133 None admin] PATH_INFO: `/v3/users/2050cc97153541d996daef4a9f63a6c1` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:53.444356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b0529-9dd4-4155-8e91-f48062fc5133 None admin] RBAC: Authorizing `identity:get_user(user_id=2050cc97153541d996daef4a9f63a6c1)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:53.445841 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b0529-9dd4-4155-8e91-f48062fc5133 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:53.447436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 137/280] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:53 2022] GET /identity/v3/users/2050cc97153541d996daef4a9f63a6c1 => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:53.448190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b0529-9dd4-4155-8e91-f48062fc5133 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:53.478034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:53.509822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69a606-f725-42c6-b0c3-0813c59612cd None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:53.545397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f560ae0-b7ff-4c7a-9fb4-72632b29162c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:53.546181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f560ae0-b7ff-4c7a-9fb4-72632b29162c None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:53.546463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f560ae0-b7ff-4c7a-9fb4-72632b29162c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:53.546732 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f560ae0-b7ff-4c7a-9fb4-72632b29162c None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:53.547412 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f560ae0-b7ff-4c7a-9fb4-72632b29162c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:53.548844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f560ae0-b7ff-4c7a-9fb4-72632b29162c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:53.553465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b0529-9dd4-4155-8e91-f48062fc5133 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:53.555082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:53.582158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 144/281] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:49:53 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:53.583152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f560ae0-b7ff-4c7a-9fb4-72632b29162c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:53.590813 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1956b4-182f-46cc-8d80-00300e05cbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:53.591456 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1956b4-182f-46cc-8d80-00300e05cbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:53.591733 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1956b4-182f-46cc-8d80-00300e05cbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:53.592004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1956b4-182f-46cc-8d80-00300e05cbb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:53.592860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1956b4-182f-46cc-8d80-00300e05cbb3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:53.593170 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1956b4-182f-46cc-8d80-00300e05cbb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:53.594645 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1956b4-182f-46cc-8d80-00300e05cbb3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:53.610156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 138/282] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:53.611353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1956b4-182f-46cc-8d80-00300e05cbb3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:53.730528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f560ae0-b7ff-4c7a-9fb4-72632b29162c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:53.759603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1956b4-182f-46cc-8d80-00300e05cbb3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:53.770328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:53.783698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a0a86-d2f3-4e2f-b49a-580a742aebd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:53.784374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a0a86-d2f3-4e2f-b49a-580a742aebd8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:53.784655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a0a86-d2f3-4e2f-b49a-580a742aebd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:53.784925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497a0a86-d2f3-4e2f-b49a-580a742aebd8 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:53.786897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a0a86-d2f3-4e2f-b49a-580a742aebd8 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:53.788361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497a0a86-d2f3-4e2f-b49a-580a742aebd8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:53.790089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 145/283] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:53 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:53.795966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a0a86-d2f3-4e2f-b49a-580a742aebd8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:53.806950 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558f9bc-3d9f-4871-8199-c2450c235cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:53.807884 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558f9bc-3d9f-4871-8199-c2450c235cfa None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:53.808346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558f9bc-3d9f-4871-8199-c2450c235cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:53.809961 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2558f9bc-3d9f-4871-8199-c2450c235cfa None admin] PATH_INFO: `/v3/users/3d3160faded94a088345a81fa6bd29a3` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:53.824434 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558f9bc-3d9f-4871-8199-c2450c235cfa None admin] RBAC: Authorizing `identity:get_user(user_id=3d3160faded94a088345a81fa6bd29a3)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:53.826001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2558f9bc-3d9f-4871-8199-c2450c235cfa None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:53.828011 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 139/284] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:53 2022] GET /identity/v3/users/3d3160faded94a088345a81fa6bd29a3 => generated 293 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:53.834670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558f9bc-3d9f-4871-8199-c2450c235cfa None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:53.870572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:53.925070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497a0a86-d2f3-4e2f-b49a-580a742aebd8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:53.961979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2558f9bc-3d9f-4871-8199-c2450c235cfa None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:53.969260 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bead5001-16f1-4047-9bb8-2533503b1311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:53.969260 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead5001-16f1-4047-9bb8-2533503b1311 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:53.969639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead5001-16f1-4047-9bb8-2533503b1311 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:53.969862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bead5001-16f1-4047-9bb8-2533503b1311 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d/users/2050cc97153541d996daef4a9f63a6c1/roles/fce6359ef8b8407a9887ee97701093a8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:53.973087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead5001-16f1-4047-9bb8-2533503b1311 None admin] RBAC: Authorizing `identity:create_grant(project_id=50a4f8b5734d4771ab600161af000c0d, user_id=2050cc97153541d996daef4a9f63a6c1, role_id=fce6359ef8b8407a9887ee97701093a8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:53.975541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bead5001-16f1-4047-9bb8-2533503b1311 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:53.993786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 146/285] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:49:53 2022] PUT /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d/users/2050cc97153541d996daef4a9f63a6c1/roles/fce6359ef8b8407a9887ee97701093a8 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 11:49:54.009564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d331ad-989c-40ae-b242-39961bbf7e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:54.010251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d331ad-989c-40ae-b242-39961bbf7e54 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:54.010612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d331ad-989c-40ae-b242-39961bbf7e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:54.010883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d331ad-989c-40ae-b242-39961bbf7e54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:54.011688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d331ad-989c-40ae-b242-39961bbf7e54 None admin] RBAC: Adding query filter params (role.id=251e50fd870c48f3a02b69587144b7bf, user.id=3d3160faded94a088345a81fa6bd29a3, scope.system=all) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:54.011994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d331ad-989c-40ae-b242-39961bbf7e54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:54.013536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d331ad-989c-40ae-b242-39961bbf7e54 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:54.020573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 140/286] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Aug 1 11:49:53 2022] GET /identity/v3/role_assignments?user.id=3d3160faded94a088345a81fa6bd29a3&scope.system=all&role.id=251e50fd870c48f3a02b69587144b7bf => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:54.324079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528a8c0-87f6-4383-80b8-c77890f3a289 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:54.324393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528a8c0-87f6-4383-80b8-c77890f3a289 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:54.324643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c528a8c0-87f6-4383-80b8-c77890f3a289 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:54.326286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 147/287] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:54.331147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c918fad-4972-497e-8c2a-10a1f0b9e555 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:54.331432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c918fad-4972-497e-8c2a-10a1f0b9e555 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:54.331703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c918fad-4972-497e-8c2a-10a1f0b9e555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:54.354973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9c918fad-4972-497e-8c2a-10a1f0b9e555 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:54.356174 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9c918fad-4972-497e-8c2a-10a1f0b9e555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:54.445601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 141/288] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:54.469588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528a8c0-87f6-4383-80b8-c77890f3a289 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:54.550284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:54.618998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c528a8c0-87f6-4383-80b8-c77890f3a289 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:54.659971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bf4bc-4457-4e3e-9a00-26a494043b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:54.660659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bf4bc-4457-4e3e-9a00-26a494043b89 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:54.660937 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bf4bc-4457-4e3e-9a00-26a494043b89 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:54.661205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476bf4bc-4457-4e3e-9a00-26a494043b89 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:54.674978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476bf4bc-4457-4e3e-9a00-26a494043b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-476bf4bc-4457-4e3e-9a00-26a494043b89 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:54.680413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:54.681323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:54.682133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 148/289] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:54.690919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c918fad-4972-497e-8c2a-10a1f0b9e555 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:54.729308 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:54.849004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c918fad-4972-497e-8c2a-10a1f0b9e555 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:54.895170 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3b3d1-3fec-4245-8374-ced3a79aa1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:54.895718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3b3d1-3fec-4245-8374-ced3a79aa1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:54.895997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3b3d1-3fec-4245-8374-ced3a79aa1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:54.896272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae3b3d1-3fec-4245-8374-ced3a79aa1b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:54.896993 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3b3d1-3fec-4245-8374-ced3a79aa1b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:54.897322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3b3d1-3fec-4245-8374-ced3a79aa1b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:54.898721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae3b3d1-3fec-4245-8374-ced3a79aa1b2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:54.912856 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 142/290] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:54.918557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bf4bc-4457-4e3e-9a00-26a494043b89 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:55.070883 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476bf4bc-4457-4e3e-9a00-26a494043b89 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:55.086763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:55.116724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ea40b-a232-4da3-8696-e156299d93ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:55.117704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ea40b-a232-4da3-8696-e156299d93ad None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:55.118129 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ea40b-a232-4da3-8696-e156299d93ad None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:55.118609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ea40b-a232-4da3-8696-e156299d93ad None admin] PATH_INFO: `/v3/users/315e459a707d4df8a2dfa39e9fc6856a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:55.120369 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ea40b-a232-4da3-8696-e156299d93ad None admin] RBAC: Authorizing `identity:get_user(user_id=315e459a707d4df8a2dfa39e9fc6856a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:55.122726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ea40b-a232-4da3-8696-e156299d93ad None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:55.125379 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 149/291] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:54 2022] GET /identity/v3/users/315e459a707d4df8a2dfa39e9fc6856a => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:55.133156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3b3d1-3fec-4245-8374-ced3a79aa1b2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:55.226000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:55.239282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae3b3d1-3fec-4245-8374-ced3a79aa1b2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:55.273219 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f594688-db39-4af9-a4a8-3760c97b4ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:55.273865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f594688-db39-4af9-a4a8-3760c97b4ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:55.274147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f594688-db39-4af9-a4a8-3760c97b4ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:55.274417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f594688-db39-4af9-a4a8-3760c97b4ca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:55.343372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f594688-db39-4af9-a4a8-3760c97b4ca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:55.344906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f594688-db39-4af9-a4a8-3760c97b4ca9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:55.432621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:55.461472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 143/292] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:55.465554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ea40b-a232-4da3-8696-e156299d93ad None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:55.571134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ea40b-a232-4da3-8696-e156299d93ad None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:55.606389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009ad34c-4609-4689-a41b-bee7f2f98c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:55.607068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ad34c-4609-4689-a41b-bee7f2f98c78 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:55.607300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ad34c-4609-4689-a41b-bee7f2f98c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:55.607578 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009ad34c-4609-4689-a41b-bee7f2f98c78 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:55.608746 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ad34c-4609-4689-a41b-bee7f2f98c78 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:55.610247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009ad34c-4609-4689-a41b-bee7f2f98c78 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:55.616173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 150/293] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:55 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:55.618293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f594688-db39-4af9-a4a8-3760c97b4ca9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:55.719309 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f594688-db39-4af9-a4a8-3760c97b4ca9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:55.754614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30f9bb9-aa5d-4903-b4b2-a44f9cd464d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:55.755233 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f9bb9-aa5d-4903-b4b2-a44f9cd464d5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:55.755512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f9bb9-aa5d-4903-b4b2-a44f9cd464d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:55.755785 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30f9bb9-aa5d-4903-b4b2-a44f9cd464d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:55.756575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f9bb9-aa5d-4903-b4b2-a44f9cd464d5 None admin] RBAC: Adding query filter params (role.id=251e50fd870c48f3a02b69587144b7bf, scope.project.id=50a4f8b5734d4771ab600161af000c0d, user.id=315e459a707d4df8a2dfa39e9fc6856a) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:55.756881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f9bb9-aa5d-4903-b4b2-a44f9cd464d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:55.758418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30f9bb9-aa5d-4903-b4b2-a44f9cd464d5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:55.767449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 144/294] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:55 2022] GET /identity/v3/role_assignments?user.id=315e459a707d4df8a2dfa39e9fc6856a&scope.project.id=50a4f8b5734d4771ab600161af000c0d&role.id=251e50fd870c48f3a02b69587144b7bf => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:56.031966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465095-7eb5-4e17-a5b0-054ee5785f89 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:56.032341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465095-7eb5-4e17-a5b0-054ee5785f89 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:56.032527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb465095-7eb5-4e17-a5b0-054ee5785f89 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:56.034642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 151/295] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:56.039930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ccc9-5118-403a-81fb-57929d8328e5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:56.040798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ccc9-5118-403a-81fb-57929d8328e5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:56.041264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b7ccc9-5118-403a-81fb-57929d8328e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:56.060840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f5b7ccc9-5118-403a-81fb-57929d8328e5 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:56.062420 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f5b7ccc9-5118-403a-81fb-57929d8328e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:56.100412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:56.136624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 145/296] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:56.158609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb465095-7eb5-4e17-a5b0-054ee5785f89 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:56.226662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:56.289725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb465095-7eb5-4e17-a5b0-054ee5785f89 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:56.332378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2002712-ede2-4c43-a53f-bd3dad416744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:56.333079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002712-ede2-4c43-a53f-bd3dad416744 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:56.333440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002712-ede2-4c43-a53f-bd3dad416744 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:56.333719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2002712-ede2-4c43-a53f-bd3dad416744 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:56.344988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2002712-ede2-4c43-a53f-bd3dad416744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b2002712-ede2-4c43-a53f-bd3dad416744 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:56.350973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:56.351820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:56.352607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 152/297] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:56.358327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ccc9-5118-403a-81fb-57929d8328e5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:56.463358 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b7ccc9-5118-403a-81fb-57929d8328e5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:56.498784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a89894-c37b-44a0-a6c3-e093af765928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:56.499402 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a89894-c37b-44a0-a6c3-e093af765928 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:56.499678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a89894-c37b-44a0-a6c3-e093af765928 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:56.499947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a89894-c37b-44a0-a6c3-e093af765928 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:56.500658 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a89894-c37b-44a0-a6c3-e093af765928 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:56.500958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a89894-c37b-44a0-a6c3-e093af765928 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:56.502368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a89894-c37b-44a0-a6c3-e093af765928 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:56.511239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 146/298] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:56.516671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b759a4-78c9-4256-8a9b-f9a31c8757a5 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:56.517023 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b759a4-78c9-4256-8a9b-f9a31c8757a5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:56.517432 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b759a4-78c9-4256-8a9b-f9a31c8757a5 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:56.519253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a89894-c37b-44a0-a6c3-e093af765928 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:56.519415 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 153/299] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:56.520467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b8539-36fe-40e0-966e-ae500d411ba3 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:56.520748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b8539-36fe-40e0-966e-ae500d411ba3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:56.521018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b8539-36fe-40e0-966e-ae500d411ba3 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:56.525964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 154/300] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:56.527061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41adc6-52f8-474d-a149-4e6ce68a5ad9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:56.527340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41adc6-52f8-474d-a149-4e6ce68a5ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:56.527611 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41adc6-52f8-474d-a149-4e6ce68a5ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:56.549071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1c41adc6-52f8-474d-a149-4e6ce68a5ad9 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:56.550243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1c41adc6-52f8-474d-a149-4e6ce68a5ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:56.556919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:56.629063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a89894-c37b-44a0-a6c3-e093af765928 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:56.629247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 155/301] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:56.637139 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8901c50-949c-414a-9269-a673d3010860 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:56.637690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8901c50-949c-414a-9269-a673d3010860 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:56.638634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8901c50-949c-414a-9269-a673d3010860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:56.660308 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c8901c50-949c-414a-9269-a673d3010860 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:56.661686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c8901c50-949c-414a-9269-a673d3010860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:56.665057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e4aa1-f620-4196-b5f4-2cf46d953713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:56.665057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e4aa1-f620-4196-b5f4-2cf46d953713 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:56.665407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e4aa1-f620-4196-b5f4-2cf46d953713 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:56.665625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8e4aa1-f620-4196-b5f4-2cf46d953713 None admin] PATH_INFO: `/v3/users/d21fcc161933463a800bc3a5855f3621` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:56.679330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e4aa1-f620-4196-b5f4-2cf46d953713 None admin] RBAC: Authorizing `identity:get_user(user_id=d21fcc161933463a800bc3a5855f3621)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:56.680774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8e4aa1-f620-4196-b5f4-2cf46d953713 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:56.682608 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 147/302] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:56 2022] GET /identity/v3/users/d21fcc161933463a800bc3a5855f3621 => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:56.683186 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e4aa1-f620-4196-b5f4-2cf46d953713 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:56.702543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:56.738688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 156/303] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:56.739367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8901c50-949c-414a-9269-a673d3010860 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:56.795338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:56.805393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8e4aa1-f620-4196-b5f4-2cf46d953713 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:56.842730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd2bff-756e-45f0-a1e5-9ba5f533d4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:56.843376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd2bff-756e-45f0-a1e5-9ba5f533d4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:56.843650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd2bff-756e-45f0-a1e5-9ba5f533d4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:56.843920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd2bff-756e-45f0-a1e5-9ba5f533d4c0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:56.853101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8901c50-949c-414a-9269-a673d3010860 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:56.854572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd2bff-756e-45f0-a1e5-9ba5f533d4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-e7dd2bff-756e-45f0-a1e5-9ba5f533d4c0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:56.859498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:56.860387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:56.861180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 148/304] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:56.866082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd2bff-756e-45f0-a1e5-9ba5f533d4c0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:56.889855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e506ca-0b28-4e4b-937d-3fb843502c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:56.890474 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e506ca-0b28-4e4b-937d-3fb843502c7c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:56.890754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e506ca-0b28-4e4b-937d-3fb843502c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:56.891024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e506ca-0b28-4e4b-937d-3fb843502c7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:56.891812 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e506ca-0b28-4e4b-937d-3fb843502c7c None admin] RBAC: Adding query filter params (role.id=fce6359ef8b8407a9887ee97701093a8, user.id=d21fcc161933463a800bc3a5855f3621, scope.system=all) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:56.892120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e506ca-0b28-4e4b-937d-3fb843502c7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:56.894153 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e506ca-0b28-4e4b-937d-3fb843502c7c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:56.899125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 157/305] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Aug 1 11:49:56 2022] GET /identity/v3/role_assignments?user.id=d21fcc161933463a800bc3a5855f3621&scope.system=all&role.id=fce6359ef8b8407a9887ee97701093a8 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:56.899888 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e506ca-0b28-4e4b-937d-3fb843502c7c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:56.938261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:56.995403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd2bff-756e-45f0-a1e5-9ba5f533d4c0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:57.012054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e506ca-0b28-4e4b-937d-3fb843502c7c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:57.037593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895c38b4-eb84-4799-a797-ebbaee55eb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:57.038336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c38b4-eb84-4799-a797-ebbaee55eb79 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:57.038578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c38b4-eb84-4799-a797-ebbaee55eb79 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:57.038806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895c38b4-eb84-4799-a797-ebbaee55eb79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:57.040011 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c38b4-eb84-4799-a797-ebbaee55eb79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:57.041497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895c38b4-eb84-4799-a797-ebbaee55eb79 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:57.043460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 149/306] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:57.044701 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2b6c9-fb76-47b6-9429-1906c99d7f2e None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:57.044987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2b6c9-fb76-47b6-9429-1906c99d7f2e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:57.045258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba2b6c9-fb76-47b6-9429-1906c99d7f2e None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:57.046494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 150/307] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:57.050662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2b6c9-fb76-47b6-9429-1906c99d7f2e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:57.057428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caccf429-7719-4c08-a08a-4291ddd64547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:57.058280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf429-7719-4c08-a08a-4291ddd64547 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:57.058814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf429-7719-4c08-a08a-4291ddd64547 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:57.059279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccf429-7719-4c08-a08a-4291ddd64547 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:57.060082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccf429-7719-4c08-a08a-4291ddd64547 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:57.060391 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccf429-7719-4c08-a08a-4291ddd64547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:57.061869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caccf429-7719-4c08-a08a-4291ddd64547 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:57.072248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 158/308] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:57.074514 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76dad0-ebfc-4e3b-a0fb-a6c936347479 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:57.075023 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76dad0-ebfc-4e3b-a0fb-a6c936347479 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:57.075512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76dad0-ebfc-4e3b-a0fb-a6c936347479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:57.079331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:57.094536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7d76dad0-ebfc-4e3b-a0fb-a6c936347479 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:57.095731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7d76dad0-ebfc-4e3b-a0fb-a6c936347479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:57.167658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 159/309] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:57.168514 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76dad0-ebfc-4e3b-a0fb-a6c936347479 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:57.177979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba2b6c9-fb76-47b6-9429-1906c99d7f2e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:57.196166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:57.218289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3bbb6-ed4b-4569-b1b7-058913c1628a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:57.219100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3bbb6-ed4b-4569-b1b7-058913c1628a None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:57.219402 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3bbb6-ed4b-4569-b1b7-058913c1628a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:57.219710 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3bbb6-ed4b-4569-b1b7-058913c1628a None admin] PATH_INFO: `/v3/groups` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:57.220375 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3bbb6-ed4b-4569-b1b7-058913c1628a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:57.222481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3bbb6-ed4b-4569-b1b7-058913c1628a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:57.239283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 151/310] 10.222.0.42 () {60 vars in 1134 bytes} [Mon Aug 1 11:49:57 2022] POST /identity/v3/groups => generated 229 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:57.246839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3bbb6-ed4b-4569-b1b7-058913c1628a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:57.284972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76dad0-ebfc-4e3b-a0fb-a6c936347479 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:57.339830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629dd36-7caf-48de-a401-4246f08a5623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:57.340955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629dd36-7caf-48de-a401-4246f08a5623 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:57.341483 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629dd36-7caf-48de-a401-4246f08a5623 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:57.341955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629dd36-7caf-48de-a401-4246f08a5623 None admin] PATH_INFO: `/v3/users/3d3160faded94a088345a81fa6bd29a3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:57.343421 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629dd36-7caf-48de-a401-4246f08a5623 None admin] RBAC: Authorizing `identity:get_user(user_id=3d3160faded94a088345a81fa6bd29a3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:57.345406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629dd36-7caf-48de-a401-4246f08a5623 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:57.348086 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 160/311] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:57 2022] GET /identity/v3/users/3d3160faded94a088345a81fa6bd29a3 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:57.355587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629dd36-7caf-48de-a401-4246f08a5623 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:57.367848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:57.397369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3bbb6-ed4b-4569-b1b7-058913c1628a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:57.443577 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd8679-57eb-4728-b316-f9e3a8ac453e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:57.444231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd8679-57eb-4728-b316-f9e3a8ac453e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:57.444513 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd8679-57eb-4728-b316-f9e3a8ac453e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:57.444797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dd8679-57eb-4728-b316-f9e3a8ac453e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:57.456767 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90dd8679-57eb-4728-b316-f9e3a8ac453e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-90dd8679-57eb-4728-b316-f9e3a8ac453e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:57.464771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:57.465758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:57.466573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:57.466573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:57.466573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:57.466573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:57.466573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:57.466573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:57.466573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:57.466573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:57.466573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:57.466573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:57.466573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:57.466573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:49:57.467169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 152/312] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:57.473797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd8679-57eb-4728-b316-f9e3a8ac453e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:57.477080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:57.485214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629dd36-7caf-48de-a401-4246f08a5623 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:57.532137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e312abf-f897-419c-8c04-a7717290ff6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:57.532942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e312abf-f897-419c-8c04-a7717290ff6f None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:57.533223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e312abf-f897-419c-8c04-a7717290ff6f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:57.533597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e312abf-f897-419c-8c04-a7717290ff6f None admin] PATH_INFO: `/v3/system/users/3d3160faded94a088345a81fa6bd29a3/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:57.536365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e312abf-f897-419c-8c04-a7717290ff6f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3d3160faded94a088345a81fa6bd29a3, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:57.537979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e312abf-f897-419c-8c04-a7717290ff6f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:57.550353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 161/313] 10.222.0.42 () {58 vars in 1334 bytes} [Mon Aug 1 11:49:57 2022] PUT /identity/v3/system/users/3d3160faded94a088345a81fa6bd29a3/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 11:49:57.602808 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90dd8679-57eb-4728-b316-f9e3a8ac453e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:57.640793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1905189-f15b-4f1e-8323-ed2fb4926f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:57.641519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1905189-f15b-4f1e-8323-ed2fb4926f6f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:57.641798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1905189-f15b-4f1e-8323-ed2fb4926f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:57.642123 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1905189-f15b-4f1e-8323-ed2fb4926f6f None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:57.642869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1905189-f15b-4f1e-8323-ed2fb4926f6f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:57.643219 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1905189-f15b-4f1e-8323-ed2fb4926f6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:57.645376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1905189-f15b-4f1e-8323-ed2fb4926f6f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:57.655651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 153/314] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:57.660978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e312abf-f897-419c-8c04-a7717290ff6f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:57.775437 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e312abf-f897-419c-8c04-a7717290ff6f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:57.811575 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c156a4-9de7-4974-8a54-aae08032134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:57.812529 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c156a4-9de7-4974-8a54-aae08032134b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:57.812984 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c156a4-9de7-4974-8a54-aae08032134b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:57.813458 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c156a4-9de7-4974-8a54-aae08032134b None admin] PATH_INFO: `/v3/users/2050cc97153541d996daef4a9f63a6c1` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:57.814886 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c156a4-9de7-4974-8a54-aae08032134b None admin] RBAC: Authorizing `identity:get_user(user_id=2050cc97153541d996daef4a9f63a6c1)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:57.816597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c156a4-9de7-4974-8a54-aae08032134b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:57.818689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 162/315] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:57 2022] GET /identity/v3/users/2050cc97153541d996daef4a9f63a6c1 => generated 297 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:57.826352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1905189-f15b-4f1e-8323-ed2fb4926f6f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:57.829501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:57.937856 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1905189-f15b-4f1e-8323-ed2fb4926f6f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:57.974290 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c058e-20f2-4786-bed2-572c79abe21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:57.975238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c058e-20f2-4786-bed2-572c79abe21f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:57.975694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c058e-20f2-4786-bed2-572c79abe21f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:57.976381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c058e-20f2-4786-bed2-572c79abe21f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:58.048855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c058e-20f2-4786-bed2-572c79abe21f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:58.051612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c058e-20f2-4786-bed2-572c79abe21f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:58.093654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:58.154939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 154/316] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:49:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:49:58.161272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c156a4-9de7-4974-8a54-aae08032134b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:58.192802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:58.265335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c156a4-9de7-4974-8a54-aae08032134b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:58.310768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e3b36-6e20-4290-8af2-4e259533a2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:58.311426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e3b36-6e20-4290-8af2-4e259533a2fb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:58.311712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e3b36-6e20-4290-8af2-4e259533a2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:58.311992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e3b36-6e20-4290-8af2-4e259533a2fb None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:58.313170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e3b36-6e20-4290-8af2-4e259533a2fb None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:58.314690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e3b36-6e20-4290-8af2-4e259533a2fb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:58.316626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 163/317] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:49:58 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:58.322692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c058e-20f2-4786-bed2-572c79abe21f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:58.428734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c058e-20f2-4786-bed2-572c79abe21f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:58.430325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:58.467833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37c8688-fec6-480d-ab0c-c8251e083f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:58.468388 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c8688-fec6-480d-ab0c-c8251e083f2b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:58.468671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c8688-fec6-480d-ab0c-c8251e083f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:58.468947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37c8688-fec6-480d-ab0c-c8251e083f2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:58.469803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c8688-fec6-480d-ab0c-c8251e083f2b None admin] RBAC: Adding query filter params (role.id=fce6359ef8b8407a9887ee97701093a8, scope.project.id=50a4f8b5734d4771ab600161af000c0d, user.id=2050cc97153541d996daef4a9f63a6c1) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:58.470117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c8688-fec6-480d-ab0c-c8251e083f2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:58.472135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37c8688-fec6-480d-ab0c-c8251e083f2b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:58.479908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 155/318] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:49:58 2022] GET /identity/v3/role_assignments?user.id=2050cc97153541d996daef4a9f63a6c1&scope.project.id=50a4f8b5734d4771ab600161af000c0d&role.id=fce6359ef8b8407a9887ee97701093a8 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:49:58.972224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb74713-195e-4617-a634-96548c6b0eae None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:58.972592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb74713-195e-4617-a634-96548c6b0eae None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:58.972773 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb74713-195e-4617-a634-96548c6b0eae None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:58.974304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 164/319] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:58.979612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947493a-eb06-4ed8-9013-816aef9359da None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:58.979907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947493a-eb06-4ed8-9013-816aef9359da None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:58.980185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947493a-eb06-4ed8-9013-816aef9359da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:58.998796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a947493a-eb06-4ed8-9013-816aef9359da None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:58.999987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a947493a-eb06-4ed8-9013-816aef9359da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:59.069677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 156/320] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:59.091593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb74713-195e-4617-a634-96548c6b0eae None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:59.189012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:59.198077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb74713-195e-4617-a634-96548c6b0eae None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:59.232791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b81309-75ed-4e5e-98d5-dc239a707260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:59.233363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b81309-75ed-4e5e-98d5-dc239a707260 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:59.233646 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b81309-75ed-4e5e-98d5-dc239a707260 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:59.233915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b81309-75ed-4e5e-98d5-dc239a707260 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:59.244657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b81309-75ed-4e5e-98d5-dc239a707260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-23b81309-75ed-4e5e-98d5-dc239a707260 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:49:59.250065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:49:59.250926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:49:59.256438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 165/321] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:49:59.258531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947493a-eb06-4ed8-9013-816aef9359da None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:59.359971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:59.366666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947493a-eb06-4ed8-9013-816aef9359da None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:59.391512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2621bf-f67d-49c0-b8de-a9ed69387268 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:59.391804 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2621bf-f67d-49c0-b8de-a9ed69387268 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:59.392066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2621bf-f67d-49c0-b8de-a9ed69387268 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:59.393959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 166/322] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:59.398593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47573a-1038-4ccf-b949-18fc0ed775b9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:59.398877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47573a-1038-4ccf-b949-18fc0ed775b9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:59.399150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe47573a-1038-4ccf-b949-18fc0ed775b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:59.401840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeb242-be61-4f78-9f44-5ef6feb14b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:59.402466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeb242-be61-4f78-9f44-5ef6feb14b43 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:59.402744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeb242-be61-4f78-9f44-5ef6feb14b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:59.403014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafeb242-be61-4f78-9f44-5ef6feb14b43 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:59.403738 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeb242-be61-4f78-9f44-5ef6feb14b43 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:49:59.404021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeb242-be61-4f78-9f44-5ef6feb14b43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:59.405814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafeb242-be61-4f78-9f44-5ef6feb14b43 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:59.416933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 157/323] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:49:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:59.417767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fe47573a-1038-4ccf-b949-18fc0ed775b9 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:59.418959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fe47573a-1038-4ccf-b949-18fc0ed775b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:59.421597 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeb242-be61-4f78-9f44-5ef6feb14b43 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:59.492458 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 167/324] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:49:59.514472 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47573a-1038-4ccf-b949-18fc0ed775b9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:59.525722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafeb242-be61-4f78-9f44-5ef6feb14b43 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:59.561783 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca8bda-d48f-41f6-9554-7a4a63b292d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:59.562440 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca8bda-d48f-41f6-9554-7a4a63b292d0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:59.562780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca8bda-d48f-41f6-9554-7a4a63b292d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:59.563061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca8bda-d48f-41f6-9554-7a4a63b292d0 None admin] PATH_INFO: `/v3/users/d21fcc161933463a800bc3a5855f3621` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:59.564341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca8bda-d48f-41f6-9554-7a4a63b292d0 None admin] RBAC: Authorizing `identity:get_user(user_id=d21fcc161933463a800bc3a5855f3621)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:59.565871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca8bda-d48f-41f6-9554-7a4a63b292d0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:59.567498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 158/325] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:49:59 2022] GET /identity/v3/users/d21fcc161933463a800bc3a5855f3621 => generated 293 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:59.573168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca8bda-d48f-41f6-9554-7a4a63b292d0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:59.605535 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:59.611727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:59.627603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe47573a-1038-4ccf-b949-18fc0ed775b9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:59.661606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247b9c5f-8f13-4c9b-9a0f-e28ec9fe0c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:59.662239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b9c5f-8f13-4c9b-9a0f-e28ec9fe0c06 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:59.662515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b9c5f-8f13-4c9b-9a0f-e28ec9fe0c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:59.662789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247b9c5f-8f13-4c9b-9a0f-e28ec9fe0c06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:59.663922 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b9c5f-8f13-4c9b-9a0f-e28ec9fe0c06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:59.665418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247b9c5f-8f13-4c9b-9a0f-e28ec9fe0c06 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:59.666989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 168/326] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:49:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:49:59.668099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b53e94-3330-4bed-b8aa-b159b546134f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:59.668377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b53e94-3330-4bed-b8aa-b159b546134f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:59.668641 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b53e94-3330-4bed-b8aa-b159b546134f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:59.669875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 169/327] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:49:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:49:59.672276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b53e94-3330-4bed-b8aa-b159b546134f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:59.678962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca8bda-d48f-41f6-9554-7a4a63b292d0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:59.712441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678fce2b-aa05-4293-b335-fa8af4d468bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:59.713098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fce2b-aa05-4293-b335-fa8af4d468bb None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:59.713413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fce2b-aa05-4293-b335-fa8af4d468bb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:59.713686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678fce2b-aa05-4293-b335-fa8af4d468bb None admin] PATH_INFO: `/v3/system/users/d21fcc161933463a800bc3a5855f3621/roles/fce6359ef8b8407a9887ee97701093a8` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:59.715122 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fce2b-aa05-4293-b335-fa8af4d468bb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d21fcc161933463a800bc3a5855f3621, role_id=fce6359ef8b8407a9887ee97701093a8)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:59.716488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678fce2b-aa05-4293-b335-fa8af4d468bb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:59.724775 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 159/328] 10.222.0.42 () {58 vars in 1334 bytes} [Mon Aug 1 11:49:59 2022] PUT /identity/v3/system/users/d21fcc161933463a800bc3a5855f3621/roles/fce6359ef8b8407a9887ee97701093a8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 11:49:59.726357 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833bc71-4165-47a3-b2eb-a434d2cca2f5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:59.726644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833bc71-4165-47a3-b2eb-a434d2cca2f5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:59.726909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3833bc71-4165-47a3-b2eb-a434d2cca2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:59.745534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3833bc71-4165-47a3-b2eb-a434d2cca2f5 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:49:59.746775 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3833bc71-4165-47a3-b2eb-a434d2cca2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:49:59.787976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b53e94-3330-4bed-b8aa-b159b546134f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:49:59.827046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cf8f7-8aac-4fdd-8336-98057ce24961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:49:59.827674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cf8f7-8aac-4fdd-8336-98057ce24961 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:49:59.827952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cf8f7-8aac-4fdd-8336-98057ce24961 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:49:59.828284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cf8f7-8aac-4fdd-8336-98057ce24961 None admin] PATH_INFO: `/v3/groups` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:49:59.837546 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cf8f7-8aac-4fdd-8336-98057ce24961 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:49:59.837746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 160/329] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:49:59.837838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cf8f7-8aac-4fdd-8336-98057ce24961 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:49:59.851412 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 170/330] 10.222.0.42 () {60 vars in 1134 bytes} [Mon Aug 1 11:49:59 2022] POST /identity/v3/groups => generated 226 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:49:59.854939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833bc71-4165-47a3-b2eb-a434d2cca2f5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:49:59.880352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:49:59.969826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3833bc71-4165-47a3-b2eb-a434d2cca2f5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:00.007129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80c8d9-ef2a-4683-808b-832bf9968bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:00.008332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80c8d9-ef2a-4683-808b-832bf9968bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:00.008332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80c8d9-ef2a-4683-808b-832bf9968bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:00.008332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af80c8d9-ef2a-4683-808b-832bf9968bd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:00.021211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af80c8d9-ef2a-4683-808b-832bf9968bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-af80c8d9-ef2a-4683-808b-832bf9968bd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:00.026257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:00.027300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:00.028296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 161/331] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:49:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:00.035011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cf8f7-8aac-4fdd-8336-98057ce24961 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:00.051464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:00.147001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cf8f7-8aac-4fdd-8336-98057ce24961 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:00.182582 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eb2fe-8396-45af-b1cc-7335db235124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:00.183206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eb2fe-8396-45af-b1cc-7335db235124 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:00.183489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eb2fe-8396-45af-b1cc-7335db235124 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:00.183761 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eb2fe-8396-45af-b1cc-7335db235124 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:00.184490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eb2fe-8396-45af-b1cc-7335db235124 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:00.184796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eb2fe-8396-45af-b1cc-7335db235124 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:00.186235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eb2fe-8396-45af-b1cc-7335db235124 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:00.195998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 171/332] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:50:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:00.201592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80c8d9-ef2a-4683-808b-832bf9968bd8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:00.288529 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:00.311496 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af80c8d9-ef2a-4683-808b-832bf9968bd8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:00.349825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ace35b3-e274-4d2c-855c-3ea5181b7019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:00.350480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace35b3-e274-4d2c-855c-3ea5181b7019 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:00.351007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace35b3-e274-4d2c-855c-3ea5181b7019 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:00.351293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ace35b3-e274-4d2c-855c-3ea5181b7019 None admin] PATH_INFO: `/v3/users/3d3160faded94a088345a81fa6bd29a3` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:00.352486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace35b3-e274-4d2c-855c-3ea5181b7019 None admin] RBAC: Authorizing `identity:get_user(user_id=3d3160faded94a088345a81fa6bd29a3)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:00.353982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ace35b3-e274-4d2c-855c-3ea5181b7019 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:00.355895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 162/333] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:50:00 2022] GET /identity/v3/users/3d3160faded94a088345a81fa6bd29a3 => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:00.366401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eb2fe-8396-45af-b1cc-7335db235124 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:00.455039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:00.483553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eb2fe-8396-45af-b1cc-7335db235124 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:00.520179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40845a83-fb63-4127-adb0-925de45fba27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:00.520810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40845a83-fb63-4127-adb0-925de45fba27 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:00.521085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40845a83-fb63-4127-adb0-925de45fba27 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:00.521374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40845a83-fb63-4127-adb0-925de45fba27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:00.522164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40845a83-fb63-4127-adb0-925de45fba27 None admin] RBAC: Adding query filter params (role.id=251e50fd870c48f3a02b69587144b7bf, user.id=3d3160faded94a088345a81fa6bd29a3, scope.system=all) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:00.522470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40845a83-fb63-4127-adb0-925de45fba27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:00.523997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40845a83-fb63-4127-adb0-925de45fba27 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:00.537738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 172/334] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Aug 1 11:50:00 2022] GET /identity/v3/role_assignments?user.id=3d3160faded94a088345a81fa6bd29a3&scope.system=all&role.id=251e50fd870c48f3a02b69587144b7bf => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:02.043355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdb796-c660-461e-a17b-9dc92dee46b1 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:02.043855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdb796-c660-461e-a17b-9dc92dee46b1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:02.043930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bdb796-c660-461e-a17b-9dc92dee46b1 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:02.045551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 163/335] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:02.052993 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d055ed7-4fe4-4cce-8a9e-af357fae67eb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:02.053564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d055ed7-4fe4-4cce-8a9e-af357fae67eb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:02.053564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d055ed7-4fe4-4cce-8a9e-af357fae67eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:02.081139 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8d055ed7-4fe4-4cce-8a9e-af357fae67eb None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:02.083246 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8d055ed7-4fe4-4cce-8a9e-af357fae67eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:02.152547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57a35e-e96a-4fa7-8cd2-0c930e5c0122 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:02.153053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57a35e-e96a-4fa7-8cd2-0c930e5c0122 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:02.153550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57a35e-e96a-4fa7-8cd2-0c930e5c0122 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:02.156312 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 164/336] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:02.162163 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3543d-b98f-451a-956f-ac484ee12f66 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:02.162519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3543d-b98f-451a-956f-ac484ee12f66 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:02.162766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d3543d-b98f-451a-956f-ac484ee12f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:02.178855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 173/337] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:50:02.208102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-95d3543d-b98f-451a-956f-ac484ee12f66 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:02.209408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-95d3543d-b98f-451a-956f-ac484ee12f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:02.210755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d055ed7-4fe4-4cce-8a9e-af357fae67eb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:02.285776 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:02.328974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d055ed7-4fe4-4cce-8a9e-af357fae67eb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:02.365584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 165/338] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:50:02.366993 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255895a-7c5f-4f68-948d-ac072d6e1def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:02.367703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255895a-7c5f-4f68-948d-ac072d6e1def None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:02.367986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255895a-7c5f-4f68-948d-ac072d6e1def None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:02.368259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1255895a-7c5f-4f68-948d-ac072d6e1def None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:02.379552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1255895a-7c5f-4f68-948d-ac072d6e1def None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-1255895a-7c5f-4f68-948d-ac072d6e1def None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:02.384564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:02.386753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:02.388647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 174/339] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:02.393966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3543d-b98f-451a-956f-ac484ee12f66 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:02.413399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255895a-7c5f-4f68-948d-ac072d6e1def None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:02.558912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:02.604658 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d3543d-b98f-451a-956f-ac484ee12f66 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:02.631506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1255895a-7c5f-4f68-948d-ac072d6e1def None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:02.679329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27803fb7-40f5-4d62-be40-ca6ac929427c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:02.680228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27803fb7-40f5-4d62-be40-ca6ac929427c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:02.680696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27803fb7-40f5-4d62-be40-ca6ac929427c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:02.681008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27803fb7-40f5-4d62-be40-ca6ac929427c None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:02.681766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27803fb7-40f5-4d62-be40-ca6ac929427c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:02.682141 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27803fb7-40f5-4d62-be40-ca6ac929427c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:02.683949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27803fb7-40f5-4d62-be40-ca6ac929427c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:02.694265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 166/340] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:50:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:02.695508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8780c-5808-4e8d-a854-edab6b4833ee None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:02.695792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8780c-5808-4e8d-a854-edab6b4833ee None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:02.696063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe8780c-5808-4e8d-a854-edab6b4833ee None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:02.698804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 167/341] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:02.702133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8780c-5808-4e8d-a854-edab6b4833ee None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:02.702249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:02.719231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a0d105-7f66-4be4-a095-dd787fd1bbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:02.719878 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d105-7f66-4be4-a095-dd787fd1bbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:02.720159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d105-7f66-4be4-a095-dd787fd1bbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:02.720428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a0d105-7f66-4be4-a095-dd787fd1bbb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:02.740724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a0d105-7f66-4be4-a095-dd787fd1bbb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d9a0d105-7f66-4be4-a095-dd787fd1bbb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:02.745782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:02.746629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:02.747423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:02.747423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:02.747423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:02.747423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:02.747423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:02.747423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:02.747423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:02.747423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:02.747423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:02.747423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:02.747423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:02.747423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:02.750063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 175/342] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:02.751255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7e827-bc2a-49ca-b3c8-03ea6eabef29 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:02.751540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7e827-bc2a-49ca-b3c8-03ea6eabef29 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:02.751829 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd7e827-bc2a-49ca-b3c8-03ea6eabef29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:02.785665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-efd7e827-bc2a-49ca-b3c8-03ea6eabef29 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:02.786867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-efd7e827-bc2a-49ca-b3c8-03ea6eabef29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:02.881002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 176/343] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:02.881818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7e827-bc2a-49ca-b3c8-03ea6eabef29 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:02.933850 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe8780c-5808-4e8d-a854-edab6b4833ee None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:03.009677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39163bfa-6f93-40d0-91f0-13e4b276af71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:03.010335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39163bfa-6f93-40d0-91f0-13e4b276af71 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:03.010612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39163bfa-6f93-40d0-91f0-13e4b276af71 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:03.010880 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39163bfa-6f93-40d0-91f0-13e4b276af71 None admin] PATH_INFO: `/v3/users/d21fcc161933463a800bc3a5855f3621` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:03.013854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39163bfa-6f93-40d0-91f0-13e4b276af71 None admin] RBAC: Authorizing `identity:get_user(user_id=d21fcc161933463a800bc3a5855f3621)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:03.015396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39163bfa-6f93-40d0-91f0-13e4b276af71 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:03.017022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 168/344] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:50:02 2022] GET /identity/v3/users/d21fcc161933463a800bc3a5855f3621 => generated 293 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:03.017818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39163bfa-6f93-40d0-91f0-13e4b276af71 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:03.045792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:03.074545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd7e827-bc2a-49ca-b3c8-03ea6eabef29 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:03.099837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:03.138650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545b1d7-24e2-4936-b97c-76ca21506bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:03.139809 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b1d7-24e2-4936-b97c-76ca21506bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:03.140254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b1d7-24e2-4936-b97c-76ca21506bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:03.140681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2545b1d7-24e2-4936-b97c-76ca21506bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:03.141904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545b1d7-24e2-4936-b97c-76ca21506bd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:03.142848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545b1d7-24e2-4936-b97c-76ca21506bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:03.146441 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2545b1d7-24e2-4936-b97c-76ca21506bd4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:03.164699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 177/345] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:50:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:03.170122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545b1d7-24e2-4936-b97c-76ca21506bd4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:03.257835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39163bfa-6f93-40d0-91f0-13e4b276af71 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:03.391005 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094fce4-fb54-4eb2-bf64-d3b6424ae5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:03.392042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094fce4-fb54-4eb2-bf64-d3b6424ae5b6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:03.392510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094fce4-fb54-4eb2-bf64-d3b6424ae5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:03.392902 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094fce4-fb54-4eb2-bf64-d3b6424ae5b6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:03.424512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094fce4-fb54-4eb2-bf64-d3b6424ae5b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-7094fce4-fb54-4eb2-bf64-d3b6424ae5b6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:03.436296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:03.437248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:03.438198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:03.438198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:03.438198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:03.438198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:03.438198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:03.438198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:03.438198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:03.438198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:03.438198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:03.438198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:03.438198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:03.438198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:03.442693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 169/346] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:50:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 425 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:03.444509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094fce4-fb54-4eb2-bf64-d3b6424ae5b6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:03.459092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2545b1d7-24e2-4936-b97c-76ca21506bd4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:03.550658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d87aa-a5bf-442a-8618-c5a2adf23d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:03.551675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d87aa-a5bf-442a-8618-c5a2adf23d31 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:03.552167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d87aa-a5bf-442a-8618-c5a2adf23d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:03.552642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d87aa-a5bf-442a-8618-c5a2adf23d31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:03.553672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d87aa-a5bf-442a-8618-c5a2adf23d31 None admin] RBAC: Adding query filter params (role.id=fce6359ef8b8407a9887ee97701093a8, user.id=d21fcc161933463a800bc3a5855f3621, scope.system=all) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:03.554187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d87aa-a5bf-442a-8618-c5a2adf23d31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:03.555859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d87aa-a5bf-442a-8618-c5a2adf23d31 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:03.577428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 178/347] 10.222.0.42 () {56 vars in 1308 bytes} [Mon Aug 1 11:50:03 2022] GET /identity/v3/role_assignments?user.id=d21fcc161933463a800bc3a5855f3621&scope.system=all&role.id=fce6359ef8b8407a9887ee97701093a8 => generated 510 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:03.578768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d87aa-a5bf-442a-8618-c5a2adf23d31 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:03.581897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:03.614785 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094fce4-fb54-4eb2-bf64-d3b6424ae5b6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:03.641936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:03.657244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5a621c-f683-4f72-926e-5f6607dc4a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:03.658368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a621c-f683-4f72-926e-5f6607dc4a4e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:03.658853 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a621c-f683-4f72-926e-5f6607dc4a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:03.659367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5a621c-f683-4f72-926e-5f6607dc4a4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:03.753586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a621c-f683-4f72-926e-5f6607dc4a4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:03.755965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5a621c-f683-4f72-926e-5f6607dc4a4e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:03.787393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d87aa-a5bf-442a-8618-c5a2adf23d31 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:03.874762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f20af-0419-49fc-82a1-a1facc97754e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:03.875436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f20af-0419-49fc-82a1-a1facc97754e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:03.875781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f20af-0419-49fc-82a1-a1facc97754e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:03.875982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f20af-0419-49fc-82a1-a1facc97754e None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:03.876708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f20af-0419-49fc-82a1-a1facc97754e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:03.876815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:03.877008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f20af-0419-49fc-82a1-a1facc97754e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:03.882604 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f20af-0419-49fc-82a1-a1facc97754e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:03.884473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 170/348] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:03.886523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f0918-7117-4d53-8fcf-706ebe05cd70 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:03.887027 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f0918-7117-4d53-8fcf-706ebe05cd70 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:03.887529 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f0918-7117-4d53-8fcf-706ebe05cd70 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:03.889035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 171/349] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:03.896831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f0918-7117-4d53-8fcf-706ebe05cd70 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:03.901334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 179/350] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:03.902502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f5508-91e2-42ce-9c4f-b68b566ed388 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:03.902791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f5508-91e2-42ce-9c4f-b68b566ed388 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:03.903069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f5508-91e2-42ce-9c4f-b68b566ed388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:03.936312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-192f5508-91e2-42ce-9c4f-b68b566ed388 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:03.937555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-192f5508-91e2-42ce-9c4f-b68b566ed388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:04.038267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f0918-7117-4d53-8fcf-706ebe05cd70 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:04.044179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 180/351] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:50:04.045168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f5508-91e2-42ce-9c4f-b68b566ed388 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:04.080716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ee79c-09cd-4458-8639-e696aa6c71ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:04.082102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ee79c-09cd-4458-8639-e696aa6c71ea None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:04.082778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ee79c-09cd-4458-8639-e696aa6c71ea None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:04.083271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ee79c-09cd-4458-8639-e696aa6c71ea None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:04.084989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ee79c-09cd-4458-8639-e696aa6c71ea None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:04.086712 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137ee79c-09cd-4458-8639-e696aa6c71ea None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:04.089631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 172/352] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:03 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:04.094283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ee79c-09cd-4458-8639-e696aa6c71ea None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:04.098273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:04.163012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:04.200821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f5508-91e2-42ce-9c4f-b68b566ed388 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:04.224761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ee79c-09cd-4458-8639-e696aa6c71ea None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:04.247663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b32a95d-654b-4366-885e-ab442bed1ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:04.248300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32a95d-654b-4366-885e-ab442bed1ccd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:04.248580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32a95d-654b-4366-885e-ab442bed1ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:04.248848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b32a95d-654b-4366-885e-ab442bed1ccd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:04.268942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d89d3-8125-45b3-bad2-e976fe95c055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:04.269645 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d89d3-8125-45b3-bad2-e976fe95c055 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:04.269932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d89d3-8125-45b3-bad2-e976fe95c055 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:04.270203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d89d3-8125-45b3-bad2-e976fe95c055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:04.283575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d89d3-8125-45b3-bad2-e976fe95c055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-782d89d3-8125-45b3-bad2-e976fe95c055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:04.289650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:04.290528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:04.291321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:04.291321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:04.291321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:04.291321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:04.291321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:04.291321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:04.291321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:04.291321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:04.291321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:04.291321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:04.291321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:04.291321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:04.296780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 173/353] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:04.296780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d89d3-8125-45b3-bad2-e976fe95c055 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:04.354069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32a95d-654b-4366-885e-ab442bed1ccd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:04.355544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b32a95d-654b-4366-885e-ab442bed1ccd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:04.392368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:04.427815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:04.438210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d89d3-8125-45b3-bad2-e976fe95c055 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:04.485104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f439cc0-1303-4eaa-82a3-0e1f0bc04fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:04.485792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f439cc0-1303-4eaa-82a3-0e1f0bc04fda None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:04.486080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f439cc0-1303-4eaa-82a3-0e1f0bc04fda None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:04.486354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f439cc0-1303-4eaa-82a3-0e1f0bc04fda None admin] PATH_INFO: `/v3/groups/9337875cb4004e8aa9d8bba280776c77` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:04.496255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f439cc0-1303-4eaa-82a3-0e1f0bc04fda None admin] RBAC: Authorizing `identity:get_group(group_id=9337875cb4004e8aa9d8bba280776c77)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:04.499820 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f439cc0-1303-4eaa-82a3-0e1f0bc04fda None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:04.499941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 181/354] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:04.499941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cfb3f-ef7c-4619-95c6-f69017b11822 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:04.500074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 174/355] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:04 2022] GET /identity/v3/groups/9337875cb4004e8aa9d8bba280776c77 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:04.500141 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cfb3f-ef7c-4619-95c6-f69017b11822 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:04.500338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cfb3f-ef7c-4619-95c6-f69017b11822 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:04.500522 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f439cc0-1303-4eaa-82a3-0e1f0bc04fda None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:04.505386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 182/356] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:04.505386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cfb3f-ef7c-4619-95c6-f69017b11822 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:04.631484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f439cc0-1303-4eaa-82a3-0e1f0bc04fda None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:04.635418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cfb3f-ef7c-4619-95c6-f69017b11822 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:04.668803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:04.673817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64ad78-e15d-406a-90df-d06055872744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:04.674834 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64ad78-e15d-406a-90df-d06055872744 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:04.675364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64ad78-e15d-406a-90df-d06055872744 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:04.675875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64ad78-e15d-406a-90df-d06055872744 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:04.676880 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64ad78-e15d-406a-90df-d06055872744 None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:04.677417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64ad78-e15d-406a-90df-d06055872744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:04.679210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64ad78-e15d-406a-90df-d06055872744 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:04.685257 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19aa1b-f988-4890-bf46-2259dfd122a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:04.686645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19aa1b-f988-4890-bf46-2259dfd122a2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:04.686930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19aa1b-f988-4890-bf46-2259dfd122a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:04.687202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c19aa1b-f988-4890-bf46-2259dfd122a2 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:04.688387 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19aa1b-f988-4890-bf46-2259dfd122a2 None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:04.689564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 175/357] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:50:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:04.690757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c19aa1b-f988-4890-bf46-2259dfd122a2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:04.690881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bf1c4-c7a8-4b06-8a68-7631313f78e8 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:04.690881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bf1c4-c7a8-4b06-8a68-7631313f78e8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:04.691140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1bf1c4-c7a8-4b06-8a68-7631313f78e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:04.691840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 183/358] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:04 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:04.692621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19aa1b-f988-4890-bf46-2259dfd122a2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:04.713960 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1e1bf1c4-c7a8-4b06-8a68-7631313f78e8 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:04.715616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1e1bf1c4-c7a8-4b06-8a68-7631313f78e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:04.734929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:04.801753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 176/359] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:04.802928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bf1c4-c7a8-4b06-8a68-7631313f78e8 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:04.809083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c19aa1b-f988-4890-bf46-2259dfd122a2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:04.851444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0aa24-9a7a-4502-b289-08206e1cf846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:04.852065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0aa24-9a7a-4502-b289-08206e1cf846 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:04.852339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0aa24-9a7a-4502-b289-08206e1cf846 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:04.852605 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f0aa24-9a7a-4502-b289-08206e1cf846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:04.853428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0aa24-9a7a-4502-b289-08206e1cf846 None admin] RBAC: Adding query filter params (group.id=9337875cb4004e8aa9d8bba280776c77, role.id=251e50fd870c48f3a02b69587144b7bf, scope.project.id=de598ff4856d4edc9937647ebb5aa468) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:04.853737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0aa24-9a7a-4502-b289-08206e1cf846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:04.855168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f0aa24-9a7a-4502-b289-08206e1cf846 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:04.861813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 184/360] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Aug 1 11:50:04 2022] GET /identity/v3/role_assignments?group.id=9337875cb4004e8aa9d8bba280776c77&scope.project.id=de598ff4856d4edc9937647ebb5aa468&role.id=251e50fd870c48f3a02b69587144b7bf => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:04.862620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0aa24-9a7a-4502-b289-08206e1cf846 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:04.937685 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:04.951697 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1bf1c4-c7a8-4b06-8a68-7631313f78e8 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:05.001492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f0aa24-9a7a-4502-b289-08206e1cf846 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:05.003864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb93c5-a6e9-414a-8ba7-9b04fe850b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:05.004596 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb93c5-a6e9-414a-8ba7-9b04fe850b23 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:05.004877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb93c5-a6e9-414a-8ba7-9b04fe850b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:05.005182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb93c5-a6e9-414a-8ba7-9b04fe850b23 None admin] PATH_INFO: `/v3/groups/9337875cb4004e8aa9d8bba280776c77` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:05.006488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb93c5-a6e9-414a-8ba7-9b04fe850b23 None admin] RBAC: Authorizing `identity:get_group(group_id=9337875cb4004e8aa9d8bba280776c77)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:05.007967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb93c5-a6e9-414a-8ba7-9b04fe850b23 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:05.009766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 177/361] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:04 2022] GET /identity/v3/groups/9337875cb4004e8aa9d8bba280776c77 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:05.011931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f842088-0943-4de6-9584-00c1ac969999 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:05.011931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f842088-0943-4de6-9584-00c1ac969999 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:05.011931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f842088-0943-4de6-9584-00c1ac969999 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:05.013069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 178/362] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:05.013840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f842088-0943-4de6-9584-00c1ac969999 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:05.045835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:05.059167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf01aa3-ec8e-46d7-8a0d-e0bc0ce89791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:05.059790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf01aa3-ec8e-46d7-8a0d-e0bc0ce89791 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:05.060072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf01aa3-ec8e-46d7-8a0d-e0bc0ce89791 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:05.060411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf01aa3-ec8e-46d7-8a0d-e0bc0ce89791 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:05.145786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf01aa3-ec8e-46d7-8a0d-e0bc0ce89791 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:05.147284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf01aa3-ec8e-46d7-8a0d-e0bc0ce89791 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:05.148396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f842088-0943-4de6-9584-00c1ac969999 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:05.186124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb01d5e-c015-4fff-9b28-abd8e36db10d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:05.186124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb01d5e-c015-4fff-9b28-abd8e36db10d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:05.186406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb01d5e-c015-4fff-9b28-abd8e36db10d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:05.186645 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb01d5e-c015-4fff-9b28-abd8e36db10d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:05.200708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb01d5e-c015-4fff-9b28-abd8e36db10d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-7fb01d5e-c015-4fff-9b28-abd8e36db10d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:05.208614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:05.209565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:05.210356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 179/363] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:50:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:05.217468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb01d5e-c015-4fff-9b28-abd8e36db10d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:05.229866 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:05.288614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 185/364] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:05.290715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb9164-9ac9-4b47-a39b-7c55528d8ae3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:05.290715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb9164-9ac9-4b47-a39b-7c55528d8ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:05.290715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb9164-9ac9-4b47-a39b-7c55528d8ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:05.313030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a6fb9164-9ac9-4b47-a39b-7c55528d8ae3 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:05.314535 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a6fb9164-9ac9-4b47-a39b-7c55528d8ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:05.344673 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:05.371815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb01d5e-c015-4fff-9b28-abd8e36db10d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:05.418528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 186/365] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:05.418528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb9164-9ac9-4b47-a39b-7c55528d8ae3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:05.425757 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30980-96fb-4306-8f2d-1679697877bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:05.426427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30980-96fb-4306-8f2d-1679697877bd None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:05.426852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30980-96fb-4306-8f2d-1679697877bd None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:05.427272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd30980-96fb-4306-8f2d-1679697877bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:05.428670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd30980-96fb-4306-8f2d-1679697877bd None admin] RBAC: Adding query filter params (group.id=9337875cb4004e8aa9d8bba280776c77, role.id=d0262ce715f7448babe9cef93dc25e9d, scope.project.id=de598ff4856d4edc9937647ebb5aa468) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:05.429149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd30980-96fb-4306-8f2d-1679697877bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:05.431109 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd30980-96fb-4306-8f2d-1679697877bd None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:05.441283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 180/366] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Aug 1 11:50:05 2022] GET /identity/v3/role_assignments?group.id=9337875cb4004e8aa9d8bba280776c77&scope.project.id=de598ff4856d4edc9937647ebb5aa468&role.id=d0262ce715f7448babe9cef93dc25e9d => generated 260 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:05.442234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30980-96fb-4306-8f2d-1679697877bd None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:05.558864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:05.577817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb9164-9ac9-4b47-a39b-7c55528d8ae3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:05.596013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd30980-96fb-4306-8f2d-1679697877bd None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:05.626939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b18192-485e-463d-ab8d-1ac47a2ab166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:05.627722 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b18192-485e-463d-ab8d-1ac47a2ab166 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:05.628102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b18192-485e-463d-ab8d-1ac47a2ab166 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:05.628383 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b18192-485e-463d-ab8d-1ac47a2ab166 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:05.629109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b18192-485e-463d-ab8d-1ac47a2ab166 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:05.631108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b18192-485e-463d-ab8d-1ac47a2ab166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:05.632513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b18192-485e-463d-ab8d-1ac47a2ab166 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:05.639994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feccedd-5e96-4719-bef7-db1e69b6a788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:05.640646 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feccedd-5e96-4719-bef7-db1e69b6a788 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:05.640920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feccedd-5e96-4719-bef7-db1e69b6a788 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:05.641237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feccedd-5e96-4719-bef7-db1e69b6a788 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:05.641836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 187/367] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:05.642655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feccedd-5e96-4719-bef7-db1e69b6a788 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:05.642764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b18192-485e-463d-ab8d-1ac47a2ab166 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:05.644262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4feccedd-5e96-4719-bef7-db1e69b6a788 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:05.648196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 181/368] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:05 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:05.651762 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feccedd-5e96-4719-bef7-db1e69b6a788 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:05.671450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:05.765057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b18192-485e-463d-ab8d-1ac47a2ab166 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:05.789163 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feccedd-5e96-4719-bef7-db1e69b6a788 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:05.818142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dca6c4-fde1-466e-a767-c4096ca3b14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:05.819125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dca6c4-fde1-466e-a767-c4096ca3b14e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:05.819788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dca6c4-fde1-466e-a767-c4096ca3b14e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:05.820203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dca6c4-fde1-466e-a767-c4096ca3b14e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:05.830291 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f69f48-5eb7-4287-9698-d674a84aeb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:05.831023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69f48-5eb7-4287-9698-d674a84aeb70 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:05.831407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69f48-5eb7-4287-9698-d674a84aeb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:05.831778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f69f48-5eb7-4287-9698-d674a84aeb70 None admin] PATH_INFO: `/v3/groups/9337875cb4004e8aa9d8bba280776c77` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:05.833067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f69f48-5eb7-4287-9698-d674a84aeb70 None admin] RBAC: Authorizing `identity:get_group(group_id=9337875cb4004e8aa9d8bba280776c77)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:05.840815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f69f48-5eb7-4287-9698-d674a84aeb70 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:05.840815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 182/369] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:05 2022] GET /identity/v3/groups/9337875cb4004e8aa9d8bba280776c77 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:05.840815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f69f48-5eb7-4287-9698-d674a84aeb70 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:05.841992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dca6c4-fde1-466e-a767-c4096ca3b14e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f5dca6c4-fde1-466e-a767-c4096ca3b14e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:05.847981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:05.848873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:05.849914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 188/370] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:05.854256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dca6c4-fde1-466e-a767-c4096ca3b14e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:05.873014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:05.962969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:05.988806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f69f48-5eb7-4287-9698-d674a84aeb70 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:05.990509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dca6c4-fde1-466e-a767-c4096ca3b14e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:06.026435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267c668-1f0a-486c-837a-6bc0f95bafe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:06.027329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267c668-1f0a-486c-837a-6bc0f95bafe0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:06.027749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267c668-1f0a-486c-837a-6bc0f95bafe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:06.028158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267c668-1f0a-486c-837a-6bc0f95bafe0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:06.028268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed18af5-777b-476a-92a3-0b406872f937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:06.028807 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed18af5-777b-476a-92a3-0b406872f937 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:06.029094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed18af5-777b-476a-92a3-0b406872f937 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:06.029512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed18af5-777b-476a-92a3-0b406872f937 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:06.030308 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed18af5-777b-476a-92a3-0b406872f937 None admin] RBAC: Adding query filter params (group.id=9337875cb4004e8aa9d8bba280776c77, role.id=251e50fd870c48f3a02b69587144b7bf, scope.project.id=50a4f8b5734d4771ab600161af000c0d) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:06.030618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed18af5-777b-476a-92a3-0b406872f937 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:06.032359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed18af5-777b-476a-92a3-0b406872f937 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:06.041348 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 189/371] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Aug 1 11:50:05 2022] GET /identity/v3/role_assignments?group.id=9337875cb4004e8aa9d8bba280776c77&scope.project.id=50a4f8b5734d4771ab600161af000c0d&role.id=251e50fd870c48f3a02b69587144b7bf => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:06.042714 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed18af5-777b-476a-92a3-0b406872f937 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:06.127325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267c668-1f0a-486c-837a-6bc0f95bafe0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:06.128772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267c668-1f0a-486c-837a-6bc0f95bafe0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:06.134485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:06.195485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed18af5-777b-476a-92a3-0b406872f937 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:06.224025 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:06.248116 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 183/372] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:06.255107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267c668-1f0a-486c-837a-6bc0f95bafe0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:06.290488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639e062-b5f0-44b9-b382-9526f1aa4f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:06.291121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639e062-b5f0-44b9-b382-9526f1aa4f3f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:06.291399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639e062-b5f0-44b9-b382-9526f1aa4f3f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:06.291665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5639e062-b5f0-44b9-b382-9526f1aa4f3f None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:06.292510 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639e062-b5f0-44b9-b382-9526f1aa4f3f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:06.292818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639e062-b5f0-44b9-b382-9526f1aa4f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:06.294297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5639e062-b5f0-44b9-b382-9526f1aa4f3f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:06.305197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 190/373] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:06.315562 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639e062-b5f0-44b9-b382-9526f1aa4f3f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:06.410190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267c668-1f0a-486c-837a-6bc0f95bafe0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:06.467388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5639e062-b5f0-44b9-b382-9526f1aa4f3f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:06.473010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcc688-d8e3-49c9-b25d-023ab45b3356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:06.473956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcc688-d8e3-49c9-b25d-023ab45b3356 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:06.475177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcc688-d8e3-49c9-b25d-023ab45b3356 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:06.475655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bcc688-d8e3-49c9-b25d-023ab45b3356 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:06.479953 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcc688-d8e3-49c9-b25d-023ab45b3356 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:06.481687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bcc688-d8e3-49c9-b25d-023ab45b3356 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:06.485353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 184/374] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:06 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:06.494268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcc688-d8e3-49c9-b25d-023ab45b3356 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:06.542712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82666a-4448-44bc-bace-a1d461568ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:06.543867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82666a-4448-44bc-bace-a1d461568ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:06.545419 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82666a-4448-44bc-bace-a1d461568ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:06.545912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82666a-4448-44bc-bace-a1d461568ce7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:06.550760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:06.595615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:06.668090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bcc688-d8e3-49c9-b25d-023ab45b3356 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:06.702583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82666a-4448-44bc-bace-a1d461568ce7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:06.704097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82666a-4448-44bc-bace-a1d461568ce7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:06.712784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e201a20-8dbb-4538-95ae-1ef5b25ceef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:06.713744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e201a20-8dbb-4538-95ae-1ef5b25ceef3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:06.715171 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e201a20-8dbb-4538-95ae-1ef5b25ceef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:06.715670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e201a20-8dbb-4538-95ae-1ef5b25ceef3 None admin] PATH_INFO: `/v3/groups/9337875cb4004e8aa9d8bba280776c77` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:06.717050 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e201a20-8dbb-4538-95ae-1ef5b25ceef3 None admin] RBAC: Authorizing `identity:get_group(group_id=9337875cb4004e8aa9d8bba280776c77)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:06.718727 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e201a20-8dbb-4538-95ae-1ef5b25ceef3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:06.720868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 185/375] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:06 2022] GET /identity/v3/groups/9337875cb4004e8aa9d8bba280776c77 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:06.727889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e201a20-8dbb-4538-95ae-1ef5b25ceef3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:06.861643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e201a20-8dbb-4538-95ae-1ef5b25ceef3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:06.917068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 191/376] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:06.917450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:06.923336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82666a-4448-44bc-bace-a1d461568ce7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:06.963127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e3a98-e079-4fd9-a45b-4f65a67c316a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:06.963758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e3a98-e079-4fd9-a45b-4f65a67c316a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:06.964037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e3a98-e079-4fd9-a45b-4f65a67c316a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:06.964311 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e3a98-e079-4fd9-a45b-4f65a67c316a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:06.965104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e3a98-e079-4fd9-a45b-4f65a67c316a None admin] RBAC: Adding query filter params (group.id=9337875cb4004e8aa9d8bba280776c77, role.id=d0262ce715f7448babe9cef93dc25e9d, scope.project.id=50a4f8b5734d4771ab600161af000c0d) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:06.965443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e3a98-e079-4fd9-a45b-4f65a67c316a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:06.966886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e3a98-e079-4fd9-a45b-4f65a67c316a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:06.979352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 186/377] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Aug 1 11:50:06 2022] GET /identity/v3/role_assignments?group.id=9337875cb4004e8aa9d8bba280776c77&scope.project.id=50a4f8b5734d4771ab600161af000c0d&role.id=d0262ce715f7448babe9cef93dc25e9d => generated 260 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:07.005760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:07.110391 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82666a-4448-44bc-bace-a1d461568ce7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:07.159413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c7b36-4664-44f5-a89e-2783736c134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:07.160063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c7b36-4664-44f5-a89e-2783736c134e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:07.160343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c7b36-4664-44f5-a89e-2783736c134e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:07.160616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c7b36-4664-44f5-a89e-2783736c134e None admin] PATH_INFO: `/v3/projects/541ab528aad34615a3714dea6d3cccb9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:07.166137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c7b36-4664-44f5-a89e-2783736c134e None admin] RBAC: Authorizing `identity:get_project(project_id=541ab528aad34615a3714dea6d3cccb9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:07.167618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c7b36-4664-44f5-a89e-2783736c134e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:07.169556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 192/378] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:06 2022] GET /identity/v3/projects/541ab528aad34615a3714dea6d3cccb9 => generated 344 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:07.175183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e3a98-e079-4fd9-a45b-4f65a67c316a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:07.208280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55a301-4f45-475e-97ff-5b1540294107 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:07.208793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55a301-4f45-475e-97ff-5b1540294107 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:07.208793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55a301-4f45-475e-97ff-5b1540294107 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:07.210214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 193/379] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:07.220824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115506-6f88-4796-af44-1e799c299688 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:07.221127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115506-6f88-4796-af44-1e799c299688 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:07.221426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03115506-6f88-4796-af44-1e799c299688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:07.250275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-03115506-6f88-4796-af44-1e799c299688 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:07.251466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-03115506-6f88-4796-af44-1e799c299688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:07.359543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e3a98-e079-4fd9-a45b-4f65a67c316a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:07.385269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 194/380] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:50:07.414726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedf0b6-e7a2-420d-9053-b1ba22794109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:07.415378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf0b6-e7a2-420d-9053-b1ba22794109 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:07.415657 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf0b6-e7a2-420d-9053-b1ba22794109 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:07.415929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fedf0b6-e7a2-420d-9053-b1ba22794109 None admin] PATH_INFO: `/v3/groups/a9c61016f15a4ab08482ec6770ef1249` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:07.416352 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03115506-6f88-4796-af44-1e799c299688 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:07.427175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedf0b6-e7a2-420d-9053-b1ba22794109 None admin] RBAC: Authorizing `identity:get_group(group_id=a9c61016f15a4ab08482ec6770ef1249)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:07.428938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fedf0b6-e7a2-420d-9053-b1ba22794109 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:07.431568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 187/381] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:07 2022] GET /identity/v3/groups/a9c61016f15a4ab08482ec6770ef1249 => generated 229 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:07.437220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedf0b6-e7a2-420d-9053-b1ba22794109 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:07.477667 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:07.499674 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:07.563982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fedf0b6-e7a2-420d-9053-b1ba22794109 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:07.612425 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03115506-6f88-4796-af44-1e799c299688 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:07.626837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19d8fb-4b1e-4835-8bb2-1a46a6604fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:07.629411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d8fb-4b1e-4835-8bb2-1a46a6604fde None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:07.629701 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d8fb-4b1e-4835-8bb2-1a46a6604fde None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:07.629977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19d8fb-4b1e-4835-8bb2-1a46a6604fde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:07.630779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19d8fb-4b1e-4835-8bb2-1a46a6604fde None admin] RBAC: Adding query filter params (group.id=a9c61016f15a4ab08482ec6770ef1249, role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=541ab528aad34615a3714dea6d3cccb9) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:07.631091 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19d8fb-4b1e-4835-8bb2-1a46a6604fde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:07.632568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce19d8fb-4b1e-4835-8bb2-1a46a6604fde None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:07.646546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 188/382] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Aug 1 11:50:07 2022] GET /identity/v3/role_assignments?group.id=a9c61016f15a4ab08482ec6770ef1249&scope.project.id=541ab528aad34615a3714dea6d3cccb9&role.id=0195bf688a7e464e8ff594afe80b050e => generated 260 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:07.666152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d067a3d-2baf-4b96-b741-38dcdd65a356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:07.667136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d067a3d-2baf-4b96-b741-38dcdd65a356 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:07.667571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d067a3d-2baf-4b96-b741-38dcdd65a356 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:07.667994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d067a3d-2baf-4b96-b741-38dcdd65a356 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:07.680775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d067a3d-2baf-4b96-b741-38dcdd65a356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8d067a3d-2baf-4b96-b741-38dcdd65a356 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:07.686347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:07.687571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:07.688583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:07.688583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:07.688583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:07.688583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:07.688583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:07.688583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:07.688583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:07.688583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:07.688583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:07.688583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:07.688583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:07.688583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:07.692274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 195/383] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:07.698000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19d8fb-4b1e-4835-8bb2-1a46a6604fde None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:07.840691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19d8fb-4b1e-4835-8bb2-1a46a6604fde None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:07.854885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:07.887042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89eb263-8a9f-49c0-9f24-efc2874f17cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:07.888069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eb263-8a9f-49c0-9f24-efc2874f17cf None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:07.888557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eb263-8a9f-49c0-9f24-efc2874f17cf None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:07.888979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89eb263-8a9f-49c0-9f24-efc2874f17cf None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:07.890025 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89eb263-8a9f-49c0-9f24-efc2874f17cf None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:07.890484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89eb263-8a9f-49c0-9f24-efc2874f17cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:07.892147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89eb263-8a9f-49c0-9f24-efc2874f17cf None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:07.912890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 189/384] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:50:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:07.918250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d067a3d-2baf-4b96-b741-38dcdd65a356 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:07.963774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bc0ff-a0e6-4ea0-a1bc-9e5b3d737278 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:07.963961 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bc0ff-a0e6-4ea0-a1bc-9e5b3d737278 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:07.964243 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550bc0ff-a0e6-4ea0-a1bc-9e5b3d737278 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:07.967305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 190/385] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:50:07.976532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e697931-3800-448f-95f2-3d6d18424c20 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:07.976826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e697931-3800-448f-95f2-3d6d18424c20 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:07.977085 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e697931-3800-448f-95f2-3d6d18424c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:07.997879 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4e697931-3800-448f-95f2-3d6d18424c20 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:07.999460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4e697931-3800-448f-95f2-3d6d18424c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:08.064435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:08.089055 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d067a3d-2baf-4b96-b741-38dcdd65a356 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:08.089463 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 191/386] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:50:08.130160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e697931-3800-448f-95f2-3d6d18424c20 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:08.167603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073caae-6fd1-4345-a52c-94e94a28f072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:08.168525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073caae-6fd1-4345-a52c-94e94a28f072 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:08.168959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073caae-6fd1-4345-a52c-94e94a28f072 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:08.169416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9073caae-6fd1-4345-a52c-94e94a28f072 None admin] PATH_INFO: `/v3/groups/9337875cb4004e8aa9d8bba280776c77` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:08.170743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073caae-6fd1-4345-a52c-94e94a28f072 None admin] RBAC: Authorizing `identity:get_group(group_id=9337875cb4004e8aa9d8bba280776c77)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:08.177318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9073caae-6fd1-4345-a52c-94e94a28f072 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:08.179697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 196/387] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:07 2022] GET /identity/v3/groups/9337875cb4004e8aa9d8bba280776c77 => generated 226 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:08.184697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073caae-6fd1-4345-a52c-94e94a28f072 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:08.261654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:08.269860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e697931-3800-448f-95f2-3d6d18424c20 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:08.339177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f738e22-ed12-4683-9573-7393b1256470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:08.339831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f738e22-ed12-4683-9573-7393b1256470 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:08.340107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f738e22-ed12-4683-9573-7393b1256470 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:08.340374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f738e22-ed12-4683-9573-7393b1256470 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:08.360752 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f738e22-ed12-4683-9573-7393b1256470 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-9f738e22-ed12-4683-9573-7393b1256470 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:08.369040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:08.369973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:08.370766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:08.370766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:08.370766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:08.370766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:08.370766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:08.370766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:08.370766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:08.370766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:08.370766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:08.370766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:08.370766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:08.370766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:08.371362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 192/388] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:50:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:08.379095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9073caae-6fd1-4345-a52c-94e94a28f072 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:08.392933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f738e22-ed12-4683-9573-7393b1256470 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:08.436367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbc651-92fa-4c6c-a152-9edbe0275683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:08.437390 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbc651-92fa-4c6c-a152-9edbe0275683 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:08.437836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbc651-92fa-4c6c-a152-9edbe0275683 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:08.438326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fbc651-92fa-4c6c-a152-9edbe0275683 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:08.439586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbc651-92fa-4c6c-a152-9edbe0275683 None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:08.441796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fbc651-92fa-4c6c-a152-9edbe0275683 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:08.444180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 197/389] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:08 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:08.450111 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbc651-92fa-4c6c-a152-9edbe0275683 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:08.483342 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:08.552846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f738e22-ed12-4683-9573-7393b1256470 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:08.562616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fbc651-92fa-4c6c-a152-9edbe0275683 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:08.601156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a78fc4-e2e7-4622-a871-85e2873d20ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:08.601970 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a78fc4-e2e7-4622-a871-85e2873d20ed None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:08.602307 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a78fc4-e2e7-4622-a871-85e2873d20ed None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:08.602724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a78fc4-e2e7-4622-a871-85e2873d20ed None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468/groups/9337875cb4004e8aa9d8bba280776c77/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:08.604824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a78fc4-e2e7-4622-a871-85e2873d20ed None admin] RBAC: Authorizing `identity:create_grant(project_id=de598ff4856d4edc9937647ebb5aa468, group_id=9337875cb4004e8aa9d8bba280776c77, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:08.606627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a78fc4-e2e7-4622-a871-85e2873d20ed None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:08.614844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb8990-f29e-460b-8439-a30659208390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:08.615496 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb8990-f29e-460b-8439-a30659208390 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:08.615779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb8990-f29e-460b-8439-a30659208390 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:08.616059 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebb8990-f29e-460b-8439-a30659208390 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:08.616807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb8990-f29e-460b-8439-a30659208390 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:08.617123 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb8990-f29e-460b-8439-a30659208390 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:08.618694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebb8990-f29e-460b-8439-a30659208390 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:08.625214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 198/390] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Aug 1 11:50:08 2022] PUT /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468/groups/9337875cb4004e8aa9d8bba280776c77/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:50:08.643881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 193/391] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:08.649940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a78fc4-e2e7-4622-a871-85e2873d20ed None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:08.776048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:08.792316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a78fc4-e2e7-4622-a871-85e2873d20ed None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:08.829107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1735d03-17fe-402c-89ab-e2018e3f6926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:08.829803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1735d03-17fe-402c-89ab-e2018e3f6926 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:08.830088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1735d03-17fe-402c-89ab-e2018e3f6926 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:08.830361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1735d03-17fe-402c-89ab-e2018e3f6926 None admin] PATH_INFO: `/v3/groups/9337875cb4004e8aa9d8bba280776c77` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:08.831600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1735d03-17fe-402c-89ab-e2018e3f6926 None admin] RBAC: Authorizing `identity:get_group(group_id=9337875cb4004e8aa9d8bba280776c77)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:08.833194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1735d03-17fe-402c-89ab-e2018e3f6926 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:08.835179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 199/392] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:08 2022] GET /identity/v3/groups/9337875cb4004e8aa9d8bba280776c77 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:08.840525 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb8990-f29e-460b-8439-a30659208390 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:08.858595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a6889-deeb-4263-bdcd-accbd7c5ba0b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:08.859042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a6889-deeb-4263-bdcd-accbd7c5ba0b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:08.859331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a6889-deeb-4263-bdcd-accbd7c5ba0b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:08.861436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 200/393] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:50:08.868956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9dc5b-8c02-4c80-8d26-bad42d7951cd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:08.869243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9dc5b-8c02-4c80-8d26-bad42d7951cd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:08.869553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9dc5b-8c02-4c80-8d26-bad42d7951cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:08.874474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:08.894046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-61c9dc5b-8c02-4c80-8d26-bad42d7951cd None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:08.895662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-61c9dc5b-8c02-4c80-8d26-bad42d7951cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:09.014954 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebb8990-f29e-460b-8439-a30659208390 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:09.031084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 201/394] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:09.054378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9dc5b-8c02-4c80-8d26-bad42d7951cd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:09.095756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b3fb7-e676-4267-87d3-bb1e2e38dbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:09.096359 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b3fb7-e676-4267-87d3-bb1e2e38dbd3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:09.096638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b3fb7-e676-4267-87d3-bb1e2e38dbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:09.096907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01b3fb7-e676-4267-87d3-bb1e2e38dbd3 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:09.102040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b3fb7-e676-4267-87d3-bb1e2e38dbd3 None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:09.103512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01b3fb7-e676-4267-87d3-bb1e2e38dbd3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:09.105551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 194/395] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:08 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:09.110876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b3fb7-e676-4267-87d3-bb1e2e38dbd3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:09.148797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:09.166810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9dc5b-8c02-4c80-8d26-bad42d7951cd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:09.205440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39ea86-24ee-41a1-8a89-91bb9505f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:09.206167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39ea86-24ee-41a1-8a89-91bb9505f641 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:09.206449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39ea86-24ee-41a1-8a89-91bb9505f641 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:09.206723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39ea86-24ee-41a1-8a89-91bb9505f641 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:09.219267 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39ea86-24ee-41a1-8a89-91bb9505f641 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-fc39ea86-24ee-41a1-8a89-91bb9505f641 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:09.224407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:09.225316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:09.226364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 202/396] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:09.231632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39ea86-24ee-41a1-8a89-91bb9505f641 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:09.303220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:09.325354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01b3fb7-e676-4267-87d3-bb1e2e38dbd3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:09.381666 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39ea86-24ee-41a1-8a89-91bb9505f641 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:09.395252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2c1bd-3f9d-4b7d-b47d-4fb0d2e723b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:09.395936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2c1bd-3f9d-4b7d-b47d-4fb0d2e723b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:09.396222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2c1bd-3f9d-4b7d-b47d-4fb0d2e723b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:09.396500 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2c1bd-3f9d-4b7d-b47d-4fb0d2e723b8 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468/groups/9337875cb4004e8aa9d8bba280776c77/roles/d0262ce715f7448babe9cef93dc25e9d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:09.403177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2c1bd-3f9d-4b7d-b47d-4fb0d2e723b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=de598ff4856d4edc9937647ebb5aa468, group_id=9337875cb4004e8aa9d8bba280776c77, role_id=d0262ce715f7448babe9cef93dc25e9d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:09.404634 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d2c1bd-3f9d-4b7d-b47d-4fb0d2e723b8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:09.422675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64060c89-83cd-45f0-8111-ab1ff59e9479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:09.423718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64060c89-83cd-45f0-8111-ab1ff59e9479 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:09.424154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64060c89-83cd-45f0-8111-ab1ff59e9479 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:09.424496 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 195/397] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Aug 1 11:50:09 2022] PUT /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468/groups/9337875cb4004e8aa9d8bba280776c77/roles/d0262ce715f7448babe9cef93dc25e9d => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 11:50:09.425529 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64060c89-83cd-45f0-8111-ab1ff59e9479 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:09.426459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64060c89-83cd-45f0-8111-ab1ff59e9479 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:09.426902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64060c89-83cd-45f0-8111-ab1ff59e9479 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:09.428560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64060c89-83cd-45f0-8111-ab1ff59e9479 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:09.439122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 203/398] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:50:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:09.445081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2c1bd-3f9d-4b7d-b47d-4fb0d2e723b8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:09.556991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2c1bd-3f9d-4b7d-b47d-4fb0d2e723b8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:09.593507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04310f-1f1c-47b0-b5fa-3ecc6712fa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:09.594168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04310f-1f1c-47b0-b5fa-3ecc6712fa4d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:09.594447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04310f-1f1c-47b0-b5fa-3ecc6712fa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:09.594722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04310f-1f1c-47b0-b5fa-3ecc6712fa4d None admin] PATH_INFO: `/v3/groups/9337875cb4004e8aa9d8bba280776c77` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:09.595944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04310f-1f1c-47b0-b5fa-3ecc6712fa4d None admin] RBAC: Authorizing `identity:get_group(group_id=9337875cb4004e8aa9d8bba280776c77)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:09.597964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04310f-1f1c-47b0-b5fa-3ecc6712fa4d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:09.599934 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 196/399] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:09 2022] GET /identity/v3/groups/9337875cb4004e8aa9d8bba280776c77 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:09.605823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64060c89-83cd-45f0-8111-ab1ff59e9479 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:09.633952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:09.740938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64060c89-83cd-45f0-8111-ab1ff59e9479 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:09.775627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8432b9c-1bd9-4f3d-900a-286af7a61171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:09.776264 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8432b9c-1bd9-4f3d-900a-286af7a61171 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:09.776539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8432b9c-1bd9-4f3d-900a-286af7a61171 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:09.776808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8432b9c-1bd9-4f3d-900a-286af7a61171 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:09.778029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8432b9c-1bd9-4f3d-900a-286af7a61171 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:09.779469 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8432b9c-1bd9-4f3d-900a-286af7a61171 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:09.781428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 204/400] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:09 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:09.787219 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04310f-1f1c-47b0-b5fa-3ecc6712fa4d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:09.818081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:09.911438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04310f-1f1c-47b0-b5fa-3ecc6712fa4d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:09.950794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7c543-5561-4229-b4e5-e9bec0e26aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:09.951490 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7c543-5561-4229-b4e5-e9bec0e26aa4 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:09.951769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7c543-5561-4229-b4e5-e9bec0e26aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:09.952041 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b7c543-5561-4229-b4e5-e9bec0e26aa4 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d/groups/9337875cb4004e8aa9d8bba280776c77/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:09.954092 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7c543-5561-4229-b4e5-e9bec0e26aa4 None admin] RBAC: Authorizing `identity:create_grant(project_id=50a4f8b5734d4771ab600161af000c0d, group_id=9337875cb4004e8aa9d8bba280776c77, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:09.956468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b7c543-5561-4229-b4e5-e9bec0e26aa4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:09.966961 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bca51-6cfc-49d8-bbf3-c4b8fb79b3e3 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:09.967648 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bca51-6cfc-49d8-bbf3-c4b8fb79b3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:09.968178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02bca51-6cfc-49d8-bbf3-c4b8fb79b3e3 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:09.970322 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 205/401] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:09.976564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92dc1e-bfba-4229-b4df-b5911d21354b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:09.977177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92dc1e-bfba-4229-b4df-b5911d21354b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:09.977828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b92dc1e-bfba-4229-b4df-b5911d21354b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:09.983821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 197/402] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Aug 1 11:50:09 2022] PUT /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d/groups/9337875cb4004e8aa9d8bba280776c77/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:50:10.006608 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7b92dc1e-bfba-4229-b4df-b5911d21354b None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:10.008189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7b92dc1e-bfba-4229-b4df-b5911d21354b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:10.108552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 206/403] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:10.142381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7c543-5561-4229-b4e5-e9bec0e26aa4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:10.247578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:10.272660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b7c543-5561-4229-b4e5-e9bec0e26aa4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:10.316915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82ef59-9ce9-4cc2-8c98-7925d1fd0c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:10.317597 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82ef59-9ce9-4cc2-8c98-7925d1fd0c70 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:10.317878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82ef59-9ce9-4cc2-8c98-7925d1fd0c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:10.318148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82ef59-9ce9-4cc2-8c98-7925d1fd0c70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:10.328704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82ef59-9ce9-4cc2-8c98-7925d1fd0c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-ee82ef59-9ce9-4cc2-8c98-7925d1fd0c70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:10.334897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:10.335855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:10.336678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:10.336678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:10.336678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:10.336678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:10.336678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:10.336678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:10.336678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:10.336678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:10.336678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:10.336678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:10.336678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:10.336678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:10.340693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 198/404] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:50:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:10.341594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82ef59-9ce9-4cc2-8c98-7925d1fd0c70 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:10.342565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb03c8-53af-41f9-aa25-da6c449db722 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:10.343070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb03c8-53af-41f9-aa25-da6c449db722 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:10.343551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdb03c8-53af-41f9-aa25-da6c449db722 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:10.345109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 207/405] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:10.350614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c1de7-75eb-424f-840c-d339d2c56844 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:10.351333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c1de7-75eb-424f-840c-d339d2c56844 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:10.351830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654c1de7-75eb-424f-840c-d339d2c56844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:10.369345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:10.383494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-654c1de7-75eb-424f-840c-d339d2c56844 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:10.386502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-654c1de7-75eb-424f-840c-d339d2c56844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:10.521107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 208/406] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:10.530547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82ef59-9ce9-4cc2-8c98-7925d1fd0c70 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:10.550595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c1de7-75eb-424f-840c-d339d2c56844 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:10.589084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6bdb4-d1b8-4ead-8f7e-59039f2d0475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:10.589580 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6bdb4-d1b8-4ead-8f7e-59039f2d0475 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:10.589859 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6bdb4-d1b8-4ead-8f7e-59039f2d0475 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:10.590128 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf6bdb4-d1b8-4ead-8f7e-59039f2d0475 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:10.590840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6bdb4-d1b8-4ead-8f7e-59039f2d0475 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:10.591141 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6bdb4-d1b8-4ead-8f7e-59039f2d0475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:10.592510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf6bdb4-d1b8-4ead-8f7e-59039f2d0475 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:10.605689 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:10.611498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 199/407] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:10.617492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6bdb4-d1b8-4ead-8f7e-59039f2d0475 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:10.659491 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654c1de7-75eb-424f-840c-d339d2c56844 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:10.695689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695e7c0-2336-42fd-9ad1-675224f09bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:10.696702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695e7c0-2336-42fd-9ad1-675224f09bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:10.697191 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695e7c0-2336-42fd-9ad1-675224f09bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:10.697716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6695e7c0-2336-42fd-9ad1-675224f09bc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:10.700621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:10.709231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6695e7c0-2336-42fd-9ad1-675224f09bc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6695e7c0-2336-42fd-9ad1-675224f09bc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:10.714573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:10.715649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:10.716634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:10.716634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:10.716634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:10.716634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:10.716634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:10.716634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:10.716634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:10.716634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:10.716634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:10.716634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:10.716634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:10.716634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:10.719138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 209/408] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:10.726356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695e7c0-2336-42fd-9ad1-675224f09bc6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:10.844616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6695e7c0-2336-42fd-9ad1-675224f09bc6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:10.883313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf6bdb4-d1b8-4ead-8f7e-59039f2d0475 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:10.885698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e0b5f-e412-4d39-aace-9082c26ba4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:10.886323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e0b5f-e412-4d39-aace-9082c26ba4fd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:10.886600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e0b5f-e412-4d39-aace-9082c26ba4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:10.886880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e0b5f-e412-4d39-aace-9082c26ba4fd None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:10.887603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e0b5f-e412-4d39-aace-9082c26ba4fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:10.887901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e0b5f-e412-4d39-aace-9082c26ba4fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:10.889319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874e0b5f-e412-4d39-aace-9082c26ba4fd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:10.899798 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 210/409] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:10.906274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e0b5f-e412-4d39-aace-9082c26ba4fd None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:10.942083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6157c7b-d28b-4f12-acc4-a29794c35227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:10.942746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6157c7b-d28b-4f12-acc4-a29794c35227 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:10.943027 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6157c7b-d28b-4f12-acc4-a29794c35227 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:10.943297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6157c7b-d28b-4f12-acc4-a29794c35227 None admin] PATH_INFO: `/v3/groups/9337875cb4004e8aa9d8bba280776c77` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:10.944489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6157c7b-d28b-4f12-acc4-a29794c35227 None admin] RBAC: Authorizing `identity:get_group(group_id=9337875cb4004e8aa9d8bba280776c77)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:10.945959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6157c7b-d28b-4f12-acc4-a29794c35227 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:10.948854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 200/410] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:10 2022] GET /identity/v3/groups/9337875cb4004e8aa9d8bba280776c77 => generated 226 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:10.953473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6157c7b-d28b-4f12-acc4-a29794c35227 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:10.981681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:11.028777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e0b5f-e412-4d39-aace-9082c26ba4fd None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:11.067528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f39ed-299f-475c-8654-1506e1ef4f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:11.068174 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f39ed-299f-475c-8654-1506e1ef4f0f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:11.068460 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f39ed-299f-475c-8654-1506e1ef4f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:11.068739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f39ed-299f-475c-8654-1506e1ef4f0f None admin] PATH_INFO: `/v3/groups/a9c61016f15a4ab08482ec6770ef1249` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:11.071428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f39ed-299f-475c-8654-1506e1ef4f0f None admin] RBAC: Authorizing `identity:get_group(group_id=a9c61016f15a4ab08482ec6770ef1249)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:11.072912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f39ed-299f-475c-8654-1506e1ef4f0f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:11.074594 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 211/411] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:10 2022] GET /identity/v3/groups/a9c61016f15a4ab08482ec6770ef1249 => generated 229 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:11.084453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f39ed-299f-475c-8654-1506e1ef4f0f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:11.090892 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:11.146876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6157c7b-d28b-4f12-acc4-a29794c35227 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:11.183367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1f9669-1cf6-4714-8e9e-14f195f358c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:11.184013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9669-1cf6-4714-8e9e-14f195f358c7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:11.184293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9669-1cf6-4714-8e9e-14f195f358c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:11.184570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1f9669-1cf6-4714-8e9e-14f195f358c7 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:11.186222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f9669-1cf6-4714-8e9e-14f195f358c7 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:11.188136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1f9669-1cf6-4714-8e9e-14f195f358c7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:11.191287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 201/412] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:10 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:11.192498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe9d53-e9de-4d7e-96a8-f4d5b25e61a5 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:11.192786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe9d53-e9de-4d7e-96a8-f4d5b25e61a5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:11.193061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe9d53-e9de-4d7e-96a8-f4d5b25e61a5 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:11.198409 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 202/413] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:11.198409 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe9d53-e9de-4d7e-96a8-f4d5b25e61a5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:11.238011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f39ed-299f-475c-8654-1506e1ef4f0f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:11.265780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:11.277225 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4e474-3736-44f0-9093-deb6bc778944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:11.278172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e474-3736-44f0-9093-deb6bc778944 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:11.278676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e474-3736-44f0-9093-deb6bc778944 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:11.279146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e474-3736-44f0-9093-deb6bc778944 None admin] PATH_INFO: `/v3/projects/541ab528aad34615a3714dea6d3cccb9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:11.280591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4e474-3736-44f0-9093-deb6bc778944 None admin] RBAC: Authorizing `identity:get_project(project_id=541ab528aad34615a3714dea6d3cccb9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:11.282365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4e474-3736-44f0-9093-deb6bc778944 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:11.284494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 212/414] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:11 2022] GET /identity/v3/projects/541ab528aad34615a3714dea6d3cccb9 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:11.285921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030b5ac-9fd9-4a87-856b-0df8198cab1e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:11.286420 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030b5ac-9fd9-4a87-856b-0df8198cab1e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:11.292547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030b5ac-9fd9-4a87-856b-0df8198cab1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:11.317702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6030b5ac-9fd9-4a87-856b-0df8198cab1e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:11.319231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6030b5ac-9fd9-4a87-856b-0df8198cab1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:11.332549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe9d53-e9de-4d7e-96a8-f4d5b25e61a5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:11.382167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f04dc-4403-44a7-b176-3ca1d8371181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:11.383339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f04dc-4403-44a7-b176-3ca1d8371181 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:11.383843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f04dc-4403-44a7-b176-3ca1d8371181 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:11.385013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292f04dc-4403-44a7-b176-3ca1d8371181 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d/groups/9337875cb4004e8aa9d8bba280776c77/roles/d0262ce715f7448babe9cef93dc25e9d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:11.388149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f04dc-4403-44a7-b176-3ca1d8371181 None admin] RBAC: Authorizing `identity:create_grant(project_id=50a4f8b5734d4771ab600161af000c0d, group_id=9337875cb4004e8aa9d8bba280776c77, role_id=d0262ce715f7448babe9cef93dc25e9d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:11.391313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292f04dc-4403-44a7-b176-3ca1d8371181 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:11.396148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:11.417417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 203/415] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Aug 1 11:50:11 2022] PUT /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d/groups/9337875cb4004e8aa9d8bba280776c77/roles/d0262ce715f7448babe9cef93dc25e9d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:50:11.417417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f04dc-4403-44a7-b176-3ca1d8371181 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:11.432593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 213/416] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:11.492990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030b5ac-9fd9-4a87-856b-0df8198cab1e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:11.561971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292f04dc-4403-44a7-b176-3ca1d8371181 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:11.607937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497c6e8-0e57-46e9-817b-1d1db35a2329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:11.608629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497c6e8-0e57-46e9-817b-1d1db35a2329 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:11.608909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497c6e8-0e57-46e9-817b-1d1db35a2329 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:11.609180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497c6e8-0e57-46e9-817b-1d1db35a2329 None admin] PATH_INFO: `/v3/projects/541ab528aad34615a3714dea6d3cccb9/groups/a9c61016f15a4ab08482ec6770ef1249/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:11.613103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497c6e8-0e57-46e9-817b-1d1db35a2329 None admin] RBAC: Authorizing `identity:create_grant(project_id=541ab528aad34615a3714dea6d3cccb9, group_id=a9c61016f15a4ab08482ec6770ef1249, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:11.614627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497c6e8-0e57-46e9-817b-1d1db35a2329 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:11.639233 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 204/417] 10.222.0.42 () {58 vars in 1442 bytes} [Mon Aug 1 11:50:11 2022] PUT /identity/v3/projects/541ab528aad34615a3714dea6d3cccb9/groups/a9c61016f15a4ab08482ec6770ef1249/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:50:11.649454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030b5ac-9fd9-4a87-856b-0df8198cab1e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:11.679662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:11.694248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd52f0-65c0-4541-9dc2-c6580f868a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:11.695333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd52f0-65c0-4541-9dc2-c6580f868a04 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:11.695818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd52f0-65c0-4541-9dc2-c6580f868a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:11.696354 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd52f0-65c0-4541-9dc2-c6580f868a04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:11.709848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd52f0-65c0-4541-9dc2-c6580f868a04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-bbcd52f0-65c0-4541-9dc2-c6580f868a04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:11.715579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:11.716572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:11.717453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:11.717453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:11.717453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:11.717453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:11.717453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:11.717453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:11.717453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:11.717453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:11.717453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:11.717453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:11.717453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:11.717453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:11.720439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 214/418] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:11.726909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497c6e8-0e57-46e9-817b-1d1db35a2329 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:11.795166 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:11.846793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d92a3-3f9f-4724-b805-d8b9bd3e225a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:11.847085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d92a3-3f9f-4724-b805-d8b9bd3e225a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:11.847509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816d92a3-3f9f-4724-b805-d8b9bd3e225a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:11.850418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497c6e8-0e57-46e9-817b-1d1db35a2329 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:11.853407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 215/419] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:11.859013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408c17-6132-41e0-b773-545a71bbc834 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:11.859297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408c17-6132-41e0-b773-545a71bbc834 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:11.859638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f408c17-6132-41e0-b773-545a71bbc834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:11.889575 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0f408c17-6132-41e0-b773-545a71bbc834 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:11.890992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0f408c17-6132-41e0-b773-545a71bbc834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:11.891687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33694b4-7da9-4530-879f-4cd945776fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:11.892709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33694b4-7da9-4530-879f-4cd945776fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:11.893244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33694b4-7da9-4530-879f-4cd945776fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:11.893625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33694b4-7da9-4530-879f-4cd945776fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:11.894423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33694b4-7da9-4530-879f-4cd945776fd7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:11.895645 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33694b4-7da9-4530-879f-4cd945776fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:11.896251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33694b4-7da9-4530-879f-4cd945776fd7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:11.913334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 205/420] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:50:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:11.914861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33694b4-7da9-4530-879f-4cd945776fd7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:11.984075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 216/421] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:12.025968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33694b4-7da9-4530-879f-4cd945776fd7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:12.030739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408c17-6132-41e0-b773-545a71bbc834 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:12.047228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:12.064267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f4ebf-9366-4386-8d62-417ef8268550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:12.064924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f4ebf-9366-4386-8d62-417ef8268550 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:12.065798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f4ebf-9366-4386-8d62-417ef8268550 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:12.066072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f4ebf-9366-4386-8d62-417ef8268550 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:12.137918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f4ebf-9366-4386-8d62-417ef8268550 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:12.139401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f4ebf-9366-4386-8d62-417ef8268550 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:12.247861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 206/422] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 11:50:12.249285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f4ebf-9366-4386-8d62-417ef8268550 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:12.263272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f408c17-6132-41e0-b773-545a71bbc834 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:12.274716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:12.291214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:12.323946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62108fb-1284-470d-accd-13909d20e13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:12.324939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62108fb-1284-470d-accd-13909d20e13c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:12.325469 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62108fb-1284-470d-accd-13909d20e13c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:12.325951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62108fb-1284-470d-accd-13909d20e13c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:12.338719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62108fb-1284-470d-accd-13909d20e13c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d62108fb-1284-470d-accd-13909d20e13c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:12.344823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:12.345696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:12.347036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:12.347036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:12.347036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:12.347036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:12.347036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:12.347036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:12.347036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:12.347036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:12.347036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:12.347036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:12.347036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:12.347036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:12.349745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 217/423] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:50:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:12.358479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62108fb-1284-470d-accd-13909d20e13c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:12.461499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f4ebf-9366-4386-8d62-417ef8268550 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:12.494323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62108fb-1284-470d-accd-13909d20e13c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:12.499275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a61f3-e776-4eb0-b3cd-846c1ead30e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:12.499971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a61f3-e776-4eb0-b3cd-846c1ead30e4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:12.500356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a61f3-e776-4eb0-b3cd-846c1ead30e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:12.500730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a61f3-e776-4eb0-b3cd-846c1ead30e4 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:12.502042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a61f3-e776-4eb0-b3cd-846c1ead30e4 None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:12.503638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22a61f3-e776-4eb0-b3cd-846c1ead30e4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:12.505890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 207/424] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:12 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:12.511103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640e8f-a946-4108-ae59-d6528f6ab78c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:12.511103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640e8f-a946-4108-ae59-d6528f6ab78c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:12.511103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640e8f-a946-4108-ae59-d6528f6ab78c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:12.513261 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 208/425] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:12.514219 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06640e8f-a946-4108-ae59-d6528f6ab78c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:12.545344 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce373a4f-c49c-45f9-b059-e4c1025067b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:12.546533 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce373a4f-c49c-45f9-b059-e4c1025067b5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:12.547071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce373a4f-c49c-45f9-b059-e4c1025067b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:12.547760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce373a4f-c49c-45f9-b059-e4c1025067b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:12.549243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce373a4f-c49c-45f9-b059-e4c1025067b5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:12.550417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce373a4f-c49c-45f9-b059-e4c1025067b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:12.552560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce373a4f-c49c-45f9-b059-e4c1025067b5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:12.564319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 218/426] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:12.565865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba51e4-178d-4c16-8cd4-83a06f34d9ab None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:12.566313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba51e4-178d-4c16-8cd4-83a06f34d9ab None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:12.566749 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba51e4-178d-4c16-8cd4-83a06f34d9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:12.590527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a5ba51e4-178d-4c16-8cd4-83a06f34d9ab None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:12.592027 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a5ba51e4-178d-4c16-8cd4-83a06f34d9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:12.622515 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:12.624603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:12.645629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06640e8f-a946-4108-ae59-d6528f6ab78c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:12.665730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 219/427] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:12.666765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba51e4-178d-4c16-8cd4-83a06f34d9ab None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:12.686498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97187dec-e329-4080-8bec-79043093ce9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:12.687377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97187dec-e329-4080-8bec-79043093ce9d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:12.687800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97187dec-e329-4080-8bec-79043093ce9d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:12.688227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97187dec-e329-4080-8bec-79043093ce9d None admin] PATH_INFO: `/v3/groups/9337875cb4004e8aa9d8bba280776c77` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:12.690399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97187dec-e329-4080-8bec-79043093ce9d None admin] RBAC: Authorizing `identity:get_group(group_id=9337875cb4004e8aa9d8bba280776c77)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:12.692304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97187dec-e329-4080-8bec-79043093ce9d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:12.694378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 209/428] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:12 2022] GET /identity/v3/groups/9337875cb4004e8aa9d8bba280776c77 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:12.700216 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97187dec-e329-4080-8bec-79043093ce9d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:12.811185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba51e4-178d-4c16-8cd4-83a06f34d9ab None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:12.819558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97187dec-e329-4080-8bec-79043093ce9d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:12.857595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43f34a-0626-4f0b-8df7-9218e2e422a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:12.858301 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43f34a-0626-4f0b-8df7-9218e2e422a4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:12.858609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf3f33-b652-4b6c-a452-ea4f7ff57f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:12.858736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43f34a-0626-4f0b-8df7-9218e2e422a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:12.858997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a43f34a-0626-4f0b-8df7-9218e2e422a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:12.859717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf3f33-b652-4b6c-a452-ea4f7ff57f18 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:12.859869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43f34a-0626-4f0b-8df7-9218e2e422a4 None admin] RBAC: Adding query filter params (group.id=9337875cb4004e8aa9d8bba280776c77, role.id=251e50fd870c48f3a02b69587144b7bf, scope.project.id=de598ff4856d4edc9937647ebb5aa468) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:12.860272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43f34a-0626-4f0b-8df7-9218e2e422a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:12.860497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf3f33-b652-4b6c-a452-ea4f7ff57f18 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:12.860944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf3f33-b652-4b6c-a452-ea4f7ff57f18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:12.862453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a43f34a-0626-4f0b-8df7-9218e2e422a4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:12.877331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 210/429] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Aug 1 11:50:12 2022] GET /identity/v3/role_assignments?group.id=9337875cb4004e8aa9d8bba280776c77&scope.project.id=de598ff4856d4edc9937647ebb5aa468&role.id=251e50fd870c48f3a02b69587144b7bf => generated 611 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:12.877331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43f34a-0626-4f0b-8df7-9218e2e422a4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:12.916388 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:12.945748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:13.011520 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf3f33-b652-4b6c-a452-ea4f7ff57f18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:13.013013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf3f33-b652-4b6c-a452-ea4f7ff57f18 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:13.030232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a43f34a-0626-4f0b-8df7-9218e2e422a4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:13.071613 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895fce3-76df-411b-9e6f-18c8c564ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:13.072257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895fce3-76df-411b-9e6f-18c8c564ac03 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:13.072539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895fce3-76df-411b-9e6f-18c8c564ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:13.072815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895fce3-76df-411b-9e6f-18c8c564ac03 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:13.087361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895fce3-76df-411b-9e6f-18c8c564ac03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-4895fce3-76df-411b-9e6f-18c8c564ac03 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:13.093129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:13.094064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:13.094843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 211/430] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:13.101865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895fce3-76df-411b-9e6f-18c8c564ac03 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:13.206617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:13.223831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 220/431] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:13.234391 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf3f33-b652-4b6c-a452-ea4f7ff57f18 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:13.240868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895fce3-76df-411b-9e6f-18c8c564ac03 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:13.282576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00e6e9-9115-4df0-acb4-9b16fcc37271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:13.283452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e6e9-9115-4df0-acb4-9b16fcc37271 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:13.284259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e6e9-9115-4df0-acb4-9b16fcc37271 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:13.285424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da00e6e9-9115-4df0-acb4-9b16fcc37271 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:13.286222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00e6e9-9115-4df0-acb4-9b16fcc37271 None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:13.286533 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00e6e9-9115-4df0-acb4-9b16fcc37271 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:13.287918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da00e6e9-9115-4df0-acb4-9b16fcc37271 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:13.298374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 212/432] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:50:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:13.305113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00e6e9-9115-4df0-acb4-9b16fcc37271 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:13.335998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:13.392089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf3f33-b652-4b6c-a452-ea4f7ff57f18 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:13.441870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ec939-c869-4aaf-b5e6-b69fdfa081e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:13.443164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ec939-c869-4aaf-b5e6-b69fdfa081e9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:13.443653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ec939-c869-4aaf-b5e6-b69fdfa081e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:13.444144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381ec939-c869-4aaf-b5e6-b69fdfa081e9 None admin] PATH_INFO: `/v3/projects/de598ff4856d4edc9937647ebb5aa468` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:13.445619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ec939-c869-4aaf-b5e6-b69fdfa081e9 None admin] RBAC: Authorizing `identity:get_project(project_id=de598ff4856d4edc9937647ebb5aa468)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:13.447756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381ec939-c869-4aaf-b5e6-b69fdfa081e9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:13.450375 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 221/433] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:13 2022] GET /identity/v3/projects/de598ff4856d4edc9937647ebb5aa468 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:13.455753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ec939-c869-4aaf-b5e6-b69fdfa081e9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:13.469458 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da00e6e9-9115-4df0-acb4-9b16fcc37271 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:13.521494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d751cac-544b-4bfa-816f-58311c6d9dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:13.521938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d751cac-544b-4bfa-816f-58311c6d9dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:13.522216 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d751cac-544b-4bfa-816f-58311c6d9dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:13.522484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d751cac-544b-4bfa-816f-58311c6d9dc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:13.535679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:13.597634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381ec939-c869-4aaf-b5e6-b69fdfa081e9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:13.604845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d751cac-544b-4bfa-816f-58311c6d9dc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:13.606334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d751cac-544b-4bfa-816f-58311c6d9dc7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:13.642680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fa01c-2035-4c4d-ab8e-c434220228e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:13.645111 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fa01c-2035-4c4d-ab8e-c434220228e5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:13.645782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fa01c-2035-4c4d-ab8e-c434220228e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:13.646320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fa01c-2035-4c4d-ab8e-c434220228e5 None admin] PATH_INFO: `/v3/groups/9337875cb4004e8aa9d8bba280776c77` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:13.647754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fa01c-2035-4c4d-ab8e-c434220228e5 None admin] RBAC: Authorizing `identity:get_group(group_id=9337875cb4004e8aa9d8bba280776c77)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:13.649807 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12fa01c-2035-4c4d-ab8e-c434220228e5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:13.652859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 222/434] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:13 2022] GET /identity/v3/groups/9337875cb4004e8aa9d8bba280776c77 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:13.658349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fa01c-2035-4c4d-ab8e-c434220228e5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:13.664072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:13.735922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 213/435] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:13.742292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d751cac-544b-4bfa-816f-58311c6d9dc7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:13.787527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fa01c-2035-4c4d-ab8e-c434220228e5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:13.788259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:13.833105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d280d4c-5dec-43e7-9538-26a87251513d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:13.834077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280d4c-5dec-43e7-9538-26a87251513d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:13.834559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280d4c-5dec-43e7-9538-26a87251513d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:13.835033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d280d4c-5dec-43e7-9538-26a87251513d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:13.836023 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d280d4c-5dec-43e7-9538-26a87251513d None admin] RBAC: Adding query filter params (group.id=9337875cb4004e8aa9d8bba280776c77, role.id=d0262ce715f7448babe9cef93dc25e9d, scope.project.id=de598ff4856d4edc9937647ebb5aa468) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:13.836559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d280d4c-5dec-43e7-9538-26a87251513d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:13.838217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d280d4c-5dec-43e7-9538-26a87251513d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:13.844815 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 223/436] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Aug 1 11:50:13 2022] GET /identity/v3/role_assignments?group.id=9337875cb4004e8aa9d8bba280776c77&scope.project.id=de598ff4856d4edc9937647ebb5aa468&role.id=d0262ce715f7448babe9cef93dc25e9d => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:13.860367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d751cac-544b-4bfa-816f-58311c6d9dc7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:13.900677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92408ff0-9e04-40d3-92e6-a2427bab9940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:13.901753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92408ff0-9e04-40d3-92e6-a2427bab9940 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:13.902239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92408ff0-9e04-40d3-92e6-a2427bab9940 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:13.902723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92408ff0-9e04-40d3-92e6-a2427bab9940 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:13.904206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92408ff0-9e04-40d3-92e6-a2427bab9940 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:13.905994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92408ff0-9e04-40d3-92e6-a2427bab9940 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:13.908413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 214/437] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:13 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:13.917423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d280d4c-5dec-43e7-9538-26a87251513d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:13.940973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3c1e5-2e5c-4498-ad5b-96f3ab86e816 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:13.941283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3c1e5-2e5c-4498-ad5b-96f3ab86e816 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:13.941543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3c1e5-2e5c-4498-ad5b-96f3ab86e816 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:13.943062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 215/438] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:13.948219 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad72a01-28ac-464d-a381-466c53d50ccf None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:13.948548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad72a01-28ac-464d-a381-466c53d50ccf None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:13.948772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad72a01-28ac-464d-a381-466c53d50ccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:13.969583 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4ad72a01-28ac-464d-a381-466c53d50ccf None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:13.970784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4ad72a01-28ac-464d-a381-466c53d50ccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:14.005907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:14.049362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 216/439] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:50:14.050254 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6e73f-f64d-491f-bf6c-6c2a9f246dd0 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:14.050534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6e73f-f64d-491f-bf6c-6c2a9f246dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:14.050831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6e73f-f64d-491f-bf6c-6c2a9f246dd0 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:14.052185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 217/440] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:14.053358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d280d4c-5dec-43e7-9538-26a87251513d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:14.057369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106901d9-dc61-45ec-bbca-b9ae5da5b89d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:14.057823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106901d9-dc61-45ec-bbca-b9ae5da5b89d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:14.058267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106901d9-dc61-45ec-bbca-b9ae5da5b89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:14.076933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-106901d9-dc61-45ec-bbca-b9ae5da5b89d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:14.078144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-106901d9-dc61-45ec-bbca-b9ae5da5b89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:14.097810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a70ec-7059-47b6-bf90-68e770235b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:14.098449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a70ec-7059-47b6-bf90-68e770235b1d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:14.098726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a70ec-7059-47b6-bf90-68e770235b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:14.098994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751a70ec-7059-47b6-bf90-68e770235b1d None admin] PATH_INFO: `/v3/groups/9337875cb4004e8aa9d8bba280776c77` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:14.100694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a70ec-7059-47b6-bf90-68e770235b1d None admin] RBAC: Authorizing `identity:get_group(group_id=9337875cb4004e8aa9d8bba280776c77)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:14.102433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751a70ec-7059-47b6-bf90-68e770235b1d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:14.108875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 224/441] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:13 2022] GET /identity/v3/groups/9337875cb4004e8aa9d8bba280776c77 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:14.108875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a70ec-7059-47b6-bf90-68e770235b1d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:14.115014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:14.161328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 218/442] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:50:14.162301 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106901d9-dc61-45ec-bbca-b9ae5da5b89d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:14.223275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751a70ec-7059-47b6-bf90-68e770235b1d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:14.264691 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3fc9f-3fb4-43cd-930c-e74ed871aba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:14.265381 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3fc9f-3fb4-43cd-930c-e74ed871aba3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:14.265674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3fc9f-3fb4-43cd-930c-e74ed871aba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:14.266271 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b3fc9f-3fb4-43cd-930c-e74ed871aba3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:14.268800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:14.278169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b3fc9f-3fb4-43cd-930c-e74ed871aba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-23b3fc9f-3fb4-43cd-930c-e74ed871aba3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:14.283668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:14.284550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 225/443] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:50:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:14.290511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3fc9f-3fb4-43cd-930c-e74ed871aba3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:14.291240 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106901d9-dc61-45ec-bbca-b9ae5da5b89d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:14.323885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f180b1-cd04-4cca-931f-5296b05b17a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:14.324496 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f180b1-cd04-4cca-931f-5296b05b17a8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:14.324770 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f180b1-cd04-4cca-931f-5296b05b17a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:14.325038 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f180b1-cd04-4cca-931f-5296b05b17a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:14.325866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f180b1-cd04-4cca-931f-5296b05b17a8 None admin] RBAC: Adding query filter params (group.id=9337875cb4004e8aa9d8bba280776c77, role.id=251e50fd870c48f3a02b69587144b7bf, scope.project.id=50a4f8b5734d4771ab600161af000c0d) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:14.326173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f180b1-cd04-4cca-931f-5296b05b17a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:14.327607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f180b1-cd04-4cca-931f-5296b05b17a8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:14.333235 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 219/444] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Aug 1 11:50:14 2022] GET /identity/v3/role_assignments?group.id=9337875cb4004e8aa9d8bba280776c77&scope.project.id=50a4f8b5734d4771ab600161af000c0d&role.id=251e50fd870c48f3a02b69587144b7bf => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:14.334023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f180b1-cd04-4cca-931f-5296b05b17a8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:14.378120 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:14.393727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b3fc9f-3fb4-43cd-930c-e74ed871aba3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:14.430497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b73a2-6c2d-4a40-b24c-0c71a22c773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:14.431152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b73a2-6c2d-4a40-b24c-0c71a22c773d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:14.431436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b73a2-6c2d-4a40-b24c-0c71a22c773d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:14.431716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900b73a2-6c2d-4a40-b24c-0c71a22c773d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:14.443562 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900b73a2-6c2d-4a40-b24c-0c71a22c773d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-900b73a2-6c2d-4a40-b24c-0c71a22c773d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:14.450137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:14.451105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:14.451896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 226/445] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:14.457645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b73a2-6c2d-4a40-b24c-0c71a22c773d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:14.460569 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f180b1-cd04-4cca-931f-5296b05b17a8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:14.499802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66f0e7-d147-4682-b644-f1e64d7b1d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:14.500429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66f0e7-d147-4682-b644-f1e64d7b1d33 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:14.501057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66f0e7-d147-4682-b644-f1e64d7b1d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:14.501057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f66f0e7-d147-4682-b644-f1e64d7b1d33 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:14.501724 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66f0e7-d147-4682-b644-f1e64d7b1d33 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:14.502032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66f0e7-d147-4682-b644-f1e64d7b1d33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:14.503968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f66f0e7-d147-4682-b644-f1e64d7b1d33 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:14.514242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 220/446] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:14.520941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66f0e7-d147-4682-b644-f1e64d7b1d33 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:14.522148 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:14.573406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900b73a2-6c2d-4a40-b24c-0c71a22c773d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:14.615205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7e176-58d6-4427-9d03-8065aa00526c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:14.616592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7e176-58d6-4427-9d03-8065aa00526c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:14.617037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7e176-58d6-4427-9d03-8065aa00526c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:14.617359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7e176-58d6-4427-9d03-8065aa00526c None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:14.618074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7e176-58d6-4427-9d03-8065aa00526c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:14.618384 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7e176-58d6-4427-9d03-8065aa00526c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:14.619774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7e176-58d6-4427-9d03-8065aa00526c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:14.629935 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 227/447] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:14.631697 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:14.636069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7e176-58d6-4427-9d03-8065aa00526c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:14.641270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f66f0e7-d147-4682-b644-f1e64d7b1d33 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:14.688462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce1ec2-96b8-4d2c-a7f5-43cedc646a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:14.689517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce1ec2-96b8-4d2c-a7f5-43cedc646a3e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:14.690749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce1ec2-96b8-4d2c-a7f5-43cedc646a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:14.690855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ce1ec2-96b8-4d2c-a7f5-43cedc646a3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:14.742823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7e176-58d6-4427-9d03-8065aa00526c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:14.758654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:14.760051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce1ec2-96b8-4d2c-a7f5-43cedc646a3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:14.761530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ce1ec2-96b8-4d2c-a7f5-43cedc646a3e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:14.779035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a237114-c90e-482c-b298-5429b57a238c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:14.779652 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a237114-c90e-482c-b298-5429b57a238c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:14.779932 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a237114-c90e-482c-b298-5429b57a238c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:14.780206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a237114-c90e-482c-b298-5429b57a238c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:14.846507 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a237114-c90e-482c-b298-5429b57a238c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:14.847967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a237114-c90e-482c-b298-5429b57a238c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:14.850756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:14.858797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 221/448] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 11:50:14.864321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce1ec2-96b8-4d2c-a7f5-43cedc646a3e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:14.946705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 228/449] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 11:50:14.951123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a237114-c90e-482c-b298-5429b57a238c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:14.965275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ce1ec2-96b8-4d2c-a7f5-43cedc646a3e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:14.967303 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:14.999646 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b2fe1-3e01-4b0b-a1e9-216358068976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:15.000275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b2fe1-3e01-4b0b-a1e9-216358068976 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:15.000550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b2fe1-3e01-4b0b-a1e9-216358068976 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:15.000819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b2fe1-3e01-4b0b-a1e9-216358068976 None admin] PATH_INFO: `/v3/projects/50a4f8b5734d4771ab600161af000c0d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:15.001982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b2fe1-3e01-4b0b-a1e9-216358068976 None admin] RBAC: Authorizing `identity:get_project(project_id=50a4f8b5734d4771ab600161af000c0d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:15.003409 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b2fe1-3e01-4b0b-a1e9-216358068976 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:15.005044 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 222/450] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:14 2022] GET /identity/v3/projects/50a4f8b5734d4771ab600161af000c0d => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:15.010385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b2fe1-3e01-4b0b-a1e9-216358068976 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:15.048889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a237114-c90e-482c-b298-5429b57a238c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:15.069419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:15.082692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892905db-69ed-444a-8d42-c2478f65f2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:15.083326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892905db-69ed-444a-8d42-c2478f65f2bb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:15.083606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892905db-69ed-444a-8d42-c2478f65f2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:15.083877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892905db-69ed-444a-8d42-c2478f65f2bb None admin] PATH_INFO: `/v3/projects/541ab528aad34615a3714dea6d3cccb9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:15.085031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892905db-69ed-444a-8d42-c2478f65f2bb None admin] RBAC: Authorizing `identity:get_project(project_id=541ab528aad34615a3714dea6d3cccb9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:15.086516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892905db-69ed-444a-8d42-c2478f65f2bb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:15.088193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 229/451] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:50:14 2022] GET /identity/v3/projects/541ab528aad34615a3714dea6d3cccb9 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:15.094025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892905db-69ed-444a-8d42-c2478f65f2bb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:15.109859 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b2fe1-3e01-4b0b-a1e9-216358068976 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:15.144356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13681b18-fa9e-4a03-a902-bacddb7cab3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:15.144993 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13681b18-fa9e-4a03-a902-bacddb7cab3c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:15.145271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13681b18-fa9e-4a03-a902-bacddb7cab3c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:15.145578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13681b18-fa9e-4a03-a902-bacddb7cab3c None admin] PATH_INFO: `/v3/groups/9337875cb4004e8aa9d8bba280776c77` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:15.146738 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13681b18-fa9e-4a03-a902-bacddb7cab3c None admin] RBAC: Authorizing `identity:get_group(group_id=9337875cb4004e8aa9d8bba280776c77)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:15.148184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13681b18-fa9e-4a03-a902-bacddb7cab3c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:15.149798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 223/452] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:15 2022] GET /identity/v3/groups/9337875cb4004e8aa9d8bba280776c77 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:15.155484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13681b18-fa9e-4a03-a902-bacddb7cab3c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:15.177331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:15.195008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892905db-69ed-444a-8d42-c2478f65f2bb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:15.228965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0cade-eb70-45f0-802d-15d8faa61417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:15.229578 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0cade-eb70-45f0-802d-15d8faa61417 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:15.229858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0cade-eb70-45f0-802d-15d8faa61417 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:15.230131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b0cade-eb70-45f0-802d-15d8faa61417 None admin] PATH_INFO: `/v3/groups/a9c61016f15a4ab08482ec6770ef1249` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:15.231302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0cade-eb70-45f0-802d-15d8faa61417 None admin] RBAC: Authorizing `identity:get_group(group_id=a9c61016f15a4ab08482ec6770ef1249)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:15.232746 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b0cade-eb70-45f0-802d-15d8faa61417 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:15.234353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 230/453] 10.222.0.42 () {56 vars in 1180 bytes} [Mon Aug 1 11:50:15 2022] GET /identity/v3/groups/a9c61016f15a4ab08482ec6770ef1249 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:15.240209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0cade-eb70-45f0-802d-15d8faa61417 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:15.255950 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13681b18-fa9e-4a03-a902-bacddb7cab3c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:15.284583 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:15.291308 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc9f12-49db-4200-925c-2b40d35b6694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:15.291929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc9f12-49db-4200-925c-2b40d35b6694 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:15.292207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc9f12-49db-4200-925c-2b40d35b6694 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:15.292477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc9f12-49db-4200-925c-2b40d35b6694 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:15.293360 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc9f12-49db-4200-925c-2b40d35b6694 None admin] RBAC: Adding query filter params (group.id=9337875cb4004e8aa9d8bba280776c77, role.id=d0262ce715f7448babe9cef93dc25e9d, scope.project.id=50a4f8b5734d4771ab600161af000c0d) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:15.293674 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc9f12-49db-4200-925c-2b40d35b6694 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:15.295427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc9f12-49db-4200-925c-2b40d35b6694 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:15.301677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 224/454] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Aug 1 11:50:15 2022] GET /identity/v3/role_assignments?group.id=9337875cb4004e8aa9d8bba280776c77&scope.project.id=50a4f8b5734d4771ab600161af000c0d&role.id=d0262ce715f7448babe9cef93dc25e9d => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:15.342053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b0cade-eb70-45f0-802d-15d8faa61417 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:15.382506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594d0999-2f61-4548-aebf-4e84f8406dd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:15.383735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d0999-2f61-4548-aebf-4e84f8406dd2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:15.384022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d0999-2f61-4548-aebf-4e84f8406dd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:15.385178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594d0999-2f61-4548-aebf-4e84f8406dd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:15.386048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d0999-2f61-4548-aebf-4e84f8406dd2 None admin] RBAC: Adding query filter params (group.id=a9c61016f15a4ab08482ec6770ef1249, role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=541ab528aad34615a3714dea6d3cccb9) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:15.386364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d0999-2f61-4548-aebf-4e84f8406dd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:15.387850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594d0999-2f61-4548-aebf-4e84f8406dd2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:15.395393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 231/455] 10.222.0.42 () {56 vars in 1376 bytes} [Mon Aug 1 11:50:15 2022] GET /identity/v3/role_assignments?group.id=a9c61016f15a4ab08482ec6770ef1249&scope.project.id=541ab528aad34615a3714dea6d3cccb9&role.id=0195bf688a7e464e8ff594afe80b050e => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:17.798963 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389a1c5-1134-4068-8e32-3869965d442c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:17.800040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389a1c5-1134-4068-8e32-3869965d442c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:17.800115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b389a1c5-1134-4068-8e32-3869965d442c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:17.801747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 225/456] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:17.807278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56fd39-f0f9-4c21-9e06-61089567e51e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:17.807738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56fd39-f0f9-4c21-9e06-61089567e51e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:17.807814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56fd39-f0f9-4c21-9e06-61089567e51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:17.831799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1c56fd39-f0f9-4c21-9e06-61089567e51e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:17.833001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1c56fd39-f0f9-4c21-9e06-61089567e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:17.845515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:17.939631 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 232/457] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:50:17.975245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389a1c5-1134-4068-8e32-3869965d442c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:18.107306 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b389a1c5-1134-4068-8e32-3869965d442c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:18.138651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138dd06-51ec-4ae6-a380-475e1e735ffd None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:18.138968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138dd06-51ec-4ae6-a380-475e1e735ffd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:18.139214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c138dd06-51ec-4ae6-a380-475e1e735ffd None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:18.140902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 233/458] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:18.153317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cfe60-7959-4ff1-a4f3-088441e59696 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:18.153317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cfe60-7959-4ff1-a4f3-088441e59696 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:18.153317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cfe60-7959-4ff1-a4f3-088441e59696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:18.157327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585632a-076c-4e89-9f11-99ac2db6e359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:18.157998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585632a-076c-4e89-9f11-99ac2db6e359 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:18.158276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585632a-076c-4e89-9f11-99ac2db6e359 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:18.158611 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585632a-076c-4e89-9f11-99ac2db6e359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:18.173556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5d6cfe60-7959-4ff1-a4f3-088441e59696 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:18.174797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5d6cfe60-7959-4ff1-a4f3-088441e59696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:18.177146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585632a-076c-4e89-9f11-99ac2db6e359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:18.178830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585632a-076c-4e89-9f11-99ac2db6e359 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-1585632a-076c-4e89-9f11-99ac2db6e359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:18.201492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:18.202426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:18.203262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:18.203262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:18.203262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:18.203262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:18.204236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 226/459] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:18.211194 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585632a-076c-4e89-9f11-99ac2db6e359 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:18.285918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:18.313142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 234/460] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:50:18.321316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b3f0a-0ed3-49da-b3b9-5cfca0a5ca5d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:18.325739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b3f0a-0ed3-49da-b3b9-5cfca0a5ca5d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:18.326018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b3f0a-0ed3-49da-b3b9-5cfca0a5ca5d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:18.327933 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 235/461] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:18 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:18.333687 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85738048-1d65-4772-af77-5b74cd273103 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:18.333964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85738048-1d65-4772-af77-5b74cd273103 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:18.334235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85738048-1d65-4772-af77-5b74cd273103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:18.339760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585632a-076c-4e89-9f11-99ac2db6e359 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:18.358889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-85738048-1d65-4772-af77-5b74cd273103 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:18.360364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-85738048-1d65-4772-af77-5b74cd273103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:18.376922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab7e70-9b3b-4666-b5da-c5ced9b1cfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:18.378101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab7e70-9b3b-4666-b5da-c5ced9b1cfe1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:18.378421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab7e70-9b3b-4666-b5da-c5ced9b1cfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:18.378700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab7e70-9b3b-4666-b5da-c5ced9b1cfe1 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:18.379394 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab7e70-9b3b-4666-b5da-c5ced9b1cfe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:18.379698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab7e70-9b3b-4666-b5da-c5ced9b1cfe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:18.381078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab7e70-9b3b-4666-b5da-c5ced9b1cfe1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:18.395528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 227/462] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:18.396393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab7e70-9b3b-4666-b5da-c5ced9b1cfe1 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:18.445284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 236/463] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:18.446217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85738048-1d65-4772-af77-5b74cd273103 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:18.457527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:18.528361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab7e70-9b3b-4666-b5da-c5ced9b1cfe1 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:18.561684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:18.572061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d46e16-f78d-4dbb-b9ba-d11d213ddf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:18.573098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46e16-f78d-4dbb-b9ba-d11d213ddf19 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:18.573437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46e16-f78d-4dbb-b9ba-d11d213ddf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:18.574410 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d46e16-f78d-4dbb-b9ba-d11d213ddf19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:18.579255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85738048-1d65-4772-af77-5b74cd273103 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:18.591296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d46e16-f78d-4dbb-b9ba-d11d213ddf19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:18.593515 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d46e16-f78d-4dbb-b9ba-d11d213ddf19 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-21d46e16-f78d-4dbb-b9ba-d11d213ddf19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:18.616508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:18.617478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:18.618326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:18.618326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:18.618326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:18.618326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:18.618326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 228/464] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:18.619032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d46e16-f78d-4dbb-b9ba-d11d213ddf19 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:18.624479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253a266-328d-40da-8f6f-651f95b03efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:18.625109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253a266-328d-40da-8f6f-651f95b03efb None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:18.625435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253a266-328d-40da-8f6f-651f95b03efb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:18.625713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253a266-328d-40da-8f6f-651f95b03efb None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:18.626402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253a266-328d-40da-8f6f-651f95b03efb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:18.628367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253a266-328d-40da-8f6f-651f95b03efb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:18.654862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 237/465] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:50:18 2022] POST /identity/v3/users => generated 246 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:50:18.655775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253a266-328d-40da-8f6f-651f95b03efb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:18.755653 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d46e16-f78d-4dbb-b9ba-d11d213ddf19 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:18.755992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:18.810979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e5c17-e6d4-4b2a-9cad-87d57cdffe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:18.811719 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e5c17-e6d4-4b2a-9cad-87d57cdffe26 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:18.812050 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e5c17-e6d4-4b2a-9cad-87d57cdffe26 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:18.812320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e5c17-e6d4-4b2a-9cad-87d57cdffe26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:18.823294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253a266-328d-40da-8f6f-651f95b03efb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:18.826538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e5c17-e6d4-4b2a-9cad-87d57cdffe26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:18.828037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e5c17-e6d4-4b2a-9cad-87d57cdffe26 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-801e5c17-e6d4-4b2a-9cad-87d57cdffe26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:18.848921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:18.849860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:18.850705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:18.850705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:18.850705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:18.850705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:18.853359 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 229/466] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:18.854806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8462de-5cee-4d66-913f-03f2156cdbfd None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:18.855226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8462de-5cee-4d66-913f-03f2156cdbfd None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:18.855497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8462de-5cee-4d66-913f-03f2156cdbfd None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:18.856876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 230/467] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:18.861849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8462de-5cee-4d66-913f-03f2156cdbfd None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:18.873745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfe91f7-eb90-4c64-aaa4-b04462ede1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:18.874300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe91f7-eb90-4c64-aaa4-b04462ede1ab None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:18.874580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe91f7-eb90-4c64-aaa4-b04462ede1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:18.874972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfe91f7-eb90-4c64-aaa4-b04462ede1ab None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:18.875673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe91f7-eb90-4c64-aaa4-b04462ede1ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:18.875976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe91f7-eb90-4c64-aaa4-b04462ede1ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:18.878627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:18.879138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfe91f7-eb90-4c64-aaa4-b04462ede1ab None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:18.895742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 238/468] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:18.897002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ddb23-dbff-40ec-98f6-c10f72628515 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:18.897323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ddb23-dbff-40ec-98f6-c10f72628515 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:18.897619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849ddb23-dbff-40ec-98f6-c10f72628515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:18.920763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-849ddb23-dbff-40ec-98f6-c10f72628515 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:18.922284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-849ddb23-dbff-40ec-98f6-c10f72628515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:18.995340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 239/469] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:19.001317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ddb23-dbff-40ec-98f6-c10f72628515 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:19.001475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8462de-5cee-4d66-913f-03f2156cdbfd None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:19.037446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349e46d-0384-4570-9d7e-d2f032ae269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:19.038075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349e46d-0384-4570-9d7e-d2f032ae269a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:19.038360 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349e46d-0384-4570-9d7e-d2f032ae269a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:19.038633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349e46d-0384-4570-9d7e-d2f032ae269a None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:19.039336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349e46d-0384-4570-9d7e-d2f032ae269a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:19.039631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349e46d-0384-4570-9d7e-d2f032ae269a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:19.042455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349e46d-0384-4570-9d7e-d2f032ae269a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:19.057377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 231/470] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:19.058492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349e46d-0384-4570-9d7e-d2f032ae269a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:19.082092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:19.133989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849ddb23-dbff-40ec-98f6-c10f72628515 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:19.137654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:19.171305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349e46d-0384-4570-9d7e-d2f032ae269a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:19.173567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7aec3-cc42-4a4f-a9f7-e371f4548de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:19.174426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7aec3-cc42-4a4f-a9f7-e371f4548de2 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:19.174879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7aec3-cc42-4a4f-a9f7-e371f4548de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:19.175344 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7aec3-cc42-4a4f-a9f7-e371f4548de2 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:19.176204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7aec3-cc42-4a4f-a9f7-e371f4548de2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:19.178029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad7aec3-cc42-4a4f-a9f7-e371f4548de2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:19.203797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 240/471] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:50:18 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:50:19.204881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7aec3-cc42-4a4f-a9f7-e371f4548de2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:19.234135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920a20b-26c1-44dd-9624-9ff56d59655d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:19.234803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920a20b-26c1-44dd-9624-9ff56d59655d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:19.235085 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920a20b-26c1-44dd-9624-9ff56d59655d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:19.235361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5920a20b-26c1-44dd-9624-9ff56d59655d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:19.258393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920a20b-26c1-44dd-9624-9ff56d59655d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:19.259888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5920a20b-26c1-44dd-9624-9ff56d59655d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-5920a20b-26c1-44dd-9624-9ff56d59655d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:19.290273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:19.291172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:19.292032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:19.292032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:19.292032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:19.292032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:19.295685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 232/472] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:19.303111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920a20b-26c1-44dd-9624-9ff56d59655d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:19.406750 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad7aec3-cc42-4a4f-a9f7-e371f4548de2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:19.418620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:19.451193 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5920a20b-26c1-44dd-9624-9ff56d59655d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:19.457234 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c158e87-900d-4708-b29f-ee51ec2dacff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:19.457916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c158e87-900d-4708-b29f-ee51ec2dacff None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:19.458199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c158e87-900d-4708-b29f-ee51ec2dacff None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:19.459119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c158e87-900d-4708-b29f-ee51ec2dacff None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:19.459119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c158e87-900d-4708-b29f-ee51ec2dacff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:19.460871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c158e87-900d-4708-b29f-ee51ec2dacff None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:19.482754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:19.490392 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 241/473] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:50:19 2022] POST /identity/v3/users => generated 248 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:50:19.491684 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b1be3-df16-41ff-b0de-e4cd4187b06a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:19.491966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b1be3-df16-41ff-b0de-e4cd4187b06a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:19.492236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640b1be3-df16-41ff-b0de-e4cd4187b06a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:19.494779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 242/474] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:19.501333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcc0a8-7da1-428e-89ca-a2ecbbcd746a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:19.501638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcc0a8-7da1-428e-89ca-a2ecbbcd746a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:19.501916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcc0a8-7da1-428e-89ca-a2ecbbcd746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:19.510362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054928-8ee8-445e-9449-3c8ef7e2e99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:19.511402 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054928-8ee8-445e-9449-3c8ef7e2e99e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:19.511913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054928-8ee8-445e-9449-3c8ef7e2e99e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:19.512228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1054928-8ee8-445e-9449-3c8ef7e2e99e None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:19.513028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1054928-8ee8-445e-9449-3c8ef7e2e99e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:19.513387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1054928-8ee8-445e-9449-3c8ef7e2e99e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:19.514898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1054928-8ee8-445e-9449-3c8ef7e2e99e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:19.528357 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e0fcc0a8-7da1-428e-89ca-a2ecbbcd746a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:19.529982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e0fcc0a8-7da1-428e-89ca-a2ecbbcd746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:19.530493 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 233/475] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:19.536280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054928-8ee8-445e-9449-3c8ef7e2e99e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:19.638831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 243/476] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:19.670184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcc0a8-7da1-428e-89ca-a2ecbbcd746a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:19.698197 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1054928-8ee8-445e-9449-3c8ef7e2e99e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:19.739292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771cfa7-bf2e-44bd-93f8-fe7833383b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:19.739916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771cfa7-bf2e-44bd-93f8-fe7833383b28 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:19.740190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771cfa7-bf2e-44bd-93f8-fe7833383b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:19.740457 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771cfa7-bf2e-44bd-93f8-fe7833383b28 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:19.741144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771cfa7-bf2e-44bd-93f8-fe7833383b28 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:19.742633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5771cfa7-bf2e-44bd-93f8-fe7833383b28 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:19.770974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 234/477] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:50:19 2022] POST /identity/v3/users => generated 249 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:50:19.806843 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:19.819238 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcc0a8-7da1-428e-89ca-a2ecbbcd746a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:19.860994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ffd1e-2012-42de-a660-2d77efb316e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:19.861714 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ffd1e-2012-42de-a660-2d77efb316e7 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:19.862002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ffd1e-2012-42de-a660-2d77efb316e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:19.862274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890ffd1e-2012-42de-a660-2d77efb316e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:19.863018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ffd1e-2012-42de-a660-2d77efb316e7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:19.864455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890ffd1e-2012-42de-a660-2d77efb316e7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:19.872981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.sql.core [None req-890ffd1e-2012-42de-a660-2d77efb316e7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 11:50:19.872981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 11:50:19.872981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [parameters: {'id': '449939e912e44258b06391fa4ec9bd1d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 11:50:19.872981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80141) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-890ffd1e-2012-42de-a660-2d77efb316e7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application conn.query(q) Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result.read() Aug 01 11:50:19.891013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return ref.to_dict() Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 11:50:19.891924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application next(self.gen) Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application yield resource Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application next(self.gen) Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise self.value Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application session.commit() Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 11:50:19.892940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.session.flush() Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application compat.raise_( Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 11:50:19.894695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 11:50:19.896029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application conn.query(q) Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result.read() Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 11:50:19.897122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [parameters: {'id': '449939e912e44258b06391fa4ec9bd1d', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:19.899281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 11:50:19.900080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:19.900915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 244/478] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Aug 1 11:50:19 2022] POST /identity/v3/roles => generated 144 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:19.902882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771cfa7-bf2e-44bd-93f8-fe7833383b28 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:19.961004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:20.031677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771cfa7-bf2e-44bd-93f8-fe7833383b28 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:20.068883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae53fc-b239-430b-a77b-5649044c69a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:20.069579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae53fc-b239-430b-a77b-5649044c69a1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:20.069858 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae53fc-b239-430b-a77b-5649044c69a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:20.070128 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae53fc-b239-430b-a77b-5649044c69a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:20.080491 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae53fc-b239-430b-a77b-5649044c69a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-22ae53fc-b239-430b-a77b-5649044c69a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:20.086570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:20.087447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:20.088268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 235/479] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:50:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:20.093984 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ffd1e-2012-42de-a660-2d77efb316e7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:20.207042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890ffd1e-2012-42de-a660-2d77efb316e7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:20.248611 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce22b2d-d107-44ee-8594-cce06eee94fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:20.249242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce22b2d-d107-44ee-8594-cce06eee94fa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:20.249564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce22b2d-d107-44ee-8594-cce06eee94fa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:20.249832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce22b2d-d107-44ee-8594-cce06eee94fa None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:20.250546 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce22b2d-d107-44ee-8594-cce06eee94fa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:20.250845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce22b2d-d107-44ee-8594-cce06eee94fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:20.252284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce22b2d-d107-44ee-8594-cce06eee94fa None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:20.262736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 245/480] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:20.943947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19455f4-e4ad-47fe-9199-ec3be9403742 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:20.944486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19455f4-e4ad-47fe-9199-ec3be9403742 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:20.944486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19455f4-e4ad-47fe-9199-ec3be9403742 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:20.946008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 236/481] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:20.951438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a5707-a2d6-460a-b760-b646915fb625 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:20.951859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a5707-a2d6-460a-b760-b646915fb625 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:20.952039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937a5707-a2d6-460a-b760-b646915fb625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:20.974580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-937a5707-a2d6-460a-b760-b646915fb625 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:20.975764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-937a5707-a2d6-460a-b760-b646915fb625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:20.996027 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:21.063757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 246/482] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:21.113068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19455f4-e4ad-47fe-9199-ec3be9403742 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:21.213156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:21.221591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19455f4-e4ad-47fe-9199-ec3be9403742 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:21.260740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db62f5-d861-4989-9b85-b8812e3a3683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:21.261412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db62f5-d861-4989-9b85-b8812e3a3683 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:21.261739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db62f5-d861-4989-9b85-b8812e3a3683 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:21.262007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86db62f5-d861-4989-9b85-b8812e3a3683 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:21.272935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86db62f5-d861-4989-9b85-b8812e3a3683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-86db62f5-d861-4989-9b85-b8812e3a3683 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:21.277965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:21.278912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:21.279702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 237/483] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:21.286313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a5707-a2d6-460a-b760-b646915fb625 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:21.434165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937a5707-a2d6-460a-b760-b646915fb625 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:21.483149 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfd368-318f-48fc-8373-9714d0ff83eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:21.483693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd368-318f-48fc-8373-9714d0ff83eb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:21.484014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd368-318f-48fc-8373-9714d0ff83eb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:21.484287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dfd368-318f-48fc-8373-9714d0ff83eb None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:21.485006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfd368-318f-48fc-8373-9714d0ff83eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:21.485326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfd368-318f-48fc-8373-9714d0ff83eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:21.486740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dfd368-318f-48fc-8373-9714d0ff83eb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:21.496731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 247/484] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:21.502869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db62f5-d861-4989-9b85-b8812e3a3683 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:21.621205 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86db62f5-d861-4989-9b85-b8812e3a3683 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:21.655394 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a311a7-2d89-43ac-9fac-200f6da9f390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:21.656031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a311a7-2d89-43ac-9fac-200f6da9f390 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:21.656309 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a311a7-2d89-43ac-9fac-200f6da9f390 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:21.656583 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a311a7-2d89-43ac-9fac-200f6da9f390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:21.666983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a311a7-2d89-43ac-9fac-200f6da9f390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:21.668447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a311a7-2d89-43ac-9fac-200f6da9f390 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-77a311a7-2d89-43ac-9fac-200f6da9f390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:21.682509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:21.683338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:21.684172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:21.684172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:21.684172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:21.684172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:21.684172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 238/485] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:21.691510 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfd368-318f-48fc-8373-9714d0ff83eb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:21.713764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:21.775305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b429855-70e0-42ef-901e-b6a18df7a03f None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:21.775632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b429855-70e0-42ef-901e-b6a18df7a03f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:21.775855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b429855-70e0-42ef-901e-b6a18df7a03f None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:21.777191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 239/486] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:50:21.782113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de0dec-819a-4b7e-84b0-7cfdf6838557 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:21.782390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de0dec-819a-4b7e-84b0-7cfdf6838557 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:21.782661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2de0dec-819a-4b7e-84b0-7cfdf6838557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:21.810606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f2de0dec-819a-4b7e-84b0-7cfdf6838557 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:21.811821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f2de0dec-819a-4b7e-84b0-7cfdf6838557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:21.818926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:21.857769 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dfd368-318f-48fc-8373-9714d0ff83eb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:21.895506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9e9e9-b2ba-412e-8352-c43f1097a773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:21.896198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9e9e9-b2ba-412e-8352-c43f1097a773 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:21.896484 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9e9e9-b2ba-412e-8352-c43f1097a773 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:21.896757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff9e9e9-b2ba-412e-8352-c43f1097a773 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:21.897483 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9e9e9-b2ba-412e-8352-c43f1097a773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:21.897794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9e9e9-b2ba-412e-8352-c43f1097a773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:21.899766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff9e9e9-b2ba-412e-8352-c43f1097a773 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:21.913862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 248/487] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:21.918989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9e9e9-b2ba-412e-8352-c43f1097a773 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:21.952026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 240/488] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:50:21.975795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de0dec-819a-4b7e-84b0-7cfdf6838557 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:22.074538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:22.081273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2de0dec-819a-4b7e-84b0-7cfdf6838557 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:22.117633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186839-63b2-4a08-8565-99f0c4b9c7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:22.118339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186839-63b2-4a08-8565-99f0c4b9c7cf None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:22.118614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186839-63b2-4a08-8565-99f0c4b9c7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:22.118883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97186839-63b2-4a08-8565-99f0c4b9c7cf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:22.126919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:22.130846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97186839-63b2-4a08-8565-99f0c4b9c7cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-97186839-63b2-4a08-8565-99f0c4b9c7cf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:22.136543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:22.137455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:22.138255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 241/489] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:22.144276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186839-63b2-4a08-8565-99f0c4b9c7cf None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:22.163478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff9e9e9-b2ba-412e-8352-c43f1097a773 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:22.249528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97186839-63b2-4a08-8565-99f0c4b9c7cf None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:22.257993 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902325ea-8b62-4f26-968d-fae117a2c407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:22.258651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902325ea-8b62-4f26-968d-fae117a2c407 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:22.258931 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902325ea-8b62-4f26-968d-fae117a2c407 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:22.259207 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902325ea-8b62-4f26-968d-fae117a2c407 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:22.278478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902325ea-8b62-4f26-968d-fae117a2c407 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:22.280348 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902325ea-8b62-4f26-968d-fae117a2c407 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:22.292048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04ec49f-9d07-4d4a-b3c8-ea4d00480ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:22.292829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ec49f-9d07-4d4a-b3c8-ea4d00480ffd None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:22.293177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ec49f-9d07-4d4a-b3c8-ea4d00480ffd None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:22.293490 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ec49f-9d07-4d4a-b3c8-ea4d00480ffd None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:22.294220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ec49f-9d07-4d4a-b3c8-ea4d00480ffd None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:22.294523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ec49f-9d07-4d4a-b3c8-ea4d00480ffd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:22.295928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04ec49f-9d07-4d4a-b3c8-ea4d00480ffd None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-902325ea-8b62-4f26-968d-fae117a2c407 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:22.297110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:22.298013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:22.298919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:22.298919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:22.298919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:22.298919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:22.298919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:22.298919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:22.298919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:22.298919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:22.298919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:50:22.298919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:22.301529 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 249/490] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Aug 1 11:50:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 383 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:22.303040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e20088-eaf0-4b4a-ad78-76841ff7fa62 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:22.303513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e20088-eaf0-4b4a-ad78-76841ff7fa62 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:22.304482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e20088-eaf0-4b4a-ad78-76841ff7fa62 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:22.310193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 250/491] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:22.310958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 242/492] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:22.311595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e20088-eaf0-4b4a-ad78-76841ff7fa62 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:22.312204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef9d91-bbf5-4094-8038-61915c7aed7e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:22.312488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef9d91-bbf5-4094-8038-61915c7aed7e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:22.312761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ef9d91-bbf5-4094-8038-61915c7aed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:22.337893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-57ef9d91-bbf5-4094-8038-61915c7aed7e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:22.339080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-57ef9d91-bbf5-4094-8038-61915c7aed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:22.399320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:22.411918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 243/493] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:22.412793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef9d91-bbf5-4094-8038-61915c7aed7e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:22.425916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e20088-eaf0-4b4a-ad78-76841ff7fa62 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:22.457802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:22.464157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc537300-17cb-4d35-b34c-89d7d583c8f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:22.465138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc537300-17cb-4d35-b34c-89d7d583c8f6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:22.465465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc537300-17cb-4d35-b34c-89d7d583c8f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:22.465999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc537300-17cb-4d35-b34c-89d7d583c8f6 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:22.466800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc537300-17cb-4d35-b34c-89d7d583c8f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:22.467262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc537300-17cb-4d35-b34c-89d7d583c8f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:22.468997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc537300-17cb-4d35-b34c-89d7d583c8f6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:22.521006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 251/494] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Aug 1 11:50:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:22.521006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b196e7b-196d-4202-a8d9-7f13a8d5cb53 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:22.521272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ef9d91-bbf5-4094-8038-61915c7aed7e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:22.522025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b196e7b-196d-4202-a8d9-7f13a8d5cb53 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:22.522025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b196e7b-196d-4202-a8d9-7f13a8d5cb53 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:22.522025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 252/495] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:22.522025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b196e7b-196d-4202-a8d9-7f13a8d5cb53 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:22.553218 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6b470-8a59-44cb-ab48-38e583a67af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:22.553884 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b470-8a59-44cb-ab48-38e583a67af5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:22.554163 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b470-8a59-44cb-ab48-38e583a67af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:22.554431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6b470-8a59-44cb-ab48-38e583a67af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:22.564352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6b470-8a59-44cb-ab48-38e583a67af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:22.566395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac6b470-8a59-44cb-ab48-38e583a67af5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-fac6b470-8a59-44cb-ab48-38e583a67af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:22.580665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:22.581737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:22.582829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:22.582829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:22.582829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:22.582829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:22.582829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 244/496] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:22.582829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6b470-8a59-44cb-ab48-38e583a67af5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:22.632000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b196e7b-196d-4202-a8d9-7f13a8d5cb53 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:22.632168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:22.667219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf6f24-a07a-4386-a1e7-0077b9ceecf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:22.667848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6f24-a07a-4386-a1e7-0077b9ceecf8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:22.668128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6f24-a07a-4386-a1e7-0077b9ceecf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:22.668395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf6f24-a07a-4386-a1e7-0077b9ceecf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:22.679402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf6f24-a07a-4386-a1e7-0077b9ceecf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-bedf6f24-a07a-4386-a1e7-0077b9ceecf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:22.684284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:22.685177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:22.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 253/497] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:22.686956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186796b8-3efa-42e7-ae7e-112e295d68fa None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:22.687234 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186796b8-3efa-42e7-ae7e-112e295d68fa None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:22.687983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186796b8-3efa-42e7-ae7e-112e295d68fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:22.701445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6b470-8a59-44cb-ab48-38e583a67af5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:22.704738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-186796b8-3efa-42e7-ae7e-112e295d68fa None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:22.706438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-186796b8-3efa-42e7-ae7e-112e295d68fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:22.743914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e6f5b-2a8b-4fca-bed6-5915a6915782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:22.744806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e6f5b-2a8b-4fca-bed6-5915a6915782 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:22.745975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e6f5b-2a8b-4fca-bed6-5915a6915782 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:22.746263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e6f5b-2a8b-4fca-bed6-5915a6915782 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:22.756882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:22.785341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 254/498] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:22.785341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186796b8-3efa-42e7-ae7e-112e295d68fa None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:22.834997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e6f5b-2a8b-4fca-bed6-5915a6915782 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:22.836508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e6f5b-2a8b-4fca-bed6-5915a6915782 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:22.884771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:22.891270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186796b8-3efa-42e7-ae7e-112e295d68fa None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:22.926364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08db5e-9b42-42e4-b5a3-d10eeadab21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:22.927082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08db5e-9b42-42e4-b5a3-d10eeadab21b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:22.927433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08db5e-9b42-42e4-b5a3-d10eeadab21b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:22.927916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d08db5e-9b42-42e4-b5a3-d10eeadab21b None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:22.928460 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08db5e-9b42-42e4-b5a3-d10eeadab21b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:22.928764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08db5e-9b42-42e4-b5a3-d10eeadab21b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:22.930203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d08db5e-9b42-42e4-b5a3-d10eeadab21b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:22.947551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 255/499] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:22.947551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08db5e-9b42-42e4-b5a3-d10eeadab21b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:22.947816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 245/500] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:22.947816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e6f5b-2a8b-4fca-bed6-5915a6915782 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:22.994974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:23.057821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e6f5b-2a8b-4fca-bed6-5915a6915782 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:23.070553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d08db5e-9b42-42e4-b5a3-d10eeadab21b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:23.092215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adb1f4-f143-4958-8c27-a50d80908d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:23.092845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adb1f4-f143-4958-8c27-a50d80908d92 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.093122 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adb1f4-f143-4958-8c27-a50d80908d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.093436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76adb1f4-f143-4958-8c27-a50d80908d92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.105601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76adb1f4-f143-4958-8c27-a50d80908d92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-76adb1f4-f143-4958-8c27-a50d80908d92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:23.110439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:23.111329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:23.112759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 246/501] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:23.114069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adb1f4-f143-4958-8c27-a50d80908d92 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:23.117428 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:23.123801 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcb252-4464-4587-afb4-6c2ee90610a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:23.124396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcb252-4464-4587-afb4-6c2ee90610a5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.124682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcb252-4464-4587-afb4-6c2ee90610a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.124956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdcb252-4464-4587-afb4-6c2ee90610a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.125713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcb252-4464-4587-afb4-6c2ee90610a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:23.126020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcb252-4464-4587-afb4-6c2ee90610a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:23.127447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdcb252-4464-4587-afb4-6c2ee90610a5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:23.136671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 256/502] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:23.141861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcb252-4464-4587-afb4-6c2ee90610a5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:23.221855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76adb1f4-f143-4958-8c27-a50d80908d92 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:23.254809 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdcb252-4464-4587-afb4-6c2ee90610a5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:23.256337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:23.259554 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd14ee-8dc2-4971-9bfc-e96547563b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:23.260197 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd14ee-8dc2-4971-9bfc-e96547563b8d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.260478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd14ee-8dc2-4971-9bfc-e96547563b8d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.260751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd14ee-8dc2-4971-9bfc-e96547563b8d None admin] PATH_INFO: `/v3/users/glance` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.268455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd14ee-8dc2-4971-9bfc-e96547563b8d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:23.269946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd14ee-8dc2-4971-9bfc-e96547563b8d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-ffdd14ee-8dc2-4971-9bfc-e96547563b8d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:23.282655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:23.284191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:23.285057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:23.285057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:23.285057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:23.285057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:23.285057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:23.285057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:23.285057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:23.285057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:23.285057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 11:50:23.285057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:23.285057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 247/503] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:23 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:23.285660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd14ee-8dc2-4971-9bfc-e96547563b8d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:23.296058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73411c03-3f0f-4725-a778-231aadd1aad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:23.296699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73411c03-3f0f-4725-a778-231aadd1aad5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.296975 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73411c03-3f0f-4725-a778-231aadd1aad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.297583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73411c03-3f0f-4725-a778-231aadd1aad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.308133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73411c03-3f0f-4725-a778-231aadd1aad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:23.309627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73411c03-3f0f-4725-a778-231aadd1aad5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-73411c03-3f0f-4725-a778-231aadd1aad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:23.323869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:23.324850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:23.325753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:23.325753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:23.325753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:23.325753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:23.325753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 257/504] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:23.326330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73411c03-3f0f-4725-a778-231aadd1aad5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:23.349739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:23.386227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd14ee-8dc2-4971-9bfc-e96547563b8d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:23.425287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65e169c-a161-4093-bc1c-4d122e3c5508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:23.426110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e169c-a161-4093-bc1c-4d122e3c5508 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.427413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e169c-a161-4093-bc1c-4d122e3c5508 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.429137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65e169c-a161-4093-bc1c-4d122e3c5508 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.429885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e169c-a161-4093-bc1c-4d122e3c5508 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:23.430189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e169c-a161-4093-bc1c-4d122e3c5508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:23.432694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65e169c-a161-4093-bc1c-4d122e3c5508 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:23.434473 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73411c03-3f0f-4725-a778-231aadd1aad5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:23.440895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 248/505] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:23.442104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31c09c-cb72-45f8-93b6-81f93d30a48c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.442382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31c09c-cb72-45f8-93b6-81f93d30a48c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.442650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d31c09c-cb72-45f8-93b6-81f93d30a48c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.443970 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 249/506] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:23.444512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31c09c-cb72-45f8-93b6-81f93d30a48c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:23.473794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29063f-671e-42da-97f1-b828786b6bfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:23.474421 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29063f-671e-42da-97f1-b828786b6bfa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.474724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29063f-671e-42da-97f1-b828786b6bfa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.474993 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a29063f-671e-42da-97f1-b828786b6bfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.485547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29063f-671e-42da-97f1-b828786b6bfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:23.487025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a29063f-671e-42da-97f1-b828786b6bfa None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0a29063f-671e-42da-97f1-b828786b6bfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:23.501136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:23.502091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:23.502939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:23.502939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:23.502939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:23.502939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:23.502939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 258/507] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:23.503210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29063f-671e-42da-97f1-b828786b6bfa None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:23.511920 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:23.548431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d31c09c-cb72-45f8-93b6-81f93d30a48c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:23.572378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:23.582148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809c0cf-b4db-469f-8cd5-a12bb6e1f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:23.582756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809c0cf-b4db-469f-8cd5-a12bb6e1f41d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.583031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809c0cf-b4db-469f-8cd5-a12bb6e1f41d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.583298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809c0cf-b4db-469f-8cd5-a12bb6e1f41d None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.584082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809c0cf-b4db-469f-8cd5-a12bb6e1f41d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:23.584380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809c0cf-b4db-469f-8cd5-a12bb6e1f41d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:23.585860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809c0cf-b4db-469f-8cd5-a12bb6e1f41d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:23.607688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a29063f-671e-42da-97f1-b828786b6bfa None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:23.624322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 250/508] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Aug 1 11:50:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:23.625141 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809c0cf-b4db-469f-8cd5-a12bb6e1f41d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:23.643231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502ec98-cf6b-488f-b117-944d47175e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:23.643914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502ec98-cf6b-488f-b117-944d47175e59 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.644197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502ec98-cf6b-488f-b117-944d47175e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.644463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502ec98-cf6b-488f-b117-944d47175e59 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.645136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502ec98-cf6b-488f-b117-944d47175e59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:23.645480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502ec98-cf6b-488f-b117-944d47175e59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:23.646871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4502ec98-cf6b-488f-b117-944d47175e59 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:23.658180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 259/509] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:23.658180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba07b5-3159-4879-8360-4b4ae3295514 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.658180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba07b5-3159-4879-8360-4b4ae3295514 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.658180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ba07b5-3159-4879-8360-4b4ae3295514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.677432 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c6ba07b5-3159-4879-8360-4b4ae3295514 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:23.678536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c6ba07b5-3159-4879-8360-4b4ae3295514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:23.727026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809c0cf-b4db-469f-8cd5-a12bb6e1f41d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:23.735641 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:23.744055 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 260/510] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:23.744847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba07b5-3159-4879-8360-4b4ae3295514 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:23.761177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a426-d4ae-4d7a-81cc-39b3977124b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:23.761842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a426-d4ae-4d7a-81cc-39b3977124b6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.762123 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a426-d4ae-4d7a-81cc-39b3977124b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.762389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374a426-d4ae-4d7a-81cc-39b3977124b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.772241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374a426-d4ae-4d7a-81cc-39b3977124b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:23.773749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374a426-d4ae-4d7a-81cc-39b3977124b6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-b374a426-d4ae-4d7a-81cc-39b3977124b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:23.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:23.789244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:23.790579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:23.790579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:23.790579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:23.790579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:23.790579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 251/511] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:23.790579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a426-d4ae-4d7a-81cc-39b3977124b6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:23.826991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:23.858205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ba07b5-3159-4879-8360-4b4ae3295514 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:23.889881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374a426-d4ae-4d7a-81cc-39b3977124b6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:23.891495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0709b-98a7-4cde-acb0-3531f47051b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:23.892109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0709b-98a7-4cde-acb0-3531f47051b5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.892392 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0709b-98a7-4cde-acb0-3531f47051b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.892689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f0709b-98a7-4cde-acb0-3531f47051b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.893411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0709b-98a7-4cde-acb0-3531f47051b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:23.893715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0709b-98a7-4cde-acb0-3531f47051b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:23.895113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f0709b-98a7-4cde-acb0-3531f47051b5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:23.906153 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 261/512] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:23.906926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0709b-98a7-4cde-acb0-3531f47051b5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:23.922332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b3005-7946-4c39-8e12-fad5602cedc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:23.923000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b3005-7946-4c39-8e12-fad5602cedc5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:23.923276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b3005-7946-4c39-8e12-fad5602cedc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:23.923548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b3005-7946-4c39-8e12-fad5602cedc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:23.961180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:23.992335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b3005-7946-4c39-8e12-fad5602cedc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:23.993838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b3005-7946-4c39-8e12-fad5602cedc5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:24.007533 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f0709b-98a7-4cde-acb0-3531f47051b5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:24.026552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:24.040614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487225b-ce05-49a0-a597-8b2e85465c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:24.041253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487225b-ce05-49a0-a597-8b2e85465c9f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:24.041565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487225b-ce05-49a0-a597-8b2e85465c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:24.041839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2487225b-ce05-49a0-a597-8b2e85465c9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:24.048388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487225b-ce05-49a0-a597-8b2e85465c9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:24.050440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2487225b-ce05-49a0-a597-8b2e85465c9f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-2487225b-ce05-49a0-a597-8b2e85465c9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:24.062214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:24.063035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:24.063907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:24.063907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:24.063907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:24.063907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:24.063907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:24.063907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:24.063907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:24.063907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:24.063907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 262/513] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:24.064370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487225b-ce05-49a0-a597-8b2e85465c9f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:24.094182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 252/514] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:24.095020 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b3005-7946-4c39-8e12-fad5602cedc5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:24.169273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2487225b-ce05-49a0-a597-8b2e85465c9f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:24.185510 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:24.195661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b3005-7946-4c39-8e12-fad5602cedc5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:24.204019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379df101-8a1f-4e8a-bd16-e7efdbc3069b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:24.204657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379df101-8a1f-4e8a-bd16-e7efdbc3069b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:24.204938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379df101-8a1f-4e8a-bd16-e7efdbc3069b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:24.205238 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379df101-8a1f-4e8a-bd16-e7efdbc3069b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:24.215653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379df101-8a1f-4e8a-bd16-e7efdbc3069b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:24.217177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379df101-8a1f-4e8a-bd16-e7efdbc3069b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:24.228519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f8af0-972d-4168-b4cf-a166b376121e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:24.229124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f8af0-972d-4168-b4cf-a166b376121e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:24.229432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f8af0-972d-4168-b4cf-a166b376121e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:24.229705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89f8af0-972d-4168-b4cf-a166b376121e None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:24.230384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f8af0-972d-4168-b4cf-a166b376121e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:24.230683 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f8af0-972d-4168-b4cf-a166b376121e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-379df101-8a1f-4e8a-bd16-e7efdbc3069b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:24.231402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:24.232319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:24.233156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:24.233156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:24.233156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:24.233156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:24.233426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89f8af0-972d-4168-b4cf-a166b376121e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:24.233505 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 263/515] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:24.233505 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379df101-8a1f-4e8a-bd16-e7efdbc3069b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:24.235083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:24.246007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 253/516] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:24.246813 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f8af0-972d-4168-b4cf-a166b376121e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:24.333209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379df101-8a1f-4e8a-bd16-e7efdbc3069b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:24.347071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89f8af0-972d-4168-b4cf-a166b376121e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:24.366692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f585b-7de7-4476-990e-d38bc6296ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:24.367316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f585b-7de7-4476-990e-d38bc6296ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:24.367592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f585b-7de7-4476-990e-d38bc6296ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:24.367861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692f585b-7de7-4476-990e-d38bc6296ff6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:24.375101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f585b-7de7-4476-990e-d38bc6296ff6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:24.376553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692f585b-7de7-4476-990e-d38bc6296ff6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:24.381063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ec42d-3bef-4314-8eea-9d14887cb2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:24.381720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ec42d-3bef-4314-8eea-9d14887cb2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:24.381991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ec42d-3bef-4314-8eea-9d14887cb2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:24.382264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8ec42d-3bef-4314-8eea-9d14887cb2f8 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:24.383009 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ec42d-3bef-4314-8eea-9d14887cb2f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:24.383319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ec42d-3bef-4314-8eea-9d14887cb2f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:24.384734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8ec42d-3bef-4314-8eea-9d14887cb2f8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-692f585b-7de7-4476-990e-d38bc6296ff6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:24.387949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:24.388818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:24.389763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:24.389763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:24.389763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:24.389763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:24.389763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:24.389763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:24.389763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:24.389763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:24.389763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 11:50:24.389763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:24.389763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 264/517] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:24.390374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f585b-7de7-4476-990e-d38bc6296ff6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:24.407245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 254/518] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:24.408081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ec42d-3bef-4314-8eea-9d14887cb2f8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:24.418695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:24.463158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:24.490570 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692f585b-7de7-4476-990e-d38bc6296ff6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:24.506433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8ec42d-3bef-4314-8eea-9d14887cb2f8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:24.524029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0974004-c42a-46bc-95ac-d07c3cc7704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:24.524650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0974004-c42a-46bc-95ac-d07c3cc7704e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:24.524925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0974004-c42a-46bc-95ac-d07c3cc7704e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:24.525189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0974004-c42a-46bc-95ac-d07c3cc7704e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:24.535579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0974004-c42a-46bc-95ac-d07c3cc7704e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:24.537044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0974004-c42a-46bc-95ac-d07c3cc7704e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:24.539109 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89709186-1cf3-4325-99e9-245288b5ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:24.539725 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89709186-1cf3-4325-99e9-245288b5ab36 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:24.540005 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89709186-1cf3-4325-99e9-245288b5ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:24.540280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89709186-1cf3-4325-99e9-245288b5ab36 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:24.540965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89709186-1cf3-4325-99e9-245288b5ab36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:24.541272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89709186-1cf3-4325-99e9-245288b5ab36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:24.542667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89709186-1cf3-4325-99e9-245288b5ab36 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e0974004-c42a-46bc-95ac-d07c3cc7704e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:24.550999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:24.552013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:24.553455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:24.553455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:24.553455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:24.553455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:24.553455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 265/519] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:24.554054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0974004-c42a-46bc-95ac-d07c3cc7704e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:24.555707 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 255/520] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:24.556400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89709186-1cf3-4325-99e9-245288b5ab36 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:24.639948 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:24.653991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89709186-1cf3-4325-99e9-245288b5ab36 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:24.660208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0974004-c42a-46bc-95ac-d07c3cc7704e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:24.670464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:24.687546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4eaa2-0445-4c94-82ce-6da6fb7f3318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:24.688148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4eaa2-0445-4c94-82ce-6da6fb7f3318 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:24.688419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4eaa2-0445-4c94-82ce-6da6fb7f3318 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:24.688684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab4eaa2-0445-4c94-82ce-6da6fb7f3318 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:24.690010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4eaa2-0445-4c94-82ce-6da6fb7f3318 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:24.690322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4eaa2-0445-4c94-82ce-6da6fb7f3318 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:24.691750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab4eaa2-0445-4c94-82ce-6da6fb7f3318 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:24.693401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190beb-b879-4e60-9d62-ecca4fa906af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:24.694106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190beb-b879-4e60-9d62-ecca4fa906af None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:24.694456 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190beb-b879-4e60-9d62-ecca4fa906af None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:24.694802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad190beb-b879-4e60-9d62-ecca4fa906af None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:24.702187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad190beb-b879-4e60-9d62-ecca4fa906af None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:24.703616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad190beb-b879-4e60-9d62-ecca4fa906af None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:24.708882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 256/521] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Aug 1 11:50:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:24.709700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4eaa2-0445-4c94-82ce-6da6fb7f3318 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ad190beb-b879-4e60-9d62-ecca4fa906af None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:24.715698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:24.716834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:24.718035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:24.718035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:24.718035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:24.718035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:24.718035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:24.718035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:24.718035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:24.718035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:24.718035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 11:50:24.718035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:24.718035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 266/522] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:24.718035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190beb-b879-4e60-9d62-ecca4fa906af None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:24.811850 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab4eaa2-0445-4c94-82ce-6da6fb7f3318 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:24.815067 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad190beb-b879-4e60-9d62-ecca4fa906af None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:24.844975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19befe-a0c1-45c9-98cd-9fb38531264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:24.845602 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19befe-a0c1-45c9-98cd-9fb38531264c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:24.846455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19befe-a0c1-45c9-98cd-9fb38531264c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:24.846724 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b19befe-a0c1-45c9-98cd-9fb38531264c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:24.847490 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19befe-a0c1-45c9-98cd-9fb38531264c None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=f85279b6b3474c77be0d8d569feea5f2) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:24.847790 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19befe-a0c1-45c9-98cd-9fb38531264c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:24.848735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f27a5b-4cda-4e13-9d04-7e6bfcfd6397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:24.849200 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b19befe-a0c1-45c9-98cd-9fb38531264c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:24.849357 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f27a5b-4cda-4e13-9d04-7e6bfcfd6397 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:24.849638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f27a5b-4cda-4e13-9d04-7e6bfcfd6397 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:24.849909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f27a5b-4cda-4e13-9d04-7e6bfcfd6397 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:24.850587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f27a5b-4cda-4e13-9d04-7e6bfcfd6397 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:24.851175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f27a5b-4cda-4e13-9d04-7e6bfcfd6397 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:24.852528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f27a5b-4cda-4e13-9d04-7e6bfcfd6397 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:24.855268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 257/523] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:24 2022] GET /identity/v3/role_assignments?user.id=f85279b6b3474c77be0d8d569feea5f2&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:24.855442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19befe-a0c1-45c9-98cd-9fb38531264c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:24.863045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:24.869743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 267/524] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:24.871332 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f27a5b-4cda-4e13-9d04-7e6bfcfd6397 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:24.906507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:24.977115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b19befe-a0c1-45c9-98cd-9fb38531264c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:24.986012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f27a5b-4cda-4e13-9d04-7e6bfcfd6397 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:25.014692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957be89-9778-4ce2-b94f-5e425f4e5bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:25.016062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957be89-9778-4ce2-b94f-5e425f4e5bf3 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:25.016062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957be89-9778-4ce2-b94f-5e425f4e5bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:25.016062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8957be89-9778-4ce2-b94f-5e425f4e5bf3 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:25.016863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957be89-9778-4ce2-b94f-5e425f4e5bf3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:25.019041 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8957be89-9778-4ce2-b94f-5e425f4e5bf3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:25.024824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2250e2-ee1e-4de3-9c1d-568b400ea2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:25.025529 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2250e2-ee1e-4de3-9c1d-568b400ea2ce None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:25.025810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2250e2-ee1e-4de3-9c1d-568b400ea2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:25.026078 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2250e2-ee1e-4de3-9c1d-568b400ea2ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:25.040993 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 258/525] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:50:24 2022] POST /identity/v3/users => generated 247 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:50:25.042162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957be89-9778-4ce2-b94f-5e425f4e5bf3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:25.120787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:25.124603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2250e2-ee1e-4de3-9c1d-568b400ea2ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:25.127668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2250e2-ee1e-4de3-9c1d-568b400ea2ce None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:25.168437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:25.179390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8957be89-9778-4ce2-b94f-5e425f4e5bf3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:25.228042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82855f7-28be-4f42-8b0c-1af97015d8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:25.228835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82855f7-28be-4f42-8b0c-1af97015d8e4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:25.229219 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82855f7-28be-4f42-8b0c-1af97015d8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:25.229614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82855f7-28be-4f42-8b0c-1af97015d8e4 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:25.231487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82855f7-28be-4f42-8b0c-1af97015d8e4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:25.231487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82855f7-28be-4f42-8b0c-1af97015d8e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:25.233657 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82855f7-28be-4f42-8b0c-1af97015d8e4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:25.256424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 259/526] 10.222.0.42 () {56 vars in 1139 bytes} [Mon Aug 1 11:50:25 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:25.257975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82855f7-28be-4f42-8b0c-1af97015d8e4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:25.260561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 268/527] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:25.265700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2250e2-ee1e-4de3-9c1d-568b400ea2ce None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:25.367104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:25.369990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2250e2-ee1e-4de3-9c1d-568b400ea2ce None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:25.385512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82855f7-28be-4f42-8b0c-1af97015d8e4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:25.406277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6bbe4-3eac-4635-83e5-8b3eb4bb37a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:25.406897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6bbe4-3eac-4635-83e5-8b3eb4bb37a0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:25.407175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6bbe4-3eac-4635-83e5-8b3eb4bb37a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:25.407449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e6bbe4-3eac-4635-83e5-8b3eb4bb37a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:25.422314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59202e8d-75f3-4ab8-b34b-d4a2e0aef4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:25.423155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59202e8d-75f3-4ab8-b34b-d4a2e0aef4f9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:25.423574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59202e8d-75f3-4ab8-b34b-d4a2e0aef4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:25.424030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59202e8d-75f3-4ab8-b34b-d4a2e0aef4f9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:25.435700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59202e8d-75f3-4ab8-b34b-d4a2e0aef4f9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:25.437360 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59202e8d-75f3-4ab8-b34b-d4a2e0aef4f9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-59202e8d-75f3-4ab8-b34b-d4a2e0aef4f9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:25.450178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:25.451051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:25.451871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:25.451871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:25.451871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:25.451871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:25.451871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:25.451871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:25.451871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:25.451871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:25.459633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 260/528] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:25.460756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59202e8d-75f3-4ab8-b34b-d4a2e0aef4f9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:25.476405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:25.483462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6bbe4-3eac-4635-83e5-8b3eb4bb37a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:25.485154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e6bbe4-3eac-4635-83e5-8b3eb4bb37a0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:25.565125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59202e8d-75f3-4ab8-b34b-d4a2e0aef4f9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:25.589668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:25.598506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 269/529] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:25.598506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6bbe4-3eac-4635-83e5-8b3eb4bb37a0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:25.605125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba352d-4b94-446d-b09c-0cc61f0cc759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:25.606102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba352d-4b94-446d-b09c-0cc61f0cc759 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:25.606580 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba352d-4b94-446d-b09c-0cc61f0cc759 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:25.607060 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bba352d-4b94-446d-b09c-0cc61f0cc759 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:25.620011 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba352d-4b94-446d-b09c-0cc61f0cc759 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:25.621759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bba352d-4b94-446d-b09c-0cc61f0cc759 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-0bba352d-4b94-446d-b09c-0cc61f0cc759 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:25.639696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:25.640556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:25.641418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:25.641418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:25.641418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:25.641418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:25.643329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 261/530] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:25.644290 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba352d-4b94-446d-b09c-0cc61f0cc759 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:25.719545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:25.727517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e6bbe4-3eac-4635-83e5-8b3eb4bb37a0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:25.764528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704ff37-a6aa-455c-94b2-8da5dab17af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:25.765500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704ff37-a6aa-455c-94b2-8da5dab17af3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:25.765973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704ff37-a6aa-455c-94b2-8da5dab17af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:25.766434 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704ff37-a6aa-455c-94b2-8da5dab17af3 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:25.767376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704ff37-a6aa-455c-94b2-8da5dab17af3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:25.768116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704ff37-a6aa-455c-94b2-8da5dab17af3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:25.768255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bba352d-4b94-446d-b09c-0cc61f0cc759 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:25.769914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f704ff37-a6aa-455c-94b2-8da5dab17af3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:25.793054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 270/531] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:25.794264 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704ff37-a6aa-455c-94b2-8da5dab17af3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:25.808268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef753689-9f39-4bd9-a78d-9077e37bd42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:25.809179 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef753689-9f39-4bd9-a78d-9077e37bd42b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:25.809485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef753689-9f39-4bd9-a78d-9077e37bd42b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:25.809760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef753689-9f39-4bd9-a78d-9077e37bd42b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:25.824732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef753689-9f39-4bd9-a78d-9077e37bd42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:25.826876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef753689-9f39-4bd9-a78d-9077e37bd42b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-ef753689-9f39-4bd9-a78d-9077e37bd42b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:25.846887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:25.847739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:25.848568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:25.848568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:25.848568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:25.848568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:25.848568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 262/532] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:25.848844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef753689-9f39-4bd9-a78d-9077e37bd42b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:25.867855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:25.911718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704ff37-a6aa-455c-94b2-8da5dab17af3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:25.952078 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f5c8-e290-43de-91a1-5cfb62a4d496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:25.952699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f5c8-e290-43de-91a1-5cfb62a4d496 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:25.952978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f5c8-e290-43de-91a1-5cfb62a4d496 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:25.953252 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1773f5c8-e290-43de-91a1-5cfb62a4d496 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:25.954524 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773f5c8-e290-43de-91a1-5cfb62a4d496 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:25.954833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773f5c8-e290-43de-91a1-5cfb62a4d496 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:25.956274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1773f5c8-e290-43de-91a1-5cfb62a4d496 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:25.977459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 271/533] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:25.978672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f5c8-e290-43de-91a1-5cfb62a4d496 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:25.988255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef753689-9f39-4bd9-a78d-9077e37bd42b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:26.005155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:26.024527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a0ddd-ed31-448d-ad68-f8c2d869242a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:26.025535 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a0ddd-ed31-448d-ad68-f8c2d869242a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:26.026043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a0ddd-ed31-448d-ad68-f8c2d869242a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:26.026506 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1a0ddd-ed31-448d-ad68-f8c2d869242a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:26.027470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a0ddd-ed31-448d-ad68-f8c2d869242a None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=c358a2d9539c4ae2a5e12aa6f1ed6d61) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:26.027970 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a0ddd-ed31-448d-ad68-f8c2d869242a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:26.029617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1a0ddd-ed31-448d-ad68-f8c2d869242a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:26.036156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 263/534] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:25 2022] GET /identity/v3/role_assignments?user.id=c358a2d9539c4ae2a5e12aa6f1ed6d61&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:26.043739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a0ddd-ed31-448d-ad68-f8c2d869242a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:26.107558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1773f5c8-e290-43de-91a1-5cfb62a4d496 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:26.132556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:26.151206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7e19d-5545-4730-8c10-8149b0b52a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:26.152168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7e19d-5545-4730-8c10-8149b0b52a2d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:26.152739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7e19d-5545-4730-8c10-8149b0b52a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:26.153180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc7e19d-5545-4730-8c10-8149b0b52a2d None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:26.154079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7e19d-5545-4730-8c10-8149b0b52a2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:26.154569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7e19d-5545-4730-8c10-8149b0b52a2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:26.156377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc7e19d-5545-4730-8c10-8149b0b52a2d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:26.171398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 272/535] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:26.177452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7e19d-5545-4730-8c10-8149b0b52a2d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:26.279460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1a0ddd-ed31-448d-ad68-f8c2d869242a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:26.320129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5902b9-ce45-4880-9866-35864a8371e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:26.320803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5902b9-ce45-4880-9866-35864a8371e1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:26.321090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5902b9-ce45-4880-9866-35864a8371e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:26.321396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5902b9-ce45-4880-9866-35864a8371e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:26.329534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5902b9-ce45-4880-9866-35864a8371e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:26.332024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5902b9-ce45-4880-9866-35864a8371e1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-ef5902b9-ce45-4880-9866-35864a8371e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:26.344715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:26.345588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:26.347023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:26.347023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:26.347023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:26.347023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:26.347023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:26.347023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:26.347023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:26.347023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:26.347023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 264/536] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:26.352696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5902b9-ce45-4880-9866-35864a8371e1 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:26.391259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc7e19d-5545-4730-8c10-8149b0b52a2d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:26.405754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:26.464821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5902b9-ce45-4880-9866-35864a8371e1 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:26.504944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fa4c9-28a7-49e3-ad3f-f5599cbccde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:26.505616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa4c9-28a7-49e3-ad3f-f5599cbccde4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:26.505898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa4c9-28a7-49e3-ad3f-f5599cbccde4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:26.506171 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412fa4c9-28a7-49e3-ad3f-f5599cbccde4 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:26.506924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fa4c9-28a7-49e3-ad3f-f5599cbccde4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:26.507230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fa4c9-28a7-49e3-ad3f-f5599cbccde4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:26.508667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412fa4c9-28a7-49e3-ad3f-f5599cbccde4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:26.518532 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09402c-0e9d-491a-9c54-951d74224dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:26.519185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09402c-0e9d-491a-9c54-951d74224dae None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:26.519465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09402c-0e9d-491a-9c54-951d74224dae None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:26.519732 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c09402c-0e9d-491a-9c54-951d74224dae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:26.522370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 265/537] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:26.528048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fa4c9-28a7-49e3-ad3f-f5599cbccde4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:26.546116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09402c-0e9d-491a-9c54-951d74224dae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:26.547680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c09402c-0e9d-491a-9c54-951d74224dae None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-3c09402c-0e9d-491a-9c54-951d74224dae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:26.566478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:26.567351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:26.568265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:26.568265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:26.568265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:26.568265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:26.568265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:26.568265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:26.568265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:26.568265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:26.577741 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 273/538] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 401 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:26.583596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09402c-0e9d-491a-9c54-951d74224dae None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:26.632513 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412fa4c9-28a7-49e3-ad3f-f5599cbccde4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:26.649691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:26.667427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:26.695713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d0e10-f525-43a3-8dee-eb5b21b1f99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:26.696337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d0e10-f525-43a3-8dee-eb5b21b1f99b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:26.696615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d0e10-f525-43a3-8dee-eb5b21b1f99b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:26.696886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d0e10-f525-43a3-8dee-eb5b21b1f99b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:26.698777 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d0e10-f525-43a3-8dee-eb5b21b1f99b None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=00d506205722431ba2995956c7981735) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:26.699086 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d0e10-f525-43a3-8dee-eb5b21b1f99b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:26.701329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d0e10-f525-43a3-8dee-eb5b21b1f99b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:26.712196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 266/539] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:26 2022] GET /identity/v3/role_assignments?user.id=00d506205722431ba2995956c7981735&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:26.772591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c09402c-0e9d-491a-9c54-951d74224dae None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:26.824390 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87be2192-b72f-4100-8854-8a37499090d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:26.825028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be2192-b72f-4100-8854-8a37499090d5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:26.825331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be2192-b72f-4100-8854-8a37499090d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:26.825609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87be2192-b72f-4100-8854-8a37499090d5 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:26.826460 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be2192-b72f-4100-8854-8a37499090d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:26.826773 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be2192-b72f-4100-8854-8a37499090d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:26.828268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87be2192-b72f-4100-8854-8a37499090d5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:26.850066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 274/540] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:26.856128 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d0e10-f525-43a3-8dee-eb5b21b1f99b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:26.968383 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d0e10-f525-43a3-8dee-eb5b21b1f99b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:26.984670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac03da-f25d-4c9f-97dc-3740eed86659 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:26.985289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac03da-f25d-4c9f-97dc-3740eed86659 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:26.985786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ac03da-f25d-4c9f-97dc-3740eed86659 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:26.988128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 275/541] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:26.993199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fbb70-826c-4874-b6d1-babc49903603 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:26.993740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fbb70-826c-4874-b6d1-babc49903603 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:26.994232 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651fbb70-826c-4874-b6d1-babc49903603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:27.005071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4317e-fd3a-4008-b799-598392b32b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:27.005728 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4317e-fd3a-4008-b799-598392b32b6a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:27.006009 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4317e-fd3a-4008-b799-598392b32b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:27.006281 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae4317e-fd3a-4008-b799-598392b32b6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:27.007071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4317e-fd3a-4008-b799-598392b32b6a None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=a2afb18a441549e3b853966ea1ad286e) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:27.007378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4317e-fd3a-4008-b799-598392b32b6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:27.008805 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae4317e-fd3a-4008-b799-598392b32b6a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:27.017323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 267/542] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:26 2022] GET /identity/v3/role_assignments?user.id=a2afb18a441549e3b853966ea1ad286e&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:27.024084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-651fbb70-826c-4874-b6d1-babc49903603 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:27.025240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-651fbb70-826c-4874-b6d1-babc49903603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:27.130676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 276/543] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:27.163493 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4317e-fd3a-4008-b799-598392b32b6a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:27.203421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:27.282204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae4317e-fd3a-4008-b799-598392b32b6a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:27.317509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769c8c32-c53e-4b3f-a72f-cf67f96645bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:27.318157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c8c32-c53e-4b3f-a72f-cf67f96645bc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:27.318438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c8c32-c53e-4b3f-a72f-cf67f96645bc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:27.318709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769c8c32-c53e-4b3f-a72f-cf67f96645bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:27.329485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769c8c32-c53e-4b3f-a72f-cf67f96645bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-769c8c32-c53e-4b3f-a72f-cf67f96645bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:27.335562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:27.336418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:27.337210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 268/544] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:27.344167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fbb70-826c-4874-b6d1-babc49903603 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:27.396970 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:27.474330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e845bc-5aa8-4e24-aa65-dacc95da1bdc None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:27.474962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e845bc-5aa8-4e24-aa65-dacc95da1bdc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:27.475487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e845bc-5aa8-4e24-aa65-dacc95da1bdc None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:27.481148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 269/545] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:27.482631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972088a7-8187-444d-bddb-90da572868c6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:27.483132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972088a7-8187-444d-bddb-90da572868c6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:27.483600 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972088a7-8187-444d-bddb-90da572868c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:27.490428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651fbb70-826c-4874-b6d1-babc49903603 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:27.514883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-972088a7-8187-444d-bddb-90da572868c6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:27.516452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-972088a7-8187-444d-bddb-90da572868c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:27.534539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5168b-194f-4cce-91ec-4e1b232f2a25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:27.535150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5168b-194f-4cce-91ec-4e1b232f2a25 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:27.535473 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5168b-194f-4cce-91ec-4e1b232f2a25 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:27.535744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb5168b-194f-4cce-91ec-4e1b232f2a25 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:27.536478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5168b-194f-4cce-91ec-4e1b232f2a25 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:27.536773 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5168b-194f-4cce-91ec-4e1b232f2a25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:27.538236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb5168b-194f-4cce-91ec-4e1b232f2a25 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:27.556107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 277/546] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:27.570295 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5168b-194f-4cce-91ec-4e1b232f2a25 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:27.622738 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 270/547] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:27.648943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972088a7-8187-444d-bddb-90da572868c6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:27.668409 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:27.725287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb5168b-194f-4cce-91ec-4e1b232f2a25 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:27.729607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:27.766682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b091c-05da-4842-acc3-247a5673cc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:27.767311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b091c-05da-4842-acc3-247a5673cc8f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:27.768099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b091c-05da-4842-acc3-247a5673cc8f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:27.768377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b091c-05da-4842-acc3-247a5673cc8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:27.784399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b091c-05da-4842-acc3-247a5673cc8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:27.785913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64b091c-05da-4842-acc3-247a5673cc8f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-a64b091c-05da-4842-acc3-247a5673cc8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:27.810774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:27.811645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:27.812486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:27.812486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:27.812486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:27.812486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:27.813102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 278/548] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:27.817759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972088a7-8187-444d-bddb-90da572868c6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:27.819897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b091c-05da-4842-acc3-247a5673cc8f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:27.882293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b6511-b190-4698-9190-e155fc366044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:27.882937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b6511-b190-4698-9190-e155fc366044 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:27.883212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b6511-b190-4698-9190-e155fc366044 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:27.883481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b6511-b190-4698-9190-e155fc366044 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:27.906917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b6511-b190-4698-9190-e155fc366044 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-a20b6511-b190-4698-9190-e155fc366044 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:27.912821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:27.913704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:27.915034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:27.915034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:27.915034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:27.915034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:27.915034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:27.915034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:27.915034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:27.915034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:27.915034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:27.915034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:27.915034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:27.915034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:27.916279 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 271/549] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:27.922042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b6511-b190-4698-9190-e155fc366044 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:28.028625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:28.039301 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64b091c-05da-4842-acc3-247a5673cc8f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:28.056370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b6511-b190-4698-9190-e155fc366044 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:28.113656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e6fe-7254-45fe-990c-901269a78672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:28.115206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96311e-7409-44e8-8ae1-bad89334d6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:28.116115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e6fe-7254-45fe-990c-901269a78672 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:28.116933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96311e-7409-44e8-8ae1-bad89334d6de None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:28.117435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e6fe-7254-45fe-990c-901269a78672 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:28.117905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d699e6fe-7254-45fe-990c-901269a78672 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:28.118388 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96311e-7409-44e8-8ae1-bad89334d6de None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:28.119287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699e6fe-7254-45fe-990c-901269a78672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:28.119758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96311e-7409-44e8-8ae1-bad89334d6de None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:28.120664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96311e-7409-44e8-8ae1-bad89334d6de None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:28.121162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699e6fe-7254-45fe-990c-901269a78672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:28.122792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d699e6fe-7254-45fe-990c-901269a78672 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:28.123314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96311e-7409-44e8-8ae1-bad89334d6de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:28.124864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96311e-7409-44e8-8ae1-bad89334d6de None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:28.143328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 272/550] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:28.147397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 279/551] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:28.153678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96311e-7409-44e8-8ae1-bad89334d6de None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:28.155246 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e6fe-7254-45fe-990c-901269a78672 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:28.174222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:28.282699 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96311e-7409-44e8-8ae1-bad89334d6de None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:28.330175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5d798-a603-4efd-b250-91b977a40caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:28.330830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5d798-a603-4efd-b250-91b977a40caf None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:28.331110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5d798-a603-4efd-b250-91b977a40caf None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:28.331385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad5d798-a603-4efd-b250-91b977a40caf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:28.345122 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5d798-a603-4efd-b250-91b977a40caf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:28.347167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad5d798-a603-4efd-b250-91b977a40caf None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:28.355285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-cad5d798-a603-4efd-b250-91b977a40caf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:28.368367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:28.369382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:28.370447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:28.370447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:28.370447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:28.370447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:28.370447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:28.370447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:28.370447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:28.370447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:28.370447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:50:28.370447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:28.377559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 273/552] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Aug 1 11:50:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:28.382460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5d798-a603-4efd-b250-91b977a40caf None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:28.388288 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d699e6fe-7254-45fe-990c-901269a78672 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:28.454425 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f2cfb-0f81-49c3-ad79-b9074084f8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:28.455198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2cfb-0f81-49c3-ad79-b9074084f8fd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:28.455648 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2cfb-0f81-49c3-ad79-b9074084f8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:28.456095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f2cfb-0f81-49c3-ad79-b9074084f8fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:28.478542 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f2cfb-0f81-49c3-ad79-b9074084f8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:28.480087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f2cfb-0f81-49c3-ad79-b9074084f8fd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d61f2cfb-0f81-49c3-ad79-b9074084f8fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:28.506943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:28.508064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:28.509144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:28.509144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:28.509144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:28.509144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:28.509144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 280/553] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:28.515611 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f2cfb-0f81-49c3-ad79-b9074084f8fd None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:28.538661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad5d798-a603-4efd-b250-91b977a40caf None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:28.604665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59fa4c-9c68-4167-bb9d-aa22fd064065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:28.605210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59fa4c-9c68-4167-bb9d-aa22fd064065 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:28.605586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59fa4c-9c68-4167-bb9d-aa22fd064065 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:28.605857 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e59fa4c-9c68-4167-bb9d-aa22fd064065 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:28.606659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59fa4c-9c68-4167-bb9d-aa22fd064065 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:28.606967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59fa4c-9c68-4167-bb9d-aa22fd064065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:28.608395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e59fa4c-9c68-4167-bb9d-aa22fd064065 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:28.647909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 274/554] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Aug 1 11:50:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:28.649659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59fa4c-9c68-4167-bb9d-aa22fd064065 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:28.649855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:28.690413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f2cfb-0f81-49c3-ad79-b9074084f8fd None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:28.722357 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:28.729755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fd5a53-1d6f-429c-88ea-e029908fd63d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:28.730718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd5a53-1d6f-429c-88ea-e029908fd63d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:28.731146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd5a53-1d6f-429c-88ea-e029908fd63d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:28.732038 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fd5a53-1d6f-429c-88ea-e029908fd63d None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:28.733172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd5a53-1d6f-429c-88ea-e029908fd63d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:28.733734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd5a53-1d6f-429c-88ea-e029908fd63d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:28.736410 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fd5a53-1d6f-429c-88ea-e029908fd63d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:28.754559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 281/555] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:28.756785 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f00c1-3cf6-4c51-bb71-6b845495771c None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:28.757282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f00c1-3cf6-4c51-bb71-6b845495771c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:28.757802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f00c1-3cf6-4c51-bb71-6b845495771c None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:28.763934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 282/556] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:28.763934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f00c1-3cf6-4c51-bb71-6b845495771c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:28.782206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e59fa4c-9c68-4167-bb9d-aa22fd064065 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:28.840039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6bd7cc-37a9-4f43-8df7-20b1c7463adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:28.841022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd7cc-37a9-4f43-8df7-20b1c7463adc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:28.841331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd7cc-37a9-4f43-8df7-20b1c7463adc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:28.841611 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6bd7cc-37a9-4f43-8df7-20b1c7463adc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:28.859504 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bd7cc-37a9-4f43-8df7-20b1c7463adc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:28.860911 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6bd7cc-37a9-4f43-8df7-20b1c7463adc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-0b6bd7cc-37a9-4f43-8df7-20b1c7463adc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:28.879474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:28.880444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:28.881827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:28.881827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:28.881827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:28.881827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:28.881827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 275/557] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:28.881827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59887-fbd8-4830-83ce-27985024e8fc None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:28.882162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59887-fbd8-4830-83ce-27985024e8fc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:28.882944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe59887-fbd8-4830-83ce-27985024e8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:28.899497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f00c1-3cf6-4c51-bb71-6b845495771c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:28.905319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-bfe59887-fbd8-4830-83ce-27985024e8fc None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:28.906510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bfe59887-fbd8-4830-83ce-27985024e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:28.919520 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:28.942960 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273d8f7-1740-4539-a746-aaaf47f8cbfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:28.944053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273d8f7-1740-4539-a746-aaaf47f8cbfa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:28.944789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273d8f7-1740-4539-a746-aaaf47f8cbfa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:28.945516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7273d8f7-1740-4539-a746-aaaf47f8cbfa None admin] PATH_INFO: `/v3/users/swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:28.954680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273d8f7-1740-4539-a746-aaaf47f8cbfa None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:28.956727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7273d8f7-1740-4539-a746-aaaf47f8cbfa None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-7273d8f7-1740-4539-a746-aaaf47f8cbfa None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:28.972527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:28.973564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:28.974567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:28.974567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:28.974567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:28.974567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:28.974567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:28.974567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:28.974567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:28.974567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:28.974567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 11:50:28.974567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:28.975115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 283/558] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:28.976515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273d8f7-1740-4539-a746-aaaf47f8cbfa None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:28.996036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 276/559] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:28.996036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe59887-fbd8-4830-83ce-27985024e8fc None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:29.043635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:29.116642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe59887-fbd8-4830-83ce-27985024e8fc None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:29.130708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7273d8f7-1740-4539-a746-aaaf47f8cbfa None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:29.154319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7d0a9-2dc3-42e1-a914-e5901c1fd8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:29.154938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7d0a9-2dc3-42e1-a914-e5901c1fd8cf None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.155211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7d0a9-2dc3-42e1-a914-e5901c1fd8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.155476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d7d0a9-2dc3-42e1-a914-e5901c1fd8cf None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.156267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7d0a9-2dc3-42e1-a914-e5901c1fd8cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:29.156566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7d0a9-2dc3-42e1-a914-e5901c1fd8cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:29.158022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d7d0a9-2dc3-42e1-a914-e5901c1fd8cf None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:29.172353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc6c99-d440-4493-a1a6-b16bab570c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:29.172970 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc6c99-d440-4493-a1a6-b16bab570c29 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.173243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc6c99-d440-4493-a1a6-b16bab570c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.173539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc6c99-d440-4493-a1a6-b16bab570c29 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.174338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc6c99-d440-4493-a1a6-b16bab570c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:29.174634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc6c99-d440-4493-a1a6-b16bab570c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:29.175995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc6c99-d440-4493-a1a6-b16bab570c29 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:29.177363 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 277/560] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Aug 1 11:50:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:29.178427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7d0a9-2dc3-42e1-a914-e5901c1fd8cf None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:29.196263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 284/561] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:29.197869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594945ea-82f3-434a-8487-0f5eec679ec5 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.198222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594945ea-82f3-434a-8487-0f5eec679ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.198592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594945ea-82f3-434a-8487-0f5eec679ec5 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.200280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 285/562] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:29.201041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594945ea-82f3-434a-8487-0f5eec679ec5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:29.239839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:29.289331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:29.289865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d7d0a9-2dc3-42e1-a914-e5901c1fd8cf None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:29.321007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594945ea-82f3-434a-8487-0f5eec679ec5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:29.325802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289f2da-da45-45a0-a3db-f53f47dd78ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:29.326443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289f2da-da45-45a0-a3db-f53f47dd78ca None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.326711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289f2da-da45-45a0-a3db-f53f47dd78ca None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.326981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a289f2da-da45-45a0-a3db-f53f47dd78ca None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.337251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a289f2da-da45-45a0-a3db-f53f47dd78ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-a289f2da-da45-45a0-a3db-f53f47dd78ca None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:29.342126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:29.343036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 278/563] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:29.348957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289f2da-da45-45a0-a3db-f53f47dd78ca None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:29.364193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2ee1e-18c0-4a6e-945a-b8776450dd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:29.364811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2ee1e-18c0-4a6e-945a-b8776450dd81 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.365087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2ee1e-18c0-4a6e-945a-b8776450dd81 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.365395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f2ee1e-18c0-4a6e-945a-b8776450dd81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.432230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2ee1e-18c0-4a6e-945a-b8776450dd81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:29.433763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f2ee1e-18c0-4a6e-945a-b8776450dd81 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:29.446592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a289f2da-da45-45a0-a3db-f53f47dd78ca None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:29.466643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:29.484056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491699ad-a320-4e50-bce0-034f69f84793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:29.484697 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491699ad-a320-4e50-bce0-034f69f84793 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.484974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491699ad-a320-4e50-bce0-034f69f84793 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.485245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491699ad-a320-4e50-bce0-034f69f84793 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.492438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491699ad-a320-4e50-bce0-034f69f84793 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:29.493915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491699ad-a320-4e50-bce0-034f69f84793 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-491699ad-a320-4e50-bce0-034f69f84793 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:29.505633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:29.506561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:29.507474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:29.507474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:29.507474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:29.507474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:29.507474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:29.507474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:29.507474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:29.507474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:29.507474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 279/564] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:29.508103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6e238-f008-48bd-afdc-69245ee59f3f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.508297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6e238-f008-48bd-afdc-69245ee59f3f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.508573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6e238-f008-48bd-afdc-69245ee59f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.525371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-dcb6e238-f008-48bd-afdc-69245ee59f3f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:29.526551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dcb6e238-f008-48bd-afdc-69245ee59f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:29.539216 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:29.542258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 286/565] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:29.543084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2ee1e-18c0-4a6e-945a-b8776450dd81 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:29.597102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 280/566] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:29.598407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15ab7f-0b36-4a84-b814-c68486d3fdf1 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.598689 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15ab7f-0b36-4a84-b814-c68486d3fdf1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.598952 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d15ab7f-0b36-4a84-b814-c68486d3fdf1 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.604297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 281/567] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:29.604297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15ab7f-0b36-4a84-b814-c68486d3fdf1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:29.642121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f2ee1e-18c0-4a6e-945a-b8776450dd81 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:29.678065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cb467-e3ab-4b87-934d-310fe7152f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:29.678668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cb467-e3ab-4b87-934d-310fe7152f19 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.678951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cb467-e3ab-4b87-934d-310fe7152f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.679218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2cb467-e3ab-4b87-934d-310fe7152f19 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.679918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cb467-e3ab-4b87-934d-310fe7152f19 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:29.680218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cb467-e3ab-4b87-934d-310fe7152f19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:29.681624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2cb467-e3ab-4b87-934d-310fe7152f19 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:29.683849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:29.690756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 287/568] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:29.691528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cb467-e3ab-4b87-934d-310fe7152f19 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:29.716931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d15ab7f-0b36-4a84-b814-c68486d3fdf1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:29.750120 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f62747-4b08-454d-8e73-74d30b9d9011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:29.750730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f62747-4b08-454d-8e73-74d30b9d9011 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.751006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f62747-4b08-454d-8e73-74d30b9d9011 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.751274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f62747-4b08-454d-8e73-74d30b9d9011 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.752539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f62747-4b08-454d-8e73-74d30b9d9011 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:29.752839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f62747-4b08-454d-8e73-74d30b9d9011 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:29.754297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f62747-4b08-454d-8e73-74d30b9d9011 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:29.765492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 282/569] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:29.766849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be823b-0ba4-411b-a0bf-d69c11c42b3c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.767233 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be823b-0ba4-411b-a0bf-d69c11c42b3c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.768228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0be823b-0ba4-411b-a0bf-d69c11c42b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.785617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c0be823b-0ba4-411b-a0bf-d69c11c42b3c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:29.786798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c0be823b-0ba4-411b-a0bf-d69c11c42b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:29.788713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:29.792760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2cb467-e3ab-4b87-934d-310fe7152f19 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:29.825820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7226a33-5f80-4940-a066-16dfe809a521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:29.826448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7226a33-5f80-4940-a066-16dfe809a521 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.826732 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7226a33-5f80-4940-a066-16dfe809a521 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.826998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7226a33-5f80-4940-a066-16dfe809a521 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.837864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7226a33-5f80-4940-a066-16dfe809a521 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:29.839320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7226a33-5f80-4940-a066-16dfe809a521 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f7226a33-5f80-4940-a066-16dfe809a521 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:29.853414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:29.854377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:29.855274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:29.855274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:29.855274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:29.855274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:29.855504 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 283/570] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:29.855588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 288/571] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:29.855753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7226a33-5f80-4940-a066-16dfe809a521 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:29.857669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be823b-0ba4-411b-a0bf-d69c11c42b3c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:29.906001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:29.955410 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7226a33-5f80-4940-a066-16dfe809a521 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:29.956255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0be823b-0ba4-411b-a0bf-d69c11c42b3c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:29.989106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05214321-b69d-40a8-9bbe-809bd715fd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:29.989766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05214321-b69d-40a8-9bbe-809bd715fd9d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.990044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05214321-b69d-40a8-9bbe-809bd715fd9d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.990313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05214321-b69d-40a8-9bbe-809bd715fd9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.990795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3abc4c-ba96-4c05-a9c8-6f641301613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:29.991427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3abc4c-ba96-4c05-a9c8-6f641301613b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:29.991704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3abc4c-ba96-4c05-a9c8-6f641301613b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:29.991987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3abc4c-ba96-4c05-a9c8-6f641301613b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:29.998616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:30.000738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05214321-b69d-40a8-9bbe-809bd715fd9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:30.002277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05214321-b69d-40a8-9bbe-809bd715fd9d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:30.002508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3abc4c-ba96-4c05-a9c8-6f641301613b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-7d3abc4c-ba96-4c05-a9c8-6f641301613b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:30.007686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:30.008615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:30.009495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 284/572] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:30.010270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3abc4c-ba96-4c05-a9c8-6f641301613b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-05214321-b69d-40a8-9bbe-809bd715fd9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:30.021945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:30.022824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:30.023705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:30.023705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:30.023705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:30.023705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:30.023705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 289/573] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:30.024016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05214321-b69d-40a8-9bbe-809bd715fd9d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:30.112006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3abc4c-ba96-4c05-a9c8-6f641301613b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:30.124619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05214321-b69d-40a8-9bbe-809bd715fd9d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:30.126253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:30.144943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f56f8-5f0b-4e2f-94f8-cf6fe3d6ef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:30.145637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f56f8-5f0b-4e2f-94f8-cf6fe3d6ef2d None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:30.145974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f56f8-5f0b-4e2f-94f8-cf6fe3d6ef2d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:30.146252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563f56f8-5f0b-4e2f-94f8-cf6fe3d6ef2d None admin] PATH_INFO: `/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/f85279b6b3474c77be0d8d569feea5f2/roles/17e82eb8c8384f43a591d08c9cf1f63e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:30.160102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce04905-9d4f-4be9-a56a-31591405baef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:30.160571 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f56f8-5f0b-4e2f-94f8-cf6fe3d6ef2d None admin] RBAC: Authorizing `identity:create_grant(project_id=99857fcf20fd4cb8b7def2bc2de521bc, user_id=f85279b6b3474c77be0d8d569feea5f2, role_id=17e82eb8c8384f43a591d08c9cf1f63e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:30.160710 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce04905-9d4f-4be9-a56a-31591405baef None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:30.160992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce04905-9d4f-4be9-a56a-31591405baef None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:30.161266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce04905-9d4f-4be9-a56a-31591405baef None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:30.161986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce04905-9d4f-4be9-a56a-31591405baef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:30.162291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce04905-9d4f-4be9-a56a-31591405baef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:30.162553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563f56f8-5f0b-4e2f-94f8-cf6fe3d6ef2d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:30.163640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce04905-9d4f-4be9-a56a-31591405baef None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:30.175286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 285/574] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:50:30 2022] PUT /identity/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/f85279b6b3474c77be0d8d569feea5f2/roles/17e82eb8c8384f43a591d08c9cf1f63e => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:50:30.176129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f56f8-5f0b-4e2f-94f8-cf6fe3d6ef2d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:30.180699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 290/575] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:30.180699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce04905-9d4f-4be9-a56a-31591405baef None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:30.249605 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:30.297544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce04905-9d4f-4be9-a56a-31591405baef None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:30.325096 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563f56f8-5f0b-4e2f-94f8-cf6fe3d6ef2d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:30.340428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6f380-7fe5-4c6d-99f3-b0951958cc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:30.341200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6f380-7fe5-4c6d-99f3-b0951958cc31 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:30.341524 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6f380-7fe5-4c6d-99f3-b0951958cc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:30.341795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b6f380-7fe5-4c6d-99f3-b0951958cc31 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:30.342513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6f380-7fe5-4c6d-99f3-b0951958cc31 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:30.342813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6f380-7fe5-4c6d-99f3-b0951958cc31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:30.344198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b6f380-7fe5-4c6d-99f3-b0951958cc31 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:30.357457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 291/576] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:30.357457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6f380-7fe5-4c6d-99f3-b0951958cc31 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:30.368327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b201929-f2db-4721-915a-b4b89ef58f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:30.368987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b201929-f2db-4721-915a-b4b89ef58f48 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:30.369280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b201929-f2db-4721-915a-b4b89ef58f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:30.369587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b201929-f2db-4721-915a-b4b89ef58f48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:30.379861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b201929-f2db-4721-915a-b4b89ef58f48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:30.381636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-6b201929-f2db-4721-915a-b4b89ef58f48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:30.385265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:30.386188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:30.387049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 286/577] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:30.387731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b201929-f2db-4721-915a-b4b89ef58f48 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:30.461240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b6f380-7fe5-4c6d-99f3-b0951958cc31 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:30.498305 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f64b5d-e7b9-4368-b725-454ee894663b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:30.498926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f64b5d-e7b9-4368-b725-454ee894663b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:30.499201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b201929-f2db-4721-915a-b4b89ef58f48 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:30.499327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f64b5d-e7b9-4368-b725-454ee894663b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:30.499694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f64b5d-e7b9-4368-b725-454ee894663b None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:30.500393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f64b5d-e7b9-4368-b725-454ee894663b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:30.500756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f64b5d-e7b9-4368-b725-454ee894663b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:30.502366 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f64b5d-e7b9-4368-b725-454ee894663b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:30.509372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:30.515051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 292/578] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:30.515977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f64b5d-e7b9-4368-b725-454ee894663b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:30.540180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d6f29-aec4-456e-8b2a-b9fbb12c1c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:30.541160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d6f29-aec4-456e-8b2a-b9fbb12c1c6a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:30.541568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d6f29-aec4-456e-8b2a-b9fbb12c1c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:30.541842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d6f29-aec4-456e-8b2a-b9fbb12c1c6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:30.548671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d6f29-aec4-456e-8b2a-b9fbb12c1c6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:30.550687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d6f29-aec4-456e-8b2a-b9fbb12c1c6a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-632d6f29-aec4-456e-8b2a-b9fbb12c1c6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:30.561931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:30.562807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:30.568425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:30.568425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:30.568425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:30.568425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:30.568425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:30.568425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:30.568425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:30.568425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:30.568425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 287/579] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:30.568425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d6f29-aec4-456e-8b2a-b9fbb12c1c6a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:30.612868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:30.629416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f64b5d-e7b9-4368-b725-454ee894663b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:30.663700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e2b57-c4e9-4009-95c2-f49bbdf7f343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:30.664328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e2b57-c4e9-4009-95c2-f49bbdf7f343 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:30.664608 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e2b57-c4e9-4009-95c2-f49bbdf7f343 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:30.664883 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e2b57-c4e9-4009-95c2-f49bbdf7f343 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:30.675532 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e2b57-c4e9-4009-95c2-f49bbdf7f343 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:30.676135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d6f29-aec4-456e-8b2a-b9fbb12c1c6a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:30.677002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e2b57-c4e9-4009-95c2-f49bbdf7f343 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-782e2b57-c4e9-4009-95c2-f49bbdf7f343 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:30.692790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:30.693952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:30.695034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:30.695034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:30.695034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:30.695034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:30.696568 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 293/580] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:30.697526 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e2b57-c4e9-4009-95c2-f49bbdf7f343 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:30.716777 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a38f3f-3b17-44ef-a006-b87685b47263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:30.717557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a38f3f-3b17-44ef-a006-b87685b47263 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:30.717838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a38f3f-3b17-44ef-a006-b87685b47263 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:30.718105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a38f3f-3b17-44ef-a006-b87685b47263 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:30.718816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a38f3f-3b17-44ef-a006-b87685b47263 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:30.719119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a38f3f-3b17-44ef-a006-b87685b47263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:30.721115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a38f3f-3b17-44ef-a006-b87685b47263 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:30.734940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 288/581] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:30.734940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a38f3f-3b17-44ef-a006-b87685b47263 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:30.768630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:30.807053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e2b57-c4e9-4009-95c2-f49bbdf7f343 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:30.843283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5170cb-8f92-409f-a491-a5a62fbe4891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:30.843922 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5170cb-8f92-409f-a491-a5a62fbe4891 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:30.844201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5170cb-8f92-409f-a491-a5a62fbe4891 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:30.844469 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5170cb-8f92-409f-a491-a5a62fbe4891 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:30.844714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a38f3f-3b17-44ef-a006-b87685b47263 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:30.848481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:30.854206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5170cb-8f92-409f-a491-a5a62fbe4891 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:30.856475 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5170cb-8f92-409f-a491-a5a62fbe4891 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-7a5170cb-8f92-409f-a491-a5a62fbe4891 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:30.869612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:30.870595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:30.871579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:30.871579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:30.871579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:30.871579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:30.871579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:30.871579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:30.871579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:30.871579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:30.871579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 11:50:30.871579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:30.871579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 294/582] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:30 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:30.872165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5170cb-8f92-409f-a491-a5a62fbe4891 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:30.885363 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2820ae-7b30-4940-ba24-79f6d3559646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:30.885988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2820ae-7b30-4940-ba24-79f6d3559646 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:30.886257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2820ae-7b30-4940-ba24-79f6d3559646 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:30.886526 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2820ae-7b30-4940-ba24-79f6d3559646 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:30.887276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2820ae-7b30-4940-ba24-79f6d3559646 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:30.887582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2820ae-7b30-4940-ba24-79f6d3559646 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:30.889009 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2820ae-7b30-4940-ba24-79f6d3559646 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:30.902162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 289/583] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:30.903133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2820ae-7b30-4940-ba24-79f6d3559646 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:30.982499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5170cb-8f92-409f-a491-a5a62fbe4891 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:31.003690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:31.015212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2820ae-7b30-4940-ba24-79f6d3559646 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:31.016863 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cde08-6c42-4b63-8616-d429f9f1ee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:31.018041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cde08-6c42-4b63-8616-d429f9f1ee7b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:31.018323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cde08-6c42-4b63-8616-d429f9f1ee7b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:31.018597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9cde08-6c42-4b63-8616-d429f9f1ee7b None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:31.019350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cde08-6c42-4b63-8616-d429f9f1ee7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:31.019599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cde08-6c42-4b63-8616-d429f9f1ee7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:31.021003 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9cde08-6c42-4b63-8616-d429f9f1ee7b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:31.037765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 295/584] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:31.037765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cde08-6c42-4b63-8616-d429f9f1ee7b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:31.058051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640cd20-0849-4b8b-a5d2-f3d1ba28e662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:31.058883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640cd20-0849-4b8b-a5d2-f3d1ba28e662 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:31.059161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640cd20-0849-4b8b-a5d2-f3d1ba28e662 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:31.059443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d640cd20-0849-4b8b-a5d2-f3d1ba28e662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:31.070285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640cd20-0849-4b8b-a5d2-f3d1ba28e662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:31.071740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d640cd20-0849-4b8b-a5d2-f3d1ba28e662 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d640cd20-0849-4b8b-a5d2-f3d1ba28e662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:31.086225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:31.087366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:31.088466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:31.088466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:31.088466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:31.088466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:31.088466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 290/585] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:31.088466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640cd20-0849-4b8b-a5d2-f3d1ba28e662 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:31.099243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:31.148220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9cde08-6c42-4b63-8616-d429f9f1ee7b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:31.185639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096bd2-cbe3-4d4a-9b78-51f45fe8fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:31.186338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096bd2-cbe3-4d4a-9b78-51f45fe8fd50 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:31.186619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096bd2-cbe3-4d4a-9b78-51f45fe8fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:31.186894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be096bd2-cbe3-4d4a-9b78-51f45fe8fd50 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:31.187744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096bd2-cbe3-4d4a-9b78-51f45fe8fd50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:31.188055 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096bd2-cbe3-4d4a-9b78-51f45fe8fd50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:31.189558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be096bd2-cbe3-4d4a-9b78-51f45fe8fd50 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:31.199944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d640cd20-0849-4b8b-a5d2-f3d1ba28e662 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:31.210720 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 296/586] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Aug 1 11:50:31 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:31.212044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096bd2-cbe3-4d4a-9b78-51f45fe8fd50 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:31.235897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8b022-d907-42f8-b043-2063ad597335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:31.237111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8b022-d907-42f8-b043-2063ad597335 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:31.237412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8b022-d907-42f8-b043-2063ad597335 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:31.237674 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c8b022-d907-42f8-b043-2063ad597335 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:31.238456 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8b022-d907-42f8-b043-2063ad597335 None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=e2dfb83ec65645459d41579b4b036ee5) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:31.238764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8b022-d907-42f8-b043-2063ad597335 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:31.240187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c8b022-d907-42f8-b043-2063ad597335 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:31.245991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 291/587] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:31 2022] GET /identity/v3/role_assignments?user.id=e2dfb83ec65645459d41579b4b036ee5&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:31.246816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8b022-d907-42f8-b043-2063ad597335 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:31.277795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:31.351601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be096bd2-cbe3-4d4a-9b78-51f45fe8fd50 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:31.363340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c8b022-d907-42f8-b043-2063ad597335 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:31.372422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:31.401345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aca341-834e-4d92-a71f-9aee07069d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:31.402056 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aca341-834e-4d92-a71f-9aee07069d8b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:31.402339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aca341-834e-4d92-a71f-9aee07069d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:31.402613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aca341-834e-4d92-a71f-9aee07069d8b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:31.403563 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cbc69-d1d6-4885-bccc-506fccc9b6dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:31.404405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cbc69-d1d6-4885-bccc-506fccc9b6dc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:31.404880 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cbc69-d1d6-4885-bccc-506fccc9b6dc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:31.405391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cbc69-d1d6-4885-bccc-506fccc9b6dc None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:31.406323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cbc69-d1d6-4885-bccc-506fccc9b6dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:31.406814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cbc69-d1d6-4885-bccc-506fccc9b6dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:31.408740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cbc69-d1d6-4885-bccc-506fccc9b6dc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:31.412417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aca341-834e-4d92-a71f-9aee07069d8b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:31.414395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aca341-834e-4d92-a71f-9aee07069d8b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:31.424984 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 292/588] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:31.425861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cbc69-d1d6-4885-bccc-506fccc9b6dc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b2aca341-834e-4d92-a71f-9aee07069d8b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:31.428609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:31.429553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:31.430467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:31.430467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:31.430467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:31.430467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:31.430467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:31.430467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:31.430467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:31.430467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:31.430467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 11:50:31.430467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:31.430467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 297/589] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:31.434966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aca341-834e-4d92-a71f-9aee07069d8b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:31.518242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:31.557756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aca341-834e-4d92-a71f-9aee07069d8b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:31.566150 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cbc69-d1d6-4885-bccc-506fccc9b6dc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:31.595560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de8324-a7c1-4f41-8ff7-1a64b2b4fab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:31.596735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de8324-a7c1-4f41-8ff7-1a64b2b4fab7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:31.597010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de8324-a7c1-4f41-8ff7-1a64b2b4fab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:31.597273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de8324-a7c1-4f41-8ff7-1a64b2b4fab7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:31.606154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de8324-a7c1-4f41-8ff7-1a64b2b4fab7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:31.607719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de8324-a7c1-4f41-8ff7-1a64b2b4fab7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:31.613076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1881f-2701-402e-8b7c-23761b911ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:31.613930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1881f-2701-402e-8b7c-23761b911ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:31.614614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1881f-2701-402e-8b7c-23761b911ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:31.615040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1881f-2701-402e-8b7c-23761b911ad1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-54de8324-a7c1-4f41-8ff7-1a64b2b4fab7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:31.620101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:31.621256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:31.622482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:31.622482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:31.622482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:31.622482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:31.622482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:31.622482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:31.622482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:31.622482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:31.622482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 11:50:31.622482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:31.627855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 298/590] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:31 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:31.628872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de8324-a7c1-4f41-8ff7-1a64b2b4fab7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:31.629527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1881f-2701-402e-8b7c-23761b911ad1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:31.631142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1881f-2701-402e-8b7c-23761b911ad1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-1bd1881f-2701-402e-8b7c-23761b911ad1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:31.655927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:31.657084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:31.658156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:31.658156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:31.658156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:31.658156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:31.663746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 293/591] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:31.664614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1881f-2701-402e-8b7c-23761b911ad1 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:31.670495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:31.752771 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de8324-a7c1-4f41-8ff7-1a64b2b4fab7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:31.787466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1881f-2701-402e-8b7c-23761b911ad1 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:31.791965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61a54b-4832-483f-8507-a4582e094256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:31.792822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61a54b-4832-483f-8507-a4582e094256 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:31.793354 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61a54b-4832-483f-8507-a4582e094256 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:31.793862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61a54b-4832-483f-8507-a4582e094256 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:31.795279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61a54b-4832-483f-8507-a4582e094256 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:31.795795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61a54b-4832-483f-8507-a4582e094256 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:31.797832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61a54b-4832-483f-8507-a4582e094256 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:31.806206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:31.823000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 299/592] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Aug 1 11:50:31 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:31.824138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61a54b-4832-483f-8507-a4582e094256 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:31.830415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e023-7302-4d2b-873b-c88e323a4bfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:31.831041 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e023-7302-4d2b-873b-c88e323a4bfe None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:31.831318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e023-7302-4d2b-873b-c88e323a4bfe None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:31.831591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412e023-7302-4d2b-873b-c88e323a4bfe None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:31.832395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e023-7302-4d2b-873b-c88e323a4bfe None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:31.832703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e023-7302-4d2b-873b-c88e323a4bfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:31.834168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412e023-7302-4d2b-873b-c88e323a4bfe None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:31.858878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 294/593] 10.222.0.42 () {56 vars in 1139 bytes} [Mon Aug 1 11:50:31 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:31.860049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e023-7302-4d2b-873b-c88e323a4bfe None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:31.937029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:31.948394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61a54b-4832-483f-8507-a4582e094256 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:31.987395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9618796-aab9-4694-a614-91ef54b28f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:31.988043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9618796-aab9-4694-a614-91ef54b28f0a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:31.988322 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9618796-aab9-4694-a614-91ef54b28f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:31.988591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9618796-aab9-4694-a614-91ef54b28f0a None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:31.989372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9618796-aab9-4694-a614-91ef54b28f0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:31.989677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9618796-aab9-4694-a614-91ef54b28f0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:31.991333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9618796-aab9-4694-a614-91ef54b28f0a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:31.997900 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412e023-7302-4d2b-873b-c88e323a4bfe None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:32.004963 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 300/594] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:32.005913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9618796-aab9-4694-a614-91ef54b28f0a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:32.045038 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b494c81-ee08-4d12-a757-4bbc478ef189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:32.046044 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b494c81-ee08-4d12-a757-4bbc478ef189 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:32.046552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b494c81-ee08-4d12-a757-4bbc478ef189 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:32.047026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b494c81-ee08-4d12-a757-4bbc478ef189 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:32.060815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b494c81-ee08-4d12-a757-4bbc478ef189 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:32.064916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b494c81-ee08-4d12-a757-4bbc478ef189 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-6b494c81-ee08-4d12-a757-4bbc478ef189 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:32.086587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:32.087492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:32.088411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:32.088411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:32.088411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:32.088411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:32.090703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 295/595] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:32.091658 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b494c81-ee08-4d12-a757-4bbc478ef189 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:32.122293 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9618796-aab9-4694-a614-91ef54b28f0a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:32.132052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:32.169503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdabdf-3148-45c6-989d-31b5ed4610fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:32.170282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdabdf-3148-45c6-989d-31b5ed4610fe None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:32.170566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdabdf-3148-45c6-989d-31b5ed4610fe None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:32.170844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdabdf-3148-45c6-989d-31b5ed4610fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:32.184401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdabdf-3148-45c6-989d-31b5ed4610fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:32.186416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbdabdf-3148-45c6-989d-31b5ed4610fe None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-7dbdabdf-3148-45c6-989d-31b5ed4610fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:32.207600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:32.208541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:32.209459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:32.209459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:32.209459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:32.209459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:32.213484 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 301/596] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:32.214476 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdabdf-3148-45c6-989d-31b5ed4610fe None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:32.216094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b494c81-ee08-4d12-a757-4bbc478ef189 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:32.218346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:32.254938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82ec26-2020-42af-b979-47fe0317ad9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:32.255586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82ec26-2020-42af-b979-47fe0317ad9d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:32.255864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82ec26-2020-42af-b979-47fe0317ad9d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:32.256139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d82ec26-2020-42af-b979-47fe0317ad9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:32.262929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82ec26-2020-42af-b979-47fe0317ad9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:32.264361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d82ec26-2020-42af-b979-47fe0317ad9d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-9d82ec26-2020-42af-b979-47fe0317ad9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:32.275731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:32.276650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:32.278389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:32.278389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:32.278389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:32.278389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:32.278389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:32.278389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:32.278389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:32.278389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:32.278389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 296/597] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:32.278389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82ec26-2020-42af-b979-47fe0317ad9d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:32.336498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbdabdf-3148-45c6-989d-31b5ed4610fe None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:32.373562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:32.374111 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e35d2-7d27-4af4-b9cd-f63ffbd1e82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:32.374890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e35d2-7d27-4af4-b9cd-f63ffbd1e82c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:32.375180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e35d2-7d27-4af4-b9cd-f63ffbd1e82c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:32.375578 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e35d2-7d27-4af4-b9cd-f63ffbd1e82c None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:32.376346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e35d2-7d27-4af4-b9cd-f63ffbd1e82c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:32.376715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e35d2-7d27-4af4-b9cd-f63ffbd1e82c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:32.378732 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e35d2-7d27-4af4-b9cd-f63ffbd1e82c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:32.387888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d82ec26-2020-42af-b979-47fe0317ad9d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:32.396848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 302/598] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:32.398299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b9c1d-4f16-4c0a-b6ac-2c806386587e None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:32.398299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b9c1d-4f16-4c0a-b6ac-2c806386587e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:32.398525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b9c1d-4f16-4c0a-b6ac-2c806386587e None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:32.400010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 303/599] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:32.400709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b9c1d-4f16-4c0a-b6ac-2c806386587e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:32.427732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695da139-881b-4471-b051-f550d89774df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:32.428356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695da139-881b-4471-b051-f550d89774df None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:32.428639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695da139-881b-4471-b051-f550d89774df None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:32.428915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695da139-881b-4471-b051-f550d89774df None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:32.429640 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695da139-881b-4471-b051-f550d89774df None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:32.429942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695da139-881b-4471-b051-f550d89774df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:32.431321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695da139-881b-4471-b051-f550d89774df None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:32.452113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 297/600] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:32.452113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695da139-881b-4471-b051-f550d89774df None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:32.469908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:32.514274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b9c1d-4f16-4c0a-b6ac-2c806386587e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:32.550326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bb3683-8cb9-4809-b252-a4f31def64e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:32.550945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb3683-8cb9-4809-b252-a4f31def64e2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:32.551227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb3683-8cb9-4809-b252-a4f31def64e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:32.551500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bb3683-8cb9-4809-b252-a4f31def64e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:32.552249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb3683-8cb9-4809-b252-a4f31def64e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:32.552560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb3683-8cb9-4809-b252-a4f31def64e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:32.554048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bb3683-8cb9-4809-b252-a4f31def64e2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:32.557537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695da139-881b-4471-b051-f550d89774df None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:32.566144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 304/601] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:32.567289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9992a-ac77-4c11-8b41-7ada612d5582 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:32.567579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9992a-ac77-4c11-8b41-7ada612d5582 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:32.567856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9992a-ac77-4c11-8b41-7ada612d5582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:32.585441 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9fe9992a-ac77-4c11-8b41-7ada612d5582 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:32.586628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9fe9992a-ac77-4c11-8b41-7ada612d5582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:32.598416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883bb37-0ae5-45e7-a7a7-8cfb151a74b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:32.599054 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883bb37-0ae5-45e7-a7a7-8cfb151a74b5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:32.599376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883bb37-0ae5-45e7-a7a7-8cfb151a74b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:32.599598 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f883bb37-0ae5-45e7-a7a7-8cfb151a74b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:32.607005 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883bb37-0ae5-45e7-a7a7-8cfb151a74b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:32.608445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f883bb37-0ae5-45e7-a7a7-8cfb151a74b5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-f883bb37-0ae5-45e7-a7a7-8cfb151a74b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:32.620131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:32.621024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:32.622212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:32.622212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:32.622212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:32.622212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:32.622212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:32.622212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:32.622212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:32.622212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:32.622212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 298/602] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:32.622212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883bb37-0ae5-45e7-a7a7-8cfb151a74b5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:32.633566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:32.673465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 305/603] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:32.676131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9992a-ac77-4c11-8b41-7ada612d5582 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:32.740578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f883bb37-0ae5-45e7-a7a7-8cfb151a74b5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:32.744367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:32.775032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a296f-a53a-4dbd-bdeb-fc27cb2bd5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:32.776045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a296f-a53a-4dbd-bdeb-fc27cb2bd5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:32.776532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a296f-a53a-4dbd-bdeb-fc27cb2bd5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:32.777070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a296f-a53a-4dbd-bdeb-fc27cb2bd5e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:32.784651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a296f-a53a-4dbd-bdeb-fc27cb2bd5e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:32.786255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06a296f-a53a-4dbd-bdeb-fc27cb2bd5e2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:32.793869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe9992a-ac77-4c11-8b41-7ada612d5582 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-e06a296f-a53a-4dbd-bdeb-fc27cb2bd5e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:32.799916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:32.800792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:32.801769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:32.801769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:32.801769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:32.801769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:32.801769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:32.801769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:32.801769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:32.801769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:32.801769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 299/604] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:32.802255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a296f-a53a-4dbd-bdeb-fc27cb2bd5e2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:32.836705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504392ad-029a-4ffd-93e6-ef0e9325d33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:32.837405 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504392ad-029a-4ffd-93e6-ef0e9325d33d None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:32.837689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504392ad-029a-4ffd-93e6-ef0e9325d33d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:32.837964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504392ad-029a-4ffd-93e6-ef0e9325d33d None admin] PATH_INFO: `/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/c358a2d9539c4ae2a5e12aa6f1ed6d61/roles/17e82eb8c8384f43a591d08c9cf1f63e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:32.854275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504392ad-029a-4ffd-93e6-ef0e9325d33d None admin] RBAC: Authorizing `identity:create_grant(project_id=99857fcf20fd4cb8b7def2bc2de521bc, user_id=c358a2d9539c4ae2a5e12aa6f1ed6d61, role_id=17e82eb8c8384f43a591d08c9cf1f63e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:32.855679 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504392ad-029a-4ffd-93e6-ef0e9325d33d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:32.869902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 306/605] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:50:32 2022] PUT /identity/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/c358a2d9539c4ae2a5e12aa6f1ed6d61/roles/17e82eb8c8384f43a591d08c9cf1f63e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:50:32.870709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504392ad-029a-4ffd-93e6-ef0e9325d33d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:32.885735 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:32.950169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a296f-a53a-4dbd-bdeb-fc27cb2bd5e2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:32.990618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4a533-ffba-4e83-8848-17965f12e92e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:32.991283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4a533-ffba-4e83-8848-17965f12e92e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:32.991564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4a533-ffba-4e83-8848-17965f12e92e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:32.991837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4a533-ffba-4e83-8848-17965f12e92e None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:32.993175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4a533-ffba-4e83-8848-17965f12e92e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:32.993175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4a533-ffba-4e83-8848-17965f12e92e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:32.994560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4a533-ffba-4e83-8848-17965f12e92e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:33.013161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 300/606] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:33.013161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4a533-ffba-4e83-8848-17965f12e92e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:33.014761 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504392ad-029a-4ffd-93e6-ef0e9325d33d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:33.019715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:33.063704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155929a5-9950-48c5-aba4-5138ecc23f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:33.063704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155929a5-9950-48c5-aba4-5138ecc23f74 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:33.063704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155929a5-9950-48c5-aba4-5138ecc23f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:33.063704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155929a5-9950-48c5-aba4-5138ecc23f74 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:33.075753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155929a5-9950-48c5-aba4-5138ecc23f74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-155929a5-9950-48c5-aba4-5138ecc23f74 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:33.083639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:33.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:33.085871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 307/607] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:33.086647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155929a5-9950-48c5-aba4-5138ecc23f74 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:33.131564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4a533-ffba-4e83-8848-17965f12e92e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:33.160009 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:33.169719 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6949c-9a08-4f33-9355-68c8d570e352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:33.170337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6949c-9a08-4f33-9355-68c8d570e352 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:33.170612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6949c-9a08-4f33-9355-68c8d570e352 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:33.170878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6949c-9a08-4f33-9355-68c8d570e352 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:33.171619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6949c-9a08-4f33-9355-68c8d570e352 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:33.171915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6949c-9a08-4f33-9355-68c8d570e352 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:33.173346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6949c-9a08-4f33-9355-68c8d570e352 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:33.185196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 301/608] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:33.186316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6949c-9a08-4f33-9355-68c8d570e352 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:33.227580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155929a5-9950-48c5-aba4-5138ecc23f74 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:33.275000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9f912-0d5c-4885-a994-e87f85e47a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:33.275709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9f912-0d5c-4885-a994-e87f85e47a40 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:33.276402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9f912-0d5c-4885-a994-e87f85e47a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:33.276682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e9f912-0d5c-4885-a994-e87f85e47a40 None admin] PATH_INFO: `/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/00d506205722431ba2995956c7981735/roles/17e82eb8c8384f43a591d08c9cf1f63e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:33.297335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9f912-0d5c-4885-a994-e87f85e47a40 None admin] RBAC: Authorizing `identity:create_grant(project_id=99857fcf20fd4cb8b7def2bc2de521bc, user_id=00d506205722431ba2995956c7981735, role_id=17e82eb8c8384f43a591d08c9cf1f63e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:33.299950 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e9f912-0d5c-4885-a994-e87f85e47a40 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:33.301625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6949c-9a08-4f33-9355-68c8d570e352 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:33.319538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 308/609] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:50:33 2022] PUT /identity/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/00d506205722431ba2995956c7981735/roles/17e82eb8c8384f43a591d08c9cf1f63e => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:50:33.320469 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9f912-0d5c-4885-a994-e87f85e47a40 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:33.344367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:33.348419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92a31b-7c93-46f5-91d5-972959bd0ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:33.349243 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92a31b-7c93-46f5-91d5-972959bd0ed9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:33.349716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92a31b-7c93-46f5-91d5-972959bd0ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:33.350028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92a31b-7c93-46f5-91d5-972959bd0ed9 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:33.351915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92a31b-7c93-46f5-91d5-972959bd0ed9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:33.352225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92a31b-7c93-46f5-91d5-972959bd0ed9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:33.353659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92a31b-7c93-46f5-91d5-972959bd0ed9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:33.363639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 302/610] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:33.365091 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514730ff-2b5d-4b54-a079-a6f1448c4048 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:33.365404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514730ff-2b5d-4b54-a079-a6f1448c4048 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:33.365677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514730ff-2b5d-4b54-a079-a6f1448c4048 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:33.367298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 303/611] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:33.372904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff31bf6-9067-4cc2-8764-84767af5f517 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:33.373436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff31bf6-9067-4cc2-8764-84767af5f517 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:33.373784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff31bf6-9067-4cc2-8764-84767af5f517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:33.394940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2ff31bf6-9067-4cc2-8764-84767af5f517 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:33.396523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2ff31bf6-9067-4cc2-8764-84767af5f517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:33.450296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:33.471248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e9f912-0d5c-4885-a994-e87f85e47a40 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:33.480996 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 304/612] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 11:50:33.482384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff31bf6-9067-4cc2-8764-84767af5f517 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:33.512551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643b321-6be3-41fa-a93a-b285c1d41cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:33.513231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643b321-6be3-41fa-a93a-b285c1d41cf4 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:33.513544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643b321-6be3-41fa-a93a-b285c1d41cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:33.513942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7643b321-6be3-41fa-a93a-b285c1d41cf4 None admin] PATH_INFO: `/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/a2afb18a441549e3b853966ea1ad286e/roles/17e82eb8c8384f43a591d08c9cf1f63e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:33.529750 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643b321-6be3-41fa-a93a-b285c1d41cf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=99857fcf20fd4cb8b7def2bc2de521bc, user_id=a2afb18a441549e3b853966ea1ad286e, role_id=17e82eb8c8384f43a591d08c9cf1f63e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:33.531270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7643b321-6be3-41fa-a93a-b285c1d41cf4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:33.550844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 309/613] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:50:33 2022] PUT /identity/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/a2afb18a441549e3b853966ea1ad286e/roles/17e82eb8c8384f43a591d08c9cf1f63e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:50:33.551665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643b321-6be3-41fa-a93a-b285c1d41cf4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:33.642594 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:33.643452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff31bf6-9067-4cc2-8764-84767af5f517 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:33.686794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4973f-b7c3-4b34-bca2-da894f090a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:33.687799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4973f-b7c3-4b34-bca2-da894f090a9e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:33.688080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4973f-b7c3-4b34-bca2-da894f090a9e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:33.688361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c4973f-b7c3-4b34-bca2-da894f090a9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:33.702119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4973f-b7c3-4b34-bca2-da894f090a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:33.703525 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c4973f-b7c3-4b34-bca2-da894f090a9e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:33.719039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7643b321-6be3-41fa-a93a-b285c1d41cf4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-f1c4973f-b7c3-4b34-bca2-da894f090a9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:33.725173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:33.726390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:33.727282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:33.727282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:33.727282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:33.727282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:33.727282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 305/614] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:33.737305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4973f-b7c3-4b34-bca2-da894f090a9e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:33.787284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:33.787792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174f772-441d-4f56-b9f4-e7df1f4c7c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:33.788513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174f772-441d-4f56-b9f4-e7df1f4c7c89 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:33.789087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174f772-441d-4f56-b9f4-e7df1f4c7c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:33.789627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174f772-441d-4f56-b9f4-e7df1f4c7c89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:33.802930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174f772-441d-4f56-b9f4-e7df1f4c7c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8174f772-441d-4f56-b9f4-e7df1f4c7c89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:33.808982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:33.811346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:33.812630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 310/615] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:33.817095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174f772-441d-4f56-b9f4-e7df1f4c7c89 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:33.886927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c4973f-b7c3-4b34-bca2-da894f090a9e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:33.941493 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f7227-d110-4f0e-96c3-0f316f97ca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:33.942119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f7227-d110-4f0e-96c3-0f316f97ca35 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:33.942397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f7227-d110-4f0e-96c3-0f316f97ca35 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:33.942667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6f7227-d110-4f0e-96c3-0f316f97ca35 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:33.943362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f7227-d110-4f0e-96c3-0f316f97ca35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:33.943782 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f7227-d110-4f0e-96c3-0f316f97ca35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:33.945167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6f7227-d110-4f0e-96c3-0f316f97ca35 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:33.959487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 306/616] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:33.964819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f7227-d110-4f0e-96c3-0f316f97ca35 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:33.990365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174f772-441d-4f56-b9f4-e7df1f4c7c89 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:34.042982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:34.062569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f99e1e-5f86-4e26-af52-12adf2e757c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:34.064383 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f99e1e-5f86-4e26-af52-12adf2e757c3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:34.065488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f99e1e-5f86-4e26-af52-12adf2e757c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:34.065868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f99e1e-5f86-4e26-af52-12adf2e757c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:34.067305 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f99e1e-5f86-4e26-af52-12adf2e757c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:34.067869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f99e1e-5f86-4e26-af52-12adf2e757c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:34.070218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f99e1e-5f86-4e26-af52-12adf2e757c3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:34.084658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 311/617] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:34.092604 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f99e1e-5f86-4e26-af52-12adf2e757c3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:34.137668 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:34.154950 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6f7227-d110-4f0e-96c3-0f316f97ca35 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:34.227166 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d4214-3b73-4973-b1c6-10ac57f1b5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:34.227739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d4214-3b73-4973-b1c6-10ac57f1b5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:34.228016 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d4214-3b73-4973-b1c6-10ac57f1b5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:34.228286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43d4214-3b73-4973-b1c6-10ac57f1b5b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:34.243356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d4214-3b73-4973-b1c6-10ac57f1b5b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:34.250632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43d4214-3b73-4973-b1c6-10ac57f1b5b0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:34.265394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f99e1e-5f86-4e26-af52-12adf2e757c3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-b43d4214-3b73-4973-b1c6-10ac57f1b5b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:34.281403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:34.283754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:34.285837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:34.285837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:34.285837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:34.285837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:34.285837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:34.285837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:34.285837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:34.285837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:34.285837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:50:34.285837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:34.285837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 307/618] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Aug 1 11:50:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:34.293678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d4214-3b73-4973-b1c6-10ac57f1b5b0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:34.307125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b2528-9d9e-4ddf-b0c9-8e558e5143f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:34.307584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b2528-9d9e-4ddf-b0c9-8e558e5143f1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:34.307869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b2528-9d9e-4ddf-b0c9-8e558e5143f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:34.308143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3b2528-9d9e-4ddf-b0c9-8e558e5143f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:34.324320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b2528-9d9e-4ddf-b0c9-8e558e5143f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:34.327686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3b2528-9d9e-4ddf-b0c9-8e558e5143f1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ae3b2528-9d9e-4ddf-b0c9-8e558e5143f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:34.355875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:34.356792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:34.357867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:34.357867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:34.357867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:34.357867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:34.363860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 312/619] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:34.370147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b2528-9d9e-4ddf-b0c9-8e558e5143f1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:34.441052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:34.482669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43d4214-3b73-4973-b1c6-10ac57f1b5b0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:34.526754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3b2528-9d9e-4ddf-b0c9-8e558e5143f1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:34.563329 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac50d4-3fa9-49d9-9f1e-29cdaa881b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:34.563947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac50d4-3fa9-49d9-9f1e-29cdaa881b37 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:34.564259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac50d4-3fa9-49d9-9f1e-29cdaa881b37 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:34.564532 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ac50d4-3fa9-49d9-9f1e-29cdaa881b37 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:34.565220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac50d4-3fa9-49d9-9f1e-29cdaa881b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:34.566075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac50d4-3fa9-49d9-9f1e-29cdaa881b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:34.567464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ac50d4-3fa9-49d9-9f1e-29cdaa881b37 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:34.571353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8dca2-fcda-4b6c-a89e-629257e0fcc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:34.571975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8dca2-fcda-4b6c-a89e-629257e0fcc8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:34.572250 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8dca2-fcda-4b6c-a89e-629257e0fcc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:34.572518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe8dca2-fcda-4b6c-a89e-629257e0fcc8 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:34.573333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8dca2-fcda-4b6c-a89e-629257e0fcc8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:34.573643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8dca2-fcda-4b6c-a89e-629257e0fcc8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:34.575056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe8dca2-fcda-4b6c-a89e-629257e0fcc8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:34.597488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 313/620] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:34.606298 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac50d4-3fa9-49d9-9f1e-29cdaa881b37 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:34.607337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 308/621] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Aug 1 11:50:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:34.612864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8dca2-fcda-4b6c-a89e-629257e0fcc8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:34.644660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:34.721588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:34.729328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ac50d4-3fa9-49d9-9f1e-29cdaa881b37 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:34.798671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe8dca2-fcda-4b6c-a89e-629257e0fcc8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:34.835748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f2e87-aebf-48e4-abf8-5adebbcc2152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:34.835956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a0ad3-2376-42df-89d6-dfdf7499647a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:34.836374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a0ad3-2376-42df-89d6-dfdf7499647a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:34.836482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f2e87-aebf-48e4-abf8-5adebbcc2152 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:34.836681 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a0ad3-2376-42df-89d6-dfdf7499647a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:34.836779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f2e87-aebf-48e4-abf8-5adebbcc2152 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:34.836927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8a0ad3-2376-42df-89d6-dfdf7499647a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:34.837032 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f2e87-aebf-48e4-abf8-5adebbcc2152 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:34.866127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f2e87-aebf-48e4-abf8-5adebbcc2152 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:34.867677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f2e87-aebf-48e4-abf8-5adebbcc2152 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b48f2e87-aebf-48e4-abf8-5adebbcc2152 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:34.902528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:34.903534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:34.904512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:34.904512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:34.904512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:34.904512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:34.904512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:34.904512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:34.904512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:34.904512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:34.904512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 11:50:34.904512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:34.904512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 314/622] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:34.911460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a0ad3-2376-42df-89d6-dfdf7499647a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:34.912934 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8a0ad3-2376-42df-89d6-dfdf7499647a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:34.914191 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f2e87-aebf-48e4-abf8-5adebbcc2152 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:34.928211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:35.033966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 309/623] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:35.042325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a0ad3-2376-42df-89d6-dfdf7499647a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:35.099192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f2e87-aebf-48e4-abf8-5adebbcc2152 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:35.151564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08e032b-ee07-414e-93c3-1b3bdc334ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:35.152190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e032b-ee07-414e-93c3-1b3bdc334ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:35.153241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e032b-ee07-414e-93c3-1b3bdc334ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:35.153565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08e032b-ee07-414e-93c3-1b3bdc334ac0 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:35.154377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e032b-ee07-414e-93c3-1b3bdc334ac0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:35.154692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e032b-ee07-414e-93c3-1b3bdc334ac0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:35.156159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08e032b-ee07-414e-93c3-1b3bdc334ac0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:35.177813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 315/624] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Aug 1 11:50:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:35.179051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59cd16-0a98-4ed9-ae4d-29a3d91d2a30 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:35.179330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59cd16-0a98-4ed9-ae4d-29a3d91d2a30 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:35.179600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59cd16-0a98-4ed9-ae4d-29a3d91d2a30 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:35.185322 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 316/625] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:35.186072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59cd16-0a98-4ed9-ae4d-29a3d91d2a30 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:35.192135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8a0ad3-2376-42df-89d6-dfdf7499647a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:35.206220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:35.207838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:35.237493 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a4a1d6-b8cd-4c64-99ee-3118be0c9926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:35.238164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4a1d6-b8cd-4c64-99ee-3118be0c9926 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:35.238445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4a1d6-b8cd-4c64-99ee-3118be0c9926 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:35.238722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a4a1d6-b8cd-4c64-99ee-3118be0c9926 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:35.251750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4a1d6-b8cd-4c64-99ee-3118be0c9926 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:35.253950 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a4a1d6-b8cd-4c64-99ee-3118be0c9926 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-70a4a1d6-b8cd-4c64-99ee-3118be0c9926 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:35.272730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:35.273893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:35.274786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:35.274786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:35.274786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:35.274786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:35.274786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 310/626] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:35.280095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52418dca-45bb-4c0b-8a30-7a68395beadd None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:35.280095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52418dca-45bb-4c0b-8a30-7a68395beadd None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:35.280095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52418dca-45bb-4c0b-8a30-7a68395beadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:35.302762 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-52418dca-45bb-4c0b-8a30-7a68395beadd None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:35.303955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-52418dca-45bb-4c0b-8a30-7a68395beadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:35.323992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59cd16-0a98-4ed9-ae4d-29a3d91d2a30 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:35.363305 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa04af-f578-44c4-bf40-2002cd375d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:35.364272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa04af-f578-44c4-bf40-2002cd375d5a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:35.364854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa04af-f578-44c4-bf40-2002cd375d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:35.365458 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daa04af-f578-44c4-bf40-2002cd375d5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:35.381317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 311/627] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:35.381317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52418dca-45bb-4c0b-8a30-7a68395beadd None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:35.382547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa04af-f578-44c4-bf40-2002cd375d5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:35.384233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8daa04af-f578-44c4-bf40-2002cd375d5a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8daa04af-f578-44c4-bf40-2002cd375d5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:35.415233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:35.416178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:35.417150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:35.417150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:35.417150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:35.417150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:35.419453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 317/628] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:35.424968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa04af-f578-44c4-bf40-2002cd375d5a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:35.482373 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:35.494532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52418dca-45bb-4c0b-8a30-7a68395beadd None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:35.501786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:35.538626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1a568-60e9-4350-8caf-32f4f5e73dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:35.539517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a568-60e9-4350-8caf-32f4f5e73dcf None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:35.539798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a568-60e9-4350-8caf-32f4f5e73dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:35.540071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a568-60e9-4350-8caf-32f4f5e73dcf None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:35.540760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1a568-60e9-4350-8caf-32f4f5e73dcf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:35.541060 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1a568-60e9-4350-8caf-32f4f5e73dcf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:35.542366 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daa04af-f578-44c4-bf40-2002cd375d5a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:35.542481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd1a568-60e9-4350-8caf-32f4f5e73dcf None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:35.571985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 312/629] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:35.571985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1a568-60e9-4350-8caf-32f4f5e73dcf None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:35.599413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3905150-7ae5-458c-a845-21e3a077a9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:35.601224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3905150-7ae5-458c-a845-21e3a077a9fa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:35.601782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3905150-7ae5-458c-a845-21e3a077a9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:35.602210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3905150-7ae5-458c-a845-21e3a077a9fa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:35.617372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3905150-7ae5-458c-a845-21e3a077a9fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c3905150-7ae5-458c-a845-21e3a077a9fa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:35.625126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:35.626282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:35.627187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:35.627187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:35.627187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:35.627187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:35.627187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:35.627187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:35.627187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:35.627187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:35.627187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:35.627187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:35.627187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:35.627187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:35.635294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 318/630] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:35.635294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3905150-7ae5-458c-a845-21e3a077a9fa None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:35.700203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1a568-60e9-4350-8caf-32f4f5e73dcf None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:35.742236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1041b6d-15a3-438b-98e4-33c9558cc97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:35.743476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041b6d-15a3-438b-98e4-33c9558cc97d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:35.744185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041b6d-15a3-438b-98e4-33c9558cc97d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:35.744698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1041b6d-15a3-438b-98e4-33c9558cc97d None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:35.746167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1041b6d-15a3-438b-98e4-33c9558cc97d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:35.746726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1041b6d-15a3-438b-98e4-33c9558cc97d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:35.747882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3905150-7ae5-458c-a845-21e3a077a9fa None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:35.748887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1041b6d-15a3-438b-98e4-33c9558cc97d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:35.769287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 313/631] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:35.769287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1041b6d-15a3-438b-98e4-33c9558cc97d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:35.781413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:35.782880 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:35.793837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb73233-c89c-43e9-8d28-0ec386d5d968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:35.794670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb73233-c89c-43e9-8d28-0ec386d5d968 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:35.795140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb73233-c89c-43e9-8d28-0ec386d5d968 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:35.795414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb73233-c89c-43e9-8d28-0ec386d5d968 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:35.802417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb73233-c89c-43e9-8d28-0ec386d5d968 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:35.803881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb73233-c89c-43e9-8d28-0ec386d5d968 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6eb73233-c89c-43e9-8d28-0ec386d5d968 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:35.815983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:35.816921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:35.817874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:35.817874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:35.817874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:35.817874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:35.817874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:35.817874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:35.817874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:35.817874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:35.817874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 319/632] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:35.818357 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c314c-727b-485e-90bd-3c3d92f9cdff None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:35.818754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c314c-727b-485e-90bd-3c3d92f9cdff None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:35.818858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c314c-727b-485e-90bd-3c3d92f9cdff None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:35.823987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 320/633] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:35.823987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c314c-727b-485e-90bd-3c3d92f9cdff None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:35.885532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1041b6d-15a3-438b-98e4-33c9558cc97d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:35.923218 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e73df-bdf9-47e5-9615-3dcc6f40f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:35.923869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e73df-bdf9-47e5-9615-3dcc6f40f4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:35.924149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e73df-bdf9-47e5-9615-3dcc6f40f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:35.924421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e73df-bdf9-47e5-9615-3dcc6f40f4c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:35.925139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e73df-bdf9-47e5-9615-3dcc6f40f4c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:35.925731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e73df-bdf9-47e5-9615-3dcc6f40f4c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:35.926842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e73df-bdf9-47e5-9615-3dcc6f40f4c7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:35.932592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675c314c-727b-485e-90bd-3c3d92f9cdff None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:35.939700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 314/634] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:35.939700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e73df-bdf9-47e5-9615-3dcc6f40f4c7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:35.974945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05615fba-a453-428f-b498-76fb53754fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:35.975582 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05615fba-a453-428f-b498-76fb53754fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:35.975859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05615fba-a453-428f-b498-76fb53754fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:35.976395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05615fba-a453-428f-b498-76fb53754fd0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:35.983341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05615fba-a453-428f-b498-76fb53754fd0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:35.984793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05615fba-a453-428f-b498-76fb53754fd0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-05615fba-a453-428f-b498-76fb53754fd0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:35.997852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:35.998859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:35.999748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:35.999748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:35.999748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:35.999748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:35.999748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:35.999748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:35.999748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:35.999748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:35.999748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 321/635] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:36.000583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc31ee5-c600-4f39-a2f5-1e0905b2599f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.000583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc31ee5-c600-4f39-a2f5-1e0905b2599f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.000719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc31ee5-c600-4f39-a2f5-1e0905b2599f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.021274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0bc31ee5-c600-4f39-a2f5-1e0905b2599f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:36.022486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0bc31ee5-c600-4f39-a2f5-1e0905b2599f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:36.032680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:36.063558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e73df-bdf9-47e5-9615-3dcc6f40f4c7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:36.070537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:36.097063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 322/636] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:36.097926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc31ee5-c600-4f39-a2f5-1e0905b2599f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:36.115706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc60cd-d737-4462-b224-1a7cb0a197ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:36.116327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc60cd-d737-4462-b224-1a7cb0a197ee None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.116604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc60cd-d737-4462-b224-1a7cb0a197ee None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.116944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc60cd-d737-4462-b224-1a7cb0a197ee None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.117657 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc60cd-d737-4462-b224-1a7cb0a197ee None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:36.118367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc60cd-d737-4462-b224-1a7cb0a197ee None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:36.120073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc60cd-d737-4462-b224-1a7cb0a197ee None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:36.132083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 315/637] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:36.133098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc60cd-d737-4462-b224-1a7cb0a197ee None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:36.194888 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc31ee5-c600-4f39-a2f5-1e0905b2599f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:36.228650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e8d377-3dc7-4669-b405-8913aa34a10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:36.229276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8d377-3dc7-4669-b405-8913aa34a10b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.229580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8d377-3dc7-4669-b405-8913aa34a10b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.229846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e8d377-3dc7-4669-b405-8913aa34a10b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.230080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc60cd-d737-4462-b224-1a7cb0a197ee None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:36.240108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8d377-3dc7-4669-b405-8913aa34a10b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:36.241565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e8d377-3dc7-4669-b405-8913aa34a10b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-70e8d377-3dc7-4669-b405-8913aa34a10b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:36.257515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:36.258692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:36.259775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:36.259775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:36.259775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:36.259775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:36.259775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 323/638] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:36.259775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22d0e-22c5-47ee-9b51-3fc7ddeb0e4f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.260182 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22d0e-22c5-47ee-9b51-3fc7ddeb0e4f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.260311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de22d0e-22c5-47ee-9b51-3fc7ddeb0e4f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.261564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 324/639] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:36.262252 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de22d0e-22c5-47ee-9b51-3fc7ddeb0e4f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:36.271056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b17fd9-9f69-4f05-a334-56b21475e249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:36.271690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17fd9-9f69-4f05-a334-56b21475e249 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.271968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17fd9-9f69-4f05-a334-56b21475e249 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.272239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b17fd9-9f69-4f05-a334-56b21475e249 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.272990 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b17fd9-9f69-4f05-a334-56b21475e249 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:36.273290 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b17fd9-9f69-4f05-a334-56b21475e249 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:36.274761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b17fd9-9f69-4f05-a334-56b21475e249 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:36.276383 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:36.287596 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 316/640] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:36.288501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b17fd9-9f69-4f05-a334-56b21475e249 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:36.295175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:36.368237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de22d0e-22c5-47ee-9b51-3fc7ddeb0e4f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:36.391436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b17fd9-9f69-4f05-a334-56b21475e249 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:36.403051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda884e4-247b-4308-b096-504d9d9c3e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:36.403687 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda884e4-247b-4308-b096-504d9d9c3e1c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.403963 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda884e4-247b-4308-b096-504d9d9c3e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.404228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda884e4-247b-4308-b096-504d9d9c3e1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.415128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda884e4-247b-4308-b096-504d9d9c3e1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-cda884e4-247b-4308-b096-504d9d9c3e1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:36.421506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:36.422580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:36.423465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 325/641] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:36.424218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda884e4-247b-4308-b096-504d9d9c3e1c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:36.432743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d594d5e-6103-412e-9ed7-a171af09437e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:36.433392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d594d5e-6103-412e-9ed7-a171af09437e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.433669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d594d5e-6103-412e-9ed7-a171af09437e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.433966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d594d5e-6103-412e-9ed7-a171af09437e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.434737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d594d5e-6103-412e-9ed7-a171af09437e None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=f85279b6b3474c77be0d8d569feea5f2) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:36.435046 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d594d5e-6103-412e-9ed7-a171af09437e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:36.436463 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d594d5e-6103-412e-9ed7-a171af09437e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:36.443484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 317/642] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:36 2022] GET /identity/v3/role_assignments?user.id=f85279b6b3474c77be0d8d569feea5f2&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:36.444267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f56927-c37e-4f8e-a68c-04a635f351fc None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.444551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f56927-c37e-4f8e-a68c-04a635f351fc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.444819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f56927-c37e-4f8e-a68c-04a635f351fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.472442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-36f56927-c37e-4f8e-a68c-04a635f351fc None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:36.473739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-36f56927-c37e-4f8e-a68c-04a635f351fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:36.530841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:36.536072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:36.543978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda884e4-247b-4308-b096-504d9d9c3e1c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:36.552410 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 318/643] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:36.553571 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f56927-c37e-4f8e-a68c-04a635f351fc None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:36.592905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18843049-4995-4458-ace8-9936fd9c8b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:36.593563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18843049-4995-4458-ace8-9936fd9c8b2d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.593873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18843049-4995-4458-ace8-9936fd9c8b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.594154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18843049-4995-4458-ace8-9936fd9c8b2d None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.594855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18843049-4995-4458-ace8-9936fd9c8b2d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:36.596208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18843049-4995-4458-ace8-9936fd9c8b2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:36.597107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18843049-4995-4458-ace8-9936fd9c8b2d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:36.610947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 326/644] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:36.612180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18843049-4995-4458-ace8-9936fd9c8b2d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:36.672270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f56927-c37e-4f8e-a68c-04a635f351fc None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:36.710500 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753c78-d970-44a6-9525-209eab5b60a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:36.711168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753c78-d970-44a6-9525-209eab5b60a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.711443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753c78-d970-44a6-9525-209eab5b60a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.711713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b753c78-d970-44a6-9525-209eab5b60a5 None admin] PATH_INFO: `/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/e2dfb83ec65645459d41579b4b036ee5/roles/17e82eb8c8384f43a591d08c9cf1f63e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.728904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18843049-4995-4458-ace8-9936fd9c8b2d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:36.729083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b753c78-d970-44a6-9525-209eab5b60a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=99857fcf20fd4cb8b7def2bc2de521bc, user_id=e2dfb83ec65645459d41579b4b036ee5, role_id=17e82eb8c8384f43a591d08c9cf1f63e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:36.730331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b753c78-d970-44a6-9525-209eab5b60a5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:36.745132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 319/645] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:50:36 2022] PUT /identity/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/e2dfb83ec65645459d41579b4b036ee5/roles/17e82eb8c8384f43a591d08c9cf1f63e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:50:36.746008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753c78-d970-44a6-9525-209eab5b60a5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:36.780180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dab256-90a8-4fe4-850c-45e3a79b6677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:36.781549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dab256-90a8-4fe4-850c-45e3a79b6677 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.782015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dab256-90a8-4fe4-850c-45e3a79b6677 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.782470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dab256-90a8-4fe4-850c-45e3a79b6677 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.784043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dab256-90a8-4fe4-850c-45e3a79b6677 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:36.784601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dab256-90a8-4fe4-850c-45e3a79b6677 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:36.786346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dab256-90a8-4fe4-850c-45e3a79b6677 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:36.796414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 327/646] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:36.797764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dab256-90a8-4fe4-850c-45e3a79b6677 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:36.797874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:36.817197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:36.869095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b753c78-d970-44a6-9525-209eab5b60a5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:36.907131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2babe8-344a-4ee3-a473-7682d50aee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:36.907523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2babe8-344a-4ee3-a473-7682d50aee18 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.907799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2babe8-344a-4ee3-a473-7682d50aee18 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.908624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2babe8-344a-4ee3-a473-7682d50aee18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.920825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2babe8-344a-4ee3-a473-7682d50aee18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:36.922999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dab256-90a8-4fe4-850c-45e3a79b6677 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-4d2babe8-344a-4ee3-a473-7682d50aee18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:36.925104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:36.926055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 320/647] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:36.927083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2babe8-344a-4ee3-a473-7682d50aee18 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:36.964059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e2d2d-2cc2-419b-a454-1b68fc3e24bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:36.964971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e2d2d-2cc2-419b-a454-1b68fc3e24bd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:36.965430 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e2d2d-2cc2-419b-a454-1b68fc3e24bd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:36.965871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e2d2d-2cc2-419b-a454-1b68fc3e24bd None admin] PATH_INFO: `/v3/users/glance` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:36.975292 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e2d2d-2cc2-419b-a454-1b68fc3e24bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:36.977005 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e2d2d-2cc2-419b-a454-1b68fc3e24bd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c07e2d2d-2cc2-419b-a454-1b68fc3e24bd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:36.996864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:36.998068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:36.999181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:36.999181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:36.999181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:36.999181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:36.999181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:36.999181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:36.999181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:36.999181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:36.999181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 11:50:36.999181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:36.999181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 328/648] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:36 2022] GET /identity/v3/users/glance => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:36.999873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e2d2d-2cc2-419b-a454-1b68fc3e24bd None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:37.042497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:37.046698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2babe8-344a-4ee3-a473-7682d50aee18 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:37.086928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:37.092110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf1f07-1a74-49f4-a1ad-73e6a904a086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:37.093561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf1f07-1a74-49f4-a1ad-73e6a904a086 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:37.094201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf1f07-1a74-49f4-a1ad-73e6a904a086 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:37.096257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf1f07-1a74-49f4-a1ad-73e6a904a086 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:37.109968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf1f07-1a74-49f4-a1ad-73e6a904a086 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:37.111789 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf1f07-1a74-49f4-a1ad-73e6a904a086 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:37.123184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e2d2d-2cc2-419b-a454-1b68fc3e24bd None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-77cf1f07-1a74-49f4-a1ad-73e6a904a086 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:37.128447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:37.129536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:37.130654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:37.130654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:37.130654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:37.130654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:37.136433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 321/649] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:37.137556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf1f07-1a74-49f4-a1ad-73e6a904a086 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:37.163611 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66683dd0-8a39-4868-9611-020600810d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:37.164560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66683dd0-8a39-4868-9611-020600810d0d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:37.165094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66683dd0-8a39-4868-9611-020600810d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:37.165555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66683dd0-8a39-4868-9611-020600810d0d None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:37.166598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66683dd0-8a39-4868-9611-020600810d0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:37.167103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66683dd0-8a39-4868-9611-020600810d0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:37.168731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66683dd0-8a39-4868-9611-020600810d0d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:37.178892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 329/650] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:37.180007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66683dd0-8a39-4868-9611-020600810d0d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:37.252999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf1f07-1a74-49f4-a1ad-73e6a904a086 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:37.296297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fdece-966c-4712-9331-aa5b0abf8538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:37.297167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fdece-966c-4712-9331-aa5b0abf8538 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:37.297690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fdece-966c-4712-9331-aa5b0abf8538 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:37.298214 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fdece-966c-4712-9331-aa5b0abf8538 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:37.299307 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fdece-966c-4712-9331-aa5b0abf8538 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:37.299723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fdece-966c-4712-9331-aa5b0abf8538 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:37.300715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66683dd0-8a39-4868-9611-020600810d0d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:37.301403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3fdece-966c-4712-9331-aa5b0abf8538 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:37.327902 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 322/651] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Aug 1 11:50:37 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:37.332654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fdece-966c-4712-9331-aa5b0abf8538 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:37.343568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:37.352318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e76a5b-377c-4113-8a1f-0d7c86988976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:37.354257 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e76a5b-377c-4113-8a1f-0d7c86988976 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:37.354609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e76a5b-377c-4113-8a1f-0d7c86988976 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:37.354957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e76a5b-377c-4113-8a1f-0d7c86988976 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:37.355891 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e76a5b-377c-4113-8a1f-0d7c86988976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:37.356265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e76a5b-377c-4113-8a1f-0d7c86988976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:37.358079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e76a5b-377c-4113-8a1f-0d7c86988976 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:37.359655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:37.381014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 330/652] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:37.382521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e76a5b-377c-4113-8a1f-0d7c86988976 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:37.445602 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3fdece-966c-4712-9331-aa5b0abf8538 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:37.482404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cd5c9-a677-4cd9-988e-89a68a7349f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:37.483446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd5c9-a677-4cd9-988e-89a68a7349f8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:37.484057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd5c9-a677-4cd9-988e-89a68a7349f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:37.484573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7cd5c9-a677-4cd9-988e-89a68a7349f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:37.496090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cd5c9-a677-4cd9-988e-89a68a7349f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:37.497907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7cd5c9-a677-4cd9-988e-89a68a7349f8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:37.511204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e76a5b-377c-4113-8a1f-0d7c86988976 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-2b7cd5c9-a677-4cd9-988e-89a68a7349f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:37.514056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:37.514929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:37.515812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:37.515812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:37.515812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:37.515812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:37.518263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 323/653] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:37.519289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cd5c9-a677-4cd9-988e-89a68a7349f8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:37.553621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1052256-dea4-4fd0-be4d-4b7f10fe6f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:37.554628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1052256-dea4-4fd0-be4d-4b7f10fe6f1a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:37.555211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1052256-dea4-4fd0-be4d-4b7f10fe6f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:37.555785 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1052256-dea4-4fd0-be4d-4b7f10fe6f1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:37.610121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:37.630845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:37.642198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1052256-dea4-4fd0-be4d-4b7f10fe6f1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:37.644053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1052256-dea4-4fd0-be4d-4b7f10fe6f1a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:37.672652 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7cd5c9-a677-4cd9-988e-89a68a7349f8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:37.721124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf501124-ee9e-4830-b74e-157b2160eba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:37.722312 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf501124-ee9e-4830-b74e-157b2160eba0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:37.722746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf501124-ee9e-4830-b74e-157b2160eba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:37.724008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf501124-ee9e-4830-b74e-157b2160eba0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:37.734313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf501124-ee9e-4830-b74e-157b2160eba0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:37.737466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf501124-ee9e-4830-b74e-157b2160eba0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-cf501124-ee9e-4830-b74e-157b2160eba0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:37.753251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:37.754378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:37.755543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:37.755543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:37.755543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:37.755543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:37.755543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:37.755543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:37.755543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:37.755543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:37.755543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 11:50:37.755543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:37.758524 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 324/654] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:37 2022] GET /identity/v3/users/cinder => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:37.759437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf501124-ee9e-4830-b74e-157b2160eba0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:37.772410 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 331/655] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:37.773995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1052256-dea4-4fd0-be4d-4b7f10fe6f1a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:37.868739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf501124-ee9e-4830-b74e-157b2160eba0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:37.890039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:37.908323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:37.916647 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1825f1-4d75-4d3a-b6ce-89b1fa39f12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:37.917474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1825f1-4d75-4d3a-b6ce-89b1fa39f12d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:37.917848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1825f1-4d75-4d3a-b6ce-89b1fa39f12d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:37.918222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1825f1-4d75-4d3a-b6ce-89b1fa39f12d None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:37.919086 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1825f1-4d75-4d3a-b6ce-89b1fa39f12d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:37.919502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1825f1-4d75-4d3a-b6ce-89b1fa39f12d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:37.920190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1052256-dea4-4fd0-be4d-4b7f10fe6f1a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:37.921070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1825f1-4d75-4d3a-b6ce-89b1fa39f12d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:37.943200 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 325/656] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:37.944235 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1825f1-4d75-4d3a-b6ce-89b1fa39f12d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:37.966688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb26da-e44b-4d4b-9ccb-42cdaa3e3451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:37.968136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb26da-e44b-4d4b-9ccb-42cdaa3e3451 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:37.968867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb26da-e44b-4d4b-9ccb-42cdaa3e3451 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:37.969285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abeb26da-e44b-4d4b-9ccb-42cdaa3e3451 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:37.971086 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb26da-e44b-4d4b-9ccb-42cdaa3e3451 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:37.971952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb26da-e44b-4d4b-9ccb-42cdaa3e3451 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:37.974170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abeb26da-e44b-4d4b-9ccb-42cdaa3e3451 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:38.002211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 332/657] 10.222.0.42 () {56 vars in 1137 bytes} [Mon Aug 1 11:50:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:38.003304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb26da-e44b-4d4b-9ccb-42cdaa3e3451 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:38.060069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1825f1-4d75-4d3a-b6ce-89b1fa39f12d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:38.097144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce24827-d607-4a6c-92d0-355686a82ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:38.097989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce24827-d607-4a6c-92d0-355686a82ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:38.098426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce24827-d607-4a6c-92d0-355686a82ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:38.098735 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce24827-d607-4a6c-92d0-355686a82ee4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:38.110516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce24827-d607-4a6c-92d0-355686a82ee4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:38.112720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce24827-d607-4a6c-92d0-355686a82ee4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-2ce24827-d607-4a6c-92d0-355686a82ee4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:38.129322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:38.130432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:38.131479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:38.131479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:38.131479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:38.131479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:38.138202 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 326/658] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:38.138202 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce24827-d607-4a6c-92d0-355686a82ee4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:38.145814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abeb26da-e44b-4d4b-9ccb-42cdaa3e3451 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:38.182003 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5f669-40f5-4aa5-9af4-b3735676dd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:38.182772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f669-40f5-4aa5-9af4-b3735676dd8e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:38.183233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f669-40f5-4aa5-9af4-b3735676dd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:38.183503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d5f669-40f5-4aa5-9af4-b3735676dd8e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:38.184630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:38.193256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5f669-40f5-4aa5-9af4-b3735676dd8e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:38.194861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d5f669-40f5-4aa5-9af4-b3735676dd8e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-25d5f669-40f5-4aa5-9af4-b3735676dd8e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:38.209235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:38.210431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:38.211619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:38.211619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:38.211619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:38.211619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:38.211619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:38.211619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:38.211619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:38.211619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:38.211619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 11:50:38.211619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:38.217672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 333/659] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:38 2022] GET /identity/v3/users/neutron => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:38.219054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5f669-40f5-4aa5-9af4-b3735676dd8e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:38.235304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:38.271514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce24827-d607-4a6c-92d0-355686a82ee4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:38.316868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2088d66-ac2b-4baa-9485-2499982c25c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:38.317582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2088d66-ac2b-4baa-9485-2499982c25c0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:38.317980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2088d66-ac2b-4baa-9485-2499982c25c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:38.318354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2088d66-ac2b-4baa-9485-2499982c25c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:38.358631 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d5f669-40f5-4aa5-9af4-b3735676dd8e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:38.394777 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2088d66-ac2b-4baa-9485-2499982c25c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:38.396329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2088d66-ac2b-4baa-9485-2499982c25c0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:38.413749 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bec5b-cc7d-4e6b-a344-dc7445684c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:38.414980 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bec5b-cc7d-4e6b-a344-dc7445684c91 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:38.415882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bec5b-cc7d-4e6b-a344-dc7445684c91 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:38.416398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1bec5b-cc7d-4e6b-a344-dc7445684c91 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:38.417334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bec5b-cc7d-4e6b-a344-dc7445684c91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:38.417851 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bec5b-cc7d-4e6b-a344-dc7445684c91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:38.420270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1bec5b-cc7d-4e6b-a344-dc7445684c91 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:38.428612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:38.444182 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 334/660] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:38.444182 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bec5b-cc7d-4e6b-a344-dc7445684c91 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:38.512845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 327/661] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:38.513810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2088d66-ac2b-4baa-9485-2499982c25c0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:38.536238 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:38.571825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1bec5b-cc7d-4e6b-a344-dc7445684c91 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:38.608516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5273686-58bd-4b5c-a27a-7bd336f2bce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:38.609127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273686-58bd-4b5c-a27a-7bd336f2bce2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:38.609428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273686-58bd-4b5c-a27a-7bd336f2bce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:38.609704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5273686-58bd-4b5c-a27a-7bd336f2bce2 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:38.610479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5273686-58bd-4b5c-a27a-7bd336f2bce2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:38.610779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5273686-58bd-4b5c-a27a-7bd336f2bce2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:38.612234 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5273686-58bd-4b5c-a27a-7bd336f2bce2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:38.617973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2088d66-ac2b-4baa-9485-2499982c25c0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:38.634096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 335/662] 10.222.0.42 () {56 vars in 1139 bytes} [Mon Aug 1 11:50:38 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:38.634096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5273686-58bd-4b5c-a27a-7bd336f2bce2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:38.654121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:38.659839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084fa64b-c6d4-43c3-9965-9f531cabac2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:38.660487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fa64b-c6d4-43c3-9965-9f531cabac2f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:38.660762 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fa64b-c6d4-43c3-9965-9f531cabac2f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:38.661038 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084fa64b-c6d4-43c3-9965-9f531cabac2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:38.667893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fa64b-c6d4-43c3-9965-9f531cabac2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:38.669368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084fa64b-c6d4-43c3-9965-9f531cabac2f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-084fa64b-c6d4-43c3-9965-9f531cabac2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:38.680726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:38.682008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:38.682914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:38.682914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:38.682914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:38.682914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:38.682914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:38.682914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:38.682914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:38.682914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:38.682914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 328/663] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:38.684375 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46703d2-abe4-490c-bebb-0edb5c75f04f None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:38.684854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46703d2-abe4-490c-bebb-0edb5c75f04f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:38.685648 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46703d2-abe4-490c-bebb-0edb5c75f04f None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:38.689604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 329/664] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:38.689604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46703d2-abe4-490c-bebb-0edb5c75f04f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:38.749933 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5273686-58bd-4b5c-a27a-7bd336f2bce2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:38.781165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:38.788295 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782250e-66aa-4a55-a516-4e93cee2e17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:38.789017 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782250e-66aa-4a55-a516-4e93cee2e17f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:38.789313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782250e-66aa-4a55-a516-4e93cee2e17f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:38.789588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e782250e-66aa-4a55-a516-4e93cee2e17f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:38.797544 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46703d2-abe4-490c-bebb-0edb5c75f04f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:38.801330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782250e-66aa-4a55-a516-4e93cee2e17f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:38.802802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e782250e-66aa-4a55-a516-4e93cee2e17f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e782250e-66aa-4a55-a516-4e93cee2e17f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:38.818757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:38.819655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:38.820552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:38.820552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:38.820552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:38.820552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:38.820552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 336/665] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:38.821566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782250e-66aa-4a55-a516-4e93cee2e17f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:38.837954 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e40ddb-8237-4eac-9c64-fcec9dca4568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:38.838538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e40ddb-8237-4eac-9c64-fcec9dca4568 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:38.838817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e40ddb-8237-4eac-9c64-fcec9dca4568 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:38.839086 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e40ddb-8237-4eac-9c64-fcec9dca4568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:38.906163 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:38.916560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e40ddb-8237-4eac-9c64-fcec9dca4568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:38.918112 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e40ddb-8237-4eac-9c64-fcec9dca4568 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:38.922028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e782250e-66aa-4a55-a516-4e93cee2e17f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:38.956470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a80de96-210b-445d-88ed-ae4c88824e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:38.957078 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80de96-210b-445d-88ed-ae4c88824e32 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:38.957388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80de96-210b-445d-88ed-ae4c88824e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:38.957657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a80de96-210b-445d-88ed-ae4c88824e32 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:38.958470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80de96-210b-445d-88ed-ae4c88824e32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:38.958780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80de96-210b-445d-88ed-ae4c88824e32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:38.960228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a80de96-210b-445d-88ed-ae4c88824e32 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:38.972785 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 337/666] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:38.973971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259f5ac-c824-453c-812b-69a7651ba804 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:38.974249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259f5ac-c824-453c-812b-69a7651ba804 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:38.974521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7259f5ac-c824-453c-812b-69a7651ba804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:38.992026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7259f5ac-c824-453c-812b-69a7651ba804 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:38.993199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7259f5ac-c824-453c-812b-69a7651ba804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:39.020740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 330/667] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:39.021581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e40ddb-8237-4eac-9c64-fcec9dca4568 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:39.032356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:39.068531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 338/668] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:39.070053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c741-c413-471d-aa32-b1dea2e1f485 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:39.070333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c741-c413-471d-aa32-b1dea2e1f485 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:39.070598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd43c741-c413-471d-aa32-b1dea2e1f485 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:39.071959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 339/669] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:39.072505 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c741-c413-471d-aa32-b1dea2e1f485 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:39.116725 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:39.125680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e40ddb-8237-4eac-9c64-fcec9dca4568 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:39.159337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff39b4-147f-4a79-a007-9aa0d0044e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:39.159949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff39b4-147f-4a79-a007-9aa0d0044e7e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:39.160221 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff39b4-147f-4a79-a007-9aa0d0044e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:39.160494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ff39b4-147f-4a79-a007-9aa0d0044e7e None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:39.161177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff39b4-147f-4a79-a007-9aa0d0044e7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:39.161510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff39b4-147f-4a79-a007-9aa0d0044e7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:39.162870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ff39b4-147f-4a79-a007-9aa0d0044e7e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:39.174995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd43c741-c413-471d-aa32-b1dea2e1f485 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:39.176148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 331/670] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:39.177021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff39b4-147f-4a79-a007-9aa0d0044e7e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:39.209818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74957a86-53aa-488f-9fde-d6dcda559198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:39.210423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74957a86-53aa-488f-9fde-d6dcda559198 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:39.210698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74957a86-53aa-488f-9fde-d6dcda559198 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:39.210967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74957a86-53aa-488f-9fde-d6dcda559198 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:39.211735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74957a86-53aa-488f-9fde-d6dcda559198 None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=c358a2d9539c4ae2a5e12aa6f1ed6d61) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:39.212035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74957a86-53aa-488f-9fde-d6dcda559198 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:39.213486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74957a86-53aa-488f-9fde-d6dcda559198 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:39.219124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 340/671] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:39 2022] GET /identity/v3/role_assignments?user.id=c358a2d9539c4ae2a5e12aa6f1ed6d61&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:39.220278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c8324-7864-4176-b7f9-d09d7cf5d90d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:39.220585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c8324-7864-4176-b7f9-d09d7cf5d90d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:39.220857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c8324-7864-4176-b7f9-d09d7cf5d90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:39.240687 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-768c8324-7864-4176-b7f9-d09d7cf5d90d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:39.241933 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-768c8324-7864-4176-b7f9-d09d7cf5d90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:39.275655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:39.286991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ff39b4-147f-4a79-a007-9aa0d0044e7e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:39.326240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 341/672] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:39.327050 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c8324-7864-4176-b7f9-d09d7cf5d90d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:39.336552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c63447-468e-4fb8-8168-c02a57a86791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:39.337206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c63447-468e-4fb8-8168-c02a57a86791 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:39.337503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c63447-468e-4fb8-8168-c02a57a86791 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:39.337777 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c63447-468e-4fb8-8168-c02a57a86791 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:39.353063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c63447-468e-4fb8-8168-c02a57a86791 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:39.354586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c63447-468e-4fb8-8168-c02a57a86791 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-99c63447-468e-4fb8-8168-c02a57a86791 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:39.370317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:39.371280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:39.372201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:39.372201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:39.372201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:39.372201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:39.372201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 332/673] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:39.372486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c63447-468e-4fb8-8168-c02a57a86791 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:39.380411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:39.452182 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c8324-7864-4176-b7f9-d09d7cf5d90d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:39.494569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b0697-6b51-442e-890e-f9faaa76b676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:39.495305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c63447-468e-4fb8-8168-c02a57a86791 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:39.495746 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b0697-6b51-442e-890e-f9faaa76b676 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:39.496211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b0697-6b51-442e-890e-f9faaa76b676 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:39.496926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b0697-6b51-442e-890e-f9faaa76b676 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:39.511770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b0697-6b51-442e-890e-f9faaa76b676 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-4e2b0697-6b51-442e-890e-f9faaa76b676 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:39.519173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:39.520116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:39.521045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 342/674] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:39.521782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b0697-6b51-442e-890e-f9faaa76b676 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:39.535658 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8229c6-1a58-4ee8-94a1-6c798a266e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:39.536295 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8229c6-1a58-4ee8-94a1-6c798a266e3e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:39.536573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8229c6-1a58-4ee8-94a1-6c798a266e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:39.536838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8229c6-1a58-4ee8-94a1-6c798a266e3e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:39.543663 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8229c6-1a58-4ee8-94a1-6c798a266e3e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:39.545094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8229c6-1a58-4ee8-94a1-6c798a266e3e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:39.550112 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-9f8229c6-1a58-4ee8-94a1-6c798a266e3e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:39.557479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:39.558377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:39.559297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:39.559297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:39.559297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:39.559297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:39.559297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:39.559297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:39.559297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:39.559297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:39.559297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 333/675] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:39.559785 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8229c6-1a58-4ee8-94a1-6c798a266e3e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:39.628756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:39.640799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b0697-6b51-442e-890e-f9faaa76b676 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:39.670105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8229c6-1a58-4ee8-94a1-6c798a266e3e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:39.676500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d62854-637e-47d6-a468-2082868faa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:39.677141 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d62854-637e-47d6-a468-2082868faa0b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:39.677453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d62854-637e-47d6-a468-2082868faa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:39.677725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d62854-637e-47d6-a468-2082868faa0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:39.688022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d62854-637e-47d6-a468-2082868faa0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c5d62854-637e-47d6-a468-2082868faa0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:39.693554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:39.694678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 343/676] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:39.695523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d62854-637e-47d6-a468-2082868faa0b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:39.711959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d9257-8fb4-4472-863f-4a3a8b5ecafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:39.712578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d9257-8fb4-4472-863f-4a3a8b5ecafb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:39.712866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d9257-8fb4-4472-863f-4a3a8b5ecafb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:39.713124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6d9257-8fb4-4472-863f-4a3a8b5ecafb None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:39.713847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d9257-8fb4-4472-863f-4a3a8b5ecafb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:39.714147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d9257-8fb4-4472-863f-4a3a8b5ecafb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:39.715520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6d9257-8fb4-4472-863f-4a3a8b5ecafb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:39.727681 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 334/677] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:39.728490 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d9257-8fb4-4472-863f-4a3a8b5ecafb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:39.793752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:39.810930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d62854-637e-47d6-a468-2082868faa0b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:39.840537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6d9257-8fb4-4472-863f-4a3a8b5ecafb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:39.848318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3117b3d-8c2e-438d-975e-de69d838dd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:39.848940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3117b3d-8c2e-438d-975e-de69d838dd4f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:39.849222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3117b3d-8c2e-438d-975e-de69d838dd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:39.849527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3117b3d-8c2e-438d-975e-de69d838dd4f None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:39.850241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3117b3d-8c2e-438d-975e-de69d838dd4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:39.850550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3117b3d-8c2e-438d-975e-de69d838dd4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:39.852202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3117b3d-8c2e-438d-975e-de69d838dd4f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:39.865653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 344/678] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:39.865653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3117b3d-8c2e-438d-975e-de69d838dd4f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:39.869874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:39.880676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dacaf-8155-429b-8edf-632049f7da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:39.881232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dacaf-8155-429b-8edf-632049f7da7a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:39.881535 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dacaf-8155-429b-8edf-632049f7da7a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:39.881804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63dacaf-8155-429b-8edf-632049f7da7a None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:39.882550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dacaf-8155-429b-8edf-632049f7da7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:39.882853 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dacaf-8155-429b-8edf-632049f7da7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:39.884284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63dacaf-8155-429b-8edf-632049f7da7a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:39.896844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 335/679] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:39.897652 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dacaf-8155-429b-8edf-632049f7da7a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:39.979795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3117b3d-8c2e-438d-975e-de69d838dd4f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:40.013473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63dacaf-8155-429b-8edf-632049f7da7a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:40.022175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a41f1e-353e-4a16-9a31-c5f6fc7ae54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:40.022790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a41f1e-353e-4a16-9a31-c5f6fc7ae54c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:40.023285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a41f1e-353e-4a16-9a31-c5f6fc7ae54c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:40.023403 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a41f1e-353e-4a16-9a31-c5f6fc7ae54c None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:40.024034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a41f1e-353e-4a16-9a31-c5f6fc7ae54c None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:40.024325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a41f1e-353e-4a16-9a31-c5f6fc7ae54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:40.025782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a41f1e-353e-4a16-9a31-c5f6fc7ae54c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:40.034510 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 345/680] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:40.035320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a41f1e-353e-4a16-9a31-c5f6fc7ae54c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:40.049760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:40.055194 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20965f09-1844-4906-975c-0cb7c7a1e76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:40.055835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20965f09-1844-4906-975c-0cb7c7a1e76c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:40.056114 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20965f09-1844-4906-975c-0cb7c7a1e76c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:40.056387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20965f09-1844-4906-975c-0cb7c7a1e76c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:40.063985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20965f09-1844-4906-975c-0cb7c7a1e76c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:40.066480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20965f09-1844-4906-975c-0cb7c7a1e76c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-20965f09-1844-4906-975c-0cb7c7a1e76c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:40.078505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:40.079432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:40.080426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:40.080426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:40.080426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:40.080426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:40.080426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:40.080426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:40.080426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:40.080426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:40.080426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 336/681] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:40.081594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20965f09-1844-4906-975c-0cb7c7a1e76c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:40.129436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:40.150303 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a41f1e-353e-4a16-9a31-c5f6fc7ae54c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:40.184056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20965f09-1844-4906-975c-0cb7c7a1e76c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:40.187528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64aa30-eacb-4b94-918b-9b8135ae09b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:40.188407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64aa30-eacb-4b94-918b-9b8135ae09b2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:40.188983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64aa30-eacb-4b94-918b-9b8135ae09b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:40.190035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c64aa30-eacb-4b94-918b-9b8135ae09b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:40.204583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64aa30-eacb-4b94-918b-9b8135ae09b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:40.206892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c64aa30-eacb-4b94-918b-9b8135ae09b2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:40.218264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475d0f-a6e4-446f-86ba-8c4948d8141b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:40.218876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475d0f-a6e4-446f-86ba-8c4948d8141b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:40.219153 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475d0f-a6e4-446f-86ba-8c4948d8141b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:40.219424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0475d0f-a6e4-446f-86ba-8c4948d8141b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:40.220201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475d0f-a6e4-446f-86ba-8c4948d8141b None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=00d506205722431ba2995956c7981735) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:40.220537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475d0f-a6e4-446f-86ba-8c4948d8141b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:40.221986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0475d0f-a6e4-446f-86ba-8c4948d8141b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-5c64aa30-eacb-4b94-918b-9b8135ae09b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:40.224006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:40.225076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:40.226531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:40.226531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:40.226531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:40.226531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:40.228123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 346/682] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:40.237504 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 337/683] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:40 2022] GET /identity/v3/role_assignments?user.id=00d506205722431ba2995956c7981735&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:40.237504 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475d0f-a6e4-446f-86ba-8c4948d8141b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:40.237799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64aa30-eacb-4b94-918b-9b8135ae09b2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:40.309759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:40.355564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c64aa30-eacb-4b94-918b-9b8135ae09b2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:40.359395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0475d0f-a6e4-446f-86ba-8c4948d8141b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:40.369897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:40.427444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220d685-34db-4480-94c0-71175de7999c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:40.428026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220d685-34db-4480-94c0-71175de7999c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:40.428303 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220d685-34db-4480-94c0-71175de7999c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:40.428574 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220d685-34db-4480-94c0-71175de7999c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:40.428678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71d73f-07ef-4820-9ff3-4b94b96b8eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:40.429393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71d73f-07ef-4820-9ff3-4b94b96b8eba None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:40.431439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71d73f-07ef-4820-9ff3-4b94b96b8eba None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:40.431439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd71d73f-07ef-4820-9ff3-4b94b96b8eba None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:40.431439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71d73f-07ef-4820-9ff3-4b94b96b8eba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:40.431439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71d73f-07ef-4820-9ff3-4b94b96b8eba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:40.432889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd71d73f-07ef-4820-9ff3-4b94b96b8eba None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:40.449320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220d685-34db-4480-94c0-71175de7999c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:40.451075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220d685-34db-4480-94c0-71175de7999c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:40.451366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 338/684] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:40.452303 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71d73f-07ef-4820-9ff3-4b94b96b8eba None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-1220d685-34db-4480-94c0-71175de7999c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:40.475895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:40.477108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:40.478226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:40.478226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:40.478226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:40.478226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:40.478226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 347/685] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:40.483370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220d685-34db-4480-94c0-71175de7999c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:40.626418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd71d73f-07ef-4820-9ff3-4b94b96b8eba None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:40.641120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220d685-34db-4480-94c0-71175de7999c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:40.659016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:40.684179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca934037-19e0-408b-839c-d223def8d138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:40.685324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca934037-19e0-408b-839c-d223def8d138 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:40.685966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca934037-19e0-408b-839c-d223def8d138 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:40.686464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca934037-19e0-408b-839c-d223def8d138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:40.687601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca934037-19e0-408b-839c-d223def8d138 None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=a2afb18a441549e3b853966ea1ad286e) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:40.687734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b09f0-52d9-46a9-914b-bbd555564cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:40.688679 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca934037-19e0-408b-839c-d223def8d138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:40.689211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b09f0-52d9-46a9-914b-bbd555564cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:40.689519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b09f0-52d9-46a9-914b-bbd555564cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:40.689791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b09f0-52d9-46a9-914b-bbd555564cf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:40.690490 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b09f0-52d9-46a9-914b-bbd555564cf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:40.690793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b09f0-52d9-46a9-914b-bbd555564cf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:40.690964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca934037-19e0-408b-839c-d223def8d138 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:40.692168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683b09f0-52d9-46a9-914b-bbd555564cf9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:40.700573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 348/686] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:40 2022] GET /identity/v3/role_assignments?user.id=a2afb18a441549e3b853966ea1ad286e&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:40.702032 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca934037-19e0-408b-839c-d223def8d138 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:40.714126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 339/687] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:40.727611 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b09f0-52d9-46a9-914b-bbd555564cf9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:40.807057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:40.870339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca934037-19e0-408b-839c-d223def8d138 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:40.915206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee2080-5d1b-449b-8f2c-36443eb5506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:40.915938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2080-5d1b-449b-8f2c-36443eb5506b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:40.916220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2080-5d1b-449b-8f2c-36443eb5506b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:40.920780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ee2080-5d1b-449b-8f2c-36443eb5506b None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:40.920780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee2080-5d1b-449b-8f2c-36443eb5506b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:40.920780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee2080-5d1b-449b-8f2c-36443eb5506b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:40.920780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ee2080-5d1b-449b-8f2c-36443eb5506b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:40.940978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 349/688] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:40.942604 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee2080-5d1b-449b-8f2c-36443eb5506b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:40.957503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b09f0-52d9-46a9-914b-bbd555564cf9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:40.989240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:41.024791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d589c-0e00-416c-8f3f-35420636a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:41.025478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d589c-0e00-416c-8f3f-35420636a62c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:41.025753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d589c-0e00-416c-8f3f-35420636a62c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:41.026021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618d589c-0e00-416c-8f3f-35420636a62c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:41.036903 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d589c-0e00-416c-8f3f-35420636a62c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:41.039032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618d589c-0e00-416c-8f3f-35420636a62c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-618d589c-0e00-416c-8f3f-35420636a62c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:41.051774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:41.053964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:41.056230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:41.056230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:41.056230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:41.056230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:41.056230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:41.056230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:41.056230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:41.056230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:41.056230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:50:41.056230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:41.057508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 340/689] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Aug 1 11:50:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:41.060679 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ee2080-5d1b-449b-8f2c-36443eb5506b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:41.062545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d589c-0e00-416c-8f3f-35420636a62c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:41.116167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd0b9f-973d-4ae0-bbe4-34a6a13249f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:41.117144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd0b9f-973d-4ae0-bbe4-34a6a13249f8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:41.117760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd0b9f-973d-4ae0-bbe4-34a6a13249f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:41.118890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd0b9f-973d-4ae0-bbe4-34a6a13249f8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:41.135063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd0b9f-973d-4ae0-bbe4-34a6a13249f8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:41.136821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cd0b9f-973d-4ae0-bbe4-34a6a13249f8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-54cd0b9f-973d-4ae0-bbe4-34a6a13249f8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:41.163000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:41.164064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:41.165013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:41.165013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:41.165013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:41.165013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:41.165013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:41.165013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:41.165013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:41.165013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:41.165013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 11:50:41.165013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:41.171344 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 350/690] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:41.183131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd0b9f-973d-4ae0-bbe4-34a6a13249f8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:41.213702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:41.238631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618d589c-0e00-416c-8f3f-35420636a62c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:41.277543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722ddda-ba49-4f14-ba9f-907e093c44e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:41.278580 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722ddda-ba49-4f14-ba9f-907e093c44e7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:41.279916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722ddda-ba49-4f14-ba9f-907e093c44e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:41.281495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722ddda-ba49-4f14-ba9f-907e093c44e7 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:41.282449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722ddda-ba49-4f14-ba9f-907e093c44e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:41.285043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722ddda-ba49-4f14-ba9f-907e093c44e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:41.286637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c722ddda-ba49-4f14-ba9f-907e093c44e7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:41.323335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 341/691] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Aug 1 11:50:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:41.334345 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722ddda-ba49-4f14-ba9f-907e093c44e7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:41.368234 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:41.375721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd0b9f-973d-4ae0-bbe4-34a6a13249f8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:41.428010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe488ff-daa9-48f0-b8dd-63309919d7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:41.428628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe488ff-daa9-48f0-b8dd-63309919d7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:41.428909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe488ff-daa9-48f0-b8dd-63309919d7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:41.430586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe488ff-daa9-48f0-b8dd-63309919d7c8 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:41.431400 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe488ff-daa9-48f0-b8dd-63309919d7c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:41.431708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe488ff-daa9-48f0-b8dd-63309919d7c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:41.433158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe488ff-daa9-48f0-b8dd-63309919d7c8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:41.465922 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 351/692] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Aug 1 11:50:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:41.471874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe488ff-daa9-48f0-b8dd-63309919d7c8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:41.520203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722ddda-ba49-4f14-ba9f-907e093c44e7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:41.565048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3914d5-74a9-4c9d-b2f7-ac56d1b74816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:41.565780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3914d5-74a9-4c9d-b2f7-ac56d1b74816 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:41.566056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3914d5-74a9-4c9d-b2f7-ac56d1b74816 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:41.566325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3914d5-74a9-4c9d-b2f7-ac56d1b74816 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:41.602354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:41.673538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe488ff-daa9-48f0-b8dd-63309919d7c8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:41.683256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3914d5-74a9-4c9d-b2f7-ac56d1b74816 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:41.684708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3914d5-74a9-4c9d-b2f7-ac56d1b74816 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:41.711110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cebed2-f113-4c1d-91e7-5be9defa79b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:41.711731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cebed2-f113-4c1d-91e7-5be9defa79b6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:41.712012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cebed2-f113-4c1d-91e7-5be9defa79b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:41.712287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cebed2-f113-4c1d-91e7-5be9defa79b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:41.738559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:41.786676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cebed2-f113-4c1d-91e7-5be9defa79b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:41.788199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cebed2-f113-4c1d-91e7-5be9defa79b6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:41.789577 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 342/693] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:41.790940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d474f-b208-4a85-8148-a6024ec25299 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:41.791127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d474f-b208-4a85-8148-a6024ec25299 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:41.791394 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4d474f-b208-4a85-8148-a6024ec25299 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:41.796724 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 343/694] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:41.797546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d474f-b208-4a85-8148-a6024ec25299 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:41.846772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:41.900465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 352/695] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 11:50:41.900465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cc4a3-8e82-457f-aa33-3da8e962edd4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:41.900465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cc4a3-8e82-457f-aa33-3da8e962edd4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:41.900465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547cc4a3-8e82-457f-aa33-3da8e962edd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:41.909591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4d474f-b208-4a85-8148-a6024ec25299 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:41.916519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-547cc4a3-8e82-457f-aa33-3da8e962edd4 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:41.917767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-547cc4a3-8e82-457f-aa33-3da8e962edd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:41.947107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06c73c-bc20-4976-b8b1-05cb7d5d2514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:41.948025 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06c73c-bc20-4976-b8b1-05cb7d5d2514 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:41.948450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06c73c-bc20-4976-b8b1-05cb7d5d2514 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:41.948881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06c73c-bc20-4976-b8b1-05cb7d5d2514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:41.959954 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06c73c-bc20-4976-b8b1-05cb7d5d2514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:41.961694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e06c73c-bc20-4976-b8b1-05cb7d5d2514 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:41.972111 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-4e06c73c-bc20-4976-b8b1-05cb7d5d2514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:41.978339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:41.979431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:41.980539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:41.980539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:41.980539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:41.980539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:41.982332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 344/696] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:41.983370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06c73c-bc20-4976-b8b1-05cb7d5d2514 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:41.997402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 353/697] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:41.997402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cc4a3-8e82-457f-aa33-3da8e962edd4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:42.100472 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547cc4a3-8e82-457f-aa33-3da8e962edd4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:42.113267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:42.117498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e06c73c-bc20-4976-b8b1-05cb7d5d2514 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:42.138351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc24b0-8d25-4627-868a-573055ccb35d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:42.139460 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc24b0-8d25-4627-868a-573055ccb35d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:42.139460 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc24b0-8d25-4627-868a-573055ccb35d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:42.139663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc24b0-8d25-4627-868a-573055ccb35d None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:42.140418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc24b0-8d25-4627-868a-573055ccb35d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:42.140844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc24b0-8d25-4627-868a-573055ccb35d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:42.142881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc24b0-8d25-4627-868a-573055ccb35d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:42.155731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a528e7-2ead-434e-a08e-4dcd04c2053b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:42.156706 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 354/698] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:42.156822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a528e7-2ead-434e-a08e-4dcd04c2053b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:42.157325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a528e7-2ead-434e-a08e-4dcd04c2053b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:42.157743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc24b0-8d25-4627-868a-573055ccb35d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:42.158104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a528e7-2ead-434e-a08e-4dcd04c2053b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:42.170125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a528e7-2ead-434e-a08e-4dcd04c2053b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:42.171951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a528e7-2ead-434e-a08e-4dcd04c2053b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-41a528e7-2ead-434e-a08e-4dcd04c2053b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:42.187451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:42.188403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:42.189462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:42.189462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:42.189462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:42.189462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:42.195852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 345/699] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:42.196951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a528e7-2ead-434e-a08e-4dcd04c2053b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:42.209890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:42.268673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc24b0-8d25-4627-868a-573055ccb35d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:42.304845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a528e7-2ead-434e-a08e-4dcd04c2053b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:42.306440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb521e-7fb9-44b1-820e-2be39bc23ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:42.307155 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb521e-7fb9-44b1-820e-2be39bc23ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:42.307510 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb521e-7fb9-44b1-820e-2be39bc23ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:42.307857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb521e-7fb9-44b1-820e-2be39bc23ce4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:42.319361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb521e-7fb9-44b1-820e-2be39bc23ce4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:42.321122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb521e-7fb9-44b1-820e-2be39bc23ce4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-90eb521e-7fb9-44b1-820e-2be39bc23ce4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:42.336663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:42.337824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:42.338902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:42.338902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:42.338902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:42.338902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:42.344138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 355/700] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:42.345074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb521e-7fb9-44b1-820e-2be39bc23ce4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:42.347761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fff19-11c4-4f1d-af5b-2ace5c95aeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:42.348693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fff19-11c4-4f1d-af5b-2ace5c95aeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:42.349185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fff19-11c4-4f1d-af5b-2ace5c95aeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:42.349748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4fff19-11c4-4f1d-af5b-2ace5c95aeb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:42.357613 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fff19-11c4-4f1d-af5b-2ace5c95aeb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:42.359373 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4fff19-11c4-4f1d-af5b-2ace5c95aeb5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-7e4fff19-11c4-4f1d-af5b-2ace5c95aeb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:42.371365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:42.372331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:42.373256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:42.373256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:42.373256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:42.373256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:42.373256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:42.373256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:42.373256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:42.373256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:42.375667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 346/701] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:42.377189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fff19-11c4-4f1d-af5b-2ace5c95aeb5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:42.390396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:42.456200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:42.462140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb521e-7fb9-44b1-820e-2be39bc23ce4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:42.486627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4fff19-11c4-4f1d-af5b-2ace5c95aeb5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:42.502583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b010d-4c7c-4074-b7fa-7a90b79762c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:42.503202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b010d-4c7c-4074-b7fa-7a90b79762c1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:42.503485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b010d-4c7c-4074-b7fa-7a90b79762c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:42.503758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053b010d-4c7c-4074-b7fa-7a90b79762c1 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:42.504453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b010d-4c7c-4074-b7fa-7a90b79762c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:42.504758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b010d-4c7c-4074-b7fa-7a90b79762c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:42.506197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053b010d-4c7c-4074-b7fa-7a90b79762c1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:42.522811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 356/702] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:42.522811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b010d-4c7c-4074-b7fa-7a90b79762c1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:42.525539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccbb1d8-73e8-409c-81e9-a7f399c4abce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:42.526871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbb1d8-73e8-409c-81e9-a7f399c4abce None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:42.526871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbb1d8-73e8-409c-81e9-a7f399c4abce None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:42.526871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccbb1d8-73e8-409c-81e9-a7f399c4abce None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:42.527440 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbb1d8-73e8-409c-81e9-a7f399c4abce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:42.527735 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbb1d8-73e8-409c-81e9-a7f399c4abce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:42.529092 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccbb1d8-73e8-409c-81e9-a7f399c4abce None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:42.542306 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 347/703] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:42.543522 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad05fc-d736-4807-b8cc-63e28f5a6a61 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:42.543804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad05fc-d736-4807-b8cc-63e28f5a6a61 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:42.544077 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad05fc-d736-4807-b8cc-63e28f5a6a61 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:42.545453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 348/704] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:42.545989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad05fc-d736-4807-b8cc-63e28f5a6a61 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:42.630911 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:42.635176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053b010d-4c7c-4074-b7fa-7a90b79762c1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:42.665931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ad05fc-d736-4807-b8cc-63e28f5a6a61 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:42.673158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7322f-7a62-4102-bb59-3ee046f9027f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:42.674339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7322f-7a62-4102-bb59-3ee046f9027f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:42.674614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7322f-7a62-4102-bb59-3ee046f9027f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:42.674877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7322f-7a62-4102-bb59-3ee046f9027f None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:42.675615 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7322f-7a62-4102-bb59-3ee046f9027f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:42.675914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7322f-7a62-4102-bb59-3ee046f9027f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:42.677367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7322f-7a62-4102-bb59-3ee046f9027f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:42.695525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 357/705] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:42.695525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc61420-2bc1-4cc2-82b2-12b264594b29 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:42.695525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc61420-2bc1-4cc2-82b2-12b264594b29 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:42.695525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc61420-2bc1-4cc2-82b2-12b264594b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:42.709834 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055a069-b67d-4429-b199-a95a383101f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:42.710649 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a069-b67d-4429-b199-a95a383101f0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:42.710928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a069-b67d-4429-b199-a95a383101f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:42.711031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-cfc61420-2bc1-4cc2-82b2-12b264594b29 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:42.711203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1055a069-b67d-4429-b199-a95a383101f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:42.712152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cfc61420-2bc1-4cc2-82b2-12b264594b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:42.719337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055a069-b67d-4429-b199-a95a383101f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:42.721761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1055a069-b67d-4429-b199-a95a383101f0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:42.726781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-1055a069-b67d-4429-b199-a95a383101f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:42.735592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:42.737284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:42.738255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:42.738255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:42.738255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:42.738255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:42.738255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:42.738255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:42.738255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:42.738255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:42.738255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 349/706] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:42.738773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055a069-b67d-4429-b199-a95a383101f0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:42.789690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 358/707] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:42.791280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc61420-2bc1-4cc2-82b2-12b264594b29 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:42.865277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1055a069-b67d-4429-b199-a95a383101f0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:42.897815 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc61420-2bc1-4cc2-82b2-12b264594b29 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:42.901421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:42.908658 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f04cf-b8bb-4cc9-887e-5539ea02c9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:42.909271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f04cf-b8bb-4cc9-887e-5539ea02c9b3 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:42.909574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f04cf-b8bb-4cc9-887e-5539ea02c9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:42.909842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f04cf-b8bb-4cc9-887e-5539ea02c9b3 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:42.910530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f04cf-b8bb-4cc9-887e-5539ea02c9b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:42.911932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9f04cf-b8bb-4cc9-887e-5539ea02c9b3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:42.941327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 350/708] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:50:42 2022] POST /identity/v3/users => generated 254 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:50:42.941327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f04cf-b8bb-4cc9-887e-5539ea02c9b3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:42.944987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae00abb-ecc2-4fc3-bd74-ebf241fc9cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:42.946747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae00abb-ecc2-4fc3-bd74-ebf241fc9cb5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:42.947102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae00abb-ecc2-4fc3-bd74-ebf241fc9cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:42.947449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae00abb-ecc2-4fc3-bd74-ebf241fc9cb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:42.948372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae00abb-ecc2-4fc3-bd74-ebf241fc9cb5 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=f85279b6b3474c77be0d8d569feea5f2) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:42.948757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae00abb-ecc2-4fc3-bd74-ebf241fc9cb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:42.950493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae00abb-ecc2-4fc3-bd74-ebf241fc9cb5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:42.961477 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 359/709] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:42 2022] GET /identity/v3/role_assignments?user.id=f85279b6b3474c77be0d8d569feea5f2&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=0195bf688a7e464e8ff594afe80b050e => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:42.962501 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae00abb-ecc2-4fc3-bd74-ebf241fc9cb5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:43.010424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:43.115397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae00abb-ecc2-4fc3-bd74-ebf241fc9cb5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:43.117788 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f04cf-b8bb-4cc9-887e-5539ea02c9b3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:43.165636 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f025d6-27fc-4771-a000-5b5a0675466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:43.167487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f025d6-27fc-4771-a000-5b5a0675466b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:43.167487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f025d6-27fc-4771-a000-5b5a0675466b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:43.167487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f025d6-27fc-4771-a000-5b5a0675466b None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:43.167743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f025d6-27fc-4771-a000-5b5a0675466b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:43.167890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f025d6-27fc-4771-a000-5b5a0675466b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:43.168001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76dbee7a-e623-4dfd-96c2-0bb36af2b0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:43.168722 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbee7a-e623-4dfd-96c2-0bb36af2b0db None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:43.169072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbee7a-e623-4dfd-96c2-0bb36af2b0db None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:43.169358 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f025d6-27fc-4771-a000-5b5a0675466b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:43.169503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76dbee7a-e623-4dfd-96c2-0bb36af2b0db None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:43.170206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbee7a-e623-4dfd-96c2-0bb36af2b0db None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:43.171803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76dbee7a-e623-4dfd-96c2-0bb36af2b0db None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:43.185456 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 351/710] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-76dbee7a-e623-4dfd-96c2-0bb36af2b0db None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:43.186399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:43.187565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 11:50:43.188555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:43.189666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae439f7-8b7f-4a0f-b79e-3d1f24f5c43e None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:43.189666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae439f7-8b7f-4a0f-b79e-3d1f24f5c43e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:43.189666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae439f7-8b7f-4a0f-b79e-3d1f24f5c43e None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:43.189888 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 360/711] 10.222.0.42 () {56 vars in 1129 bytes} [Mon Aug 1 11:50:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:43.189976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 352/712] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:43.194188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae439f7-8b7f-4a0f-b79e-3d1f24f5c43e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:43.194327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb00510-4cbd-4ab0-ad19-7ed6870551b1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:43.194656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb00510-4cbd-4ab0-ad19-7ed6870551b1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:43.195156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb00510-4cbd-4ab0-ad19-7ed6870551b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:43.214571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0fb00510-4cbd-4ab0-ad19-7ed6870551b1 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:43.216194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0fb00510-4cbd-4ab0-ad19-7ed6870551b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:43.255061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:43.311016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 361/713] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:43.311672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb00510-4cbd-4ab0-ad19-7ed6870551b1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:43.333832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:43.346794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae439f7-8b7f-4a0f-b79e-3d1f24f5c43e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:43.390861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4841cb7-58f3-4ed8-81ff-0361c896c73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:43.391400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841cb7-58f3-4ed8-81ff-0361c896c73f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:43.391676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841cb7-58f3-4ed8-81ff-0361c896c73f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:43.391942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4841cb7-58f3-4ed8-81ff-0361c896c73f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:43.393541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4841cb7-58f3-4ed8-81ff-0361c896c73f None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=e2dfb83ec65645459d41579b4b036ee5) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:43.393848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4841cb7-58f3-4ed8-81ff-0361c896c73f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:43.395677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4841cb7-58f3-4ed8-81ff-0361c896c73f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:43.403220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 353/714] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:43 2022] GET /identity/v3/role_assignments?user.id=e2dfb83ec65645459d41579b4b036ee5&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 608 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:43.404283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4841cb7-58f3-4ed8-81ff-0361c896c73f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:43.495765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb00510-4cbd-4ab0-ad19-7ed6870551b1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:43.555016 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4841cb7-58f3-4ed8-81ff-0361c896c73f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:43.578740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb6958-2d2a-4916-8a3e-28f5e4c57c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:43.579358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6958-2d2a-4916-8a3e-28f5e4c57c6f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:43.580177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6958-2d2a-4916-8a3e-28f5e4c57c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:43.580533 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bb6958-2d2a-4916-8a3e-28f5e4c57c6f None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:43.581126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb6958-2d2a-4916-8a3e-28f5e4c57c6f None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:43.581470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb6958-2d2a-4916-8a3e-28f5e4c57c6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:43.582861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bb6958-2d2a-4916-8a3e-28f5e4c57c6f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:43.586481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:43.589050 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 362/715] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Aug 1 11:50:43 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:43.595497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb6958-2d2a-4916-8a3e-28f5e4c57c6f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:43.605318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285c070-2fd6-4527-a68d-a1d6ffe8ce84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:43.605318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285c070-2fd6-4527-a68d-a1d6ffe8ce84 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:43.605318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285c070-2fd6-4527-a68d-a1d6ffe8ce84 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:43.605318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285c070-2fd6-4527-a68d-a1d6ffe8ce84 None admin] PATH_INFO: `/v3/services/network` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:43.605694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285c070-2fd6-4527-a68d-a1d6ffe8ce84 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:43.605694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285c070-2fd6-4527-a68d-a1d6ffe8ce84 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d285c070-2fd6-4527-a68d-a1d6ffe8ce84 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:43.621744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:43.622796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 11:50:43.623627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:43.628336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 354/716] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:43 2022] GET /identity/v3/services/network => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:43.629574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285c070-2fd6-4527-a68d-a1d6ffe8ce84 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:43.688236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:43.723213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bb6958-2d2a-4916-8a3e-28f5e4c57c6f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:43.748280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285c070-2fd6-4527-a68d-a1d6ffe8ce84 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:43.761138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9c7ee-5a7d-44c0-92fe-50748988d10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:43.762006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9c7ee-5a7d-44c0-92fe-50748988d10b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:43.762426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9c7ee-5a7d-44c0-92fe-50748988d10b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:43.762869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b9c7ee-5a7d-44c0-92fe-50748988d10b None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:43.763685 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9c7ee-5a7d-44c0-92fe-50748988d10b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:43.764114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9c7ee-5a7d-44c0-92fe-50748988d10b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:43.765657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b9c7ee-5a7d-44c0-92fe-50748988d10b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:43.772102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 363/717] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Aug 1 11:50:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:43.787729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020be42f-06d0-4f9a-b8f4-0dd0fc03a463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:43.788543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020be42f-06d0-4f9a-b8f4-0dd0fc03a463 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:43.788927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020be42f-06d0-4f9a-b8f4-0dd0fc03a463 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:43.789328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020be42f-06d0-4f9a-b8f4-0dd0fc03a463 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:43.790160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020be42f-06d0-4f9a-b8f4-0dd0fc03a463 None admin] RBAC: Adding query filter params (name=network) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:43.790568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020be42f-06d0-4f9a-b8f4-0dd0fc03a463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:43.792174 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020be42f-06d0-4f9a-b8f4-0dd0fc03a463 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:43.799009 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 355/718] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:50:43 2022] GET /identity/v3/services?name=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:43.804864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9c7ee-5a7d-44c0-92fe-50748988d10b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:43.921088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b9c7ee-5a7d-44c0-92fe-50748988d10b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:43.967551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aee89bb-5854-45fd-ace0-d6e2b3ee03e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:43.968232 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee89bb-5854-45fd-ace0-d6e2b3ee03e8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:43.968517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee89bb-5854-45fd-ace0-d6e2b3ee03e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:43.968811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aee89bb-5854-45fd-ace0-d6e2b3ee03e8 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:43.969664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee89bb-5854-45fd-ace0-d6e2b3ee03e8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:43.969985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee89bb-5854-45fd-ace0-d6e2b3ee03e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:43.972020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aee89bb-5854-45fd-ace0-d6e2b3ee03e8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:43.973457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:43.978613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 364/719] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:50:43 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:45.383685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca16d27-13de-4a72-83aa-689f4113c8f6 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:45.384196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca16d27-13de-4a72-83aa-689f4113c8f6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:45.384196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca16d27-13de-4a72-83aa-689f4113c8f6 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:45.385808 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 356/720] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:45.391000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255be32-3666-45c6-b181-0baa34aae65c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:45.391387 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255be32-3666-45c6-b181-0baa34aae65c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:45.391577 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255be32-3666-45c6-b181-0baa34aae65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:45.410248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3255be32-3666-45c6-b181-0baa34aae65c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:45.411612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3255be32-3666-45c6-b181-0baa34aae65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:45.500053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 365/721] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:45.523303 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca16d27-13de-4a72-83aa-689f4113c8f6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:45.564503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:45.626234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca16d27-13de-4a72-83aa-689f4113c8f6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:45.663808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5313468-7338-44fb-b939-654bb4e37866 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:45.664123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5313468-7338-44fb-b939-654bb4e37866 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:45.664351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5313468-7338-44fb-b939-654bb4e37866 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:45.665971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 366/722] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:45.678369 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb5476-23c9-405e-b151-dc43f8799041 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:45.678683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb5476-23c9-405e-b151-dc43f8799041 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:45.678910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb5476-23c9-405e-b151-dc43f8799041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:45.682846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d1b1a-9b1d-48f1-aff1-57a1d82f11d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:45.683548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d1b1a-9b1d-48f1-aff1-57a1d82f11d3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:45.683824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d1b1a-9b1d-48f1-aff1-57a1d82f11d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:45.684097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77d1b1a-9b1d-48f1-aff1-57a1d82f11d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:45.703486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1bdb5476-23c9-405e-b151-dc43f8799041 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:45.704737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1bdb5476-23c9-405e-b151-dc43f8799041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:45.711970 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77d1b1a-9b1d-48f1-aff1-57a1d82f11d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-c77d1b1a-9b1d-48f1-aff1-57a1d82f11d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:45.716978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:45.717949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:45.718803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:45.718803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:45.718803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:45.718803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:45.718803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:45.718803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:45.718803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:45.718803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:45.718803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:45.718803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:45.718803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:45.718803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:45.726924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 357/723] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:45.727983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d1b1a-9b1d-48f1-aff1-57a1d82f11d3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:45.838775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 367/724] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:45.881974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:45.886151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77d1b1a-9b1d-48f1-aff1-57a1d82f11d3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:45.900512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb5476-23c9-405e-b151-dc43f8799041 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:45.950923 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f2934-c033-4903-aab8-aaf8e4933cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:45.951544 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f2934-c033-4903-aab8-aaf8e4933cdf None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:45.951832 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f2934-c033-4903-aab8-aaf8e4933cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:45.952102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855f2934-c033-4903-aab8-aaf8e4933cdf None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:45.952787 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f2934-c033-4903-aab8-aaf8e4933cdf None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:45.953087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f2934-c033-4903-aab8-aaf8e4933cdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:45.954986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855f2934-c033-4903-aab8-aaf8e4933cdf None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:45.972375 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 358/725] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:45.978108 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f2934-c033-4903-aab8-aaf8e4933cdf None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:46.005895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:46.057557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb5476-23c9-405e-b151-dc43f8799041 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:46.113779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a90ac-f74b-475f-ad9f-c404d9f70b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:46.114318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a90ac-f74b-475f-ad9f-c404d9f70b04 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.114585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a90ac-f74b-475f-ad9f-c404d9f70b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.114855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8a90ac-f74b-475f-ad9f-c404d9f70b04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.157632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8a90ac-f74b-475f-ad9f-c404d9f70b04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:46.162024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855f2934-c033-4903-aab8-aaf8e4933cdf None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ac8a90ac-f74b-475f-ad9f-c404d9f70b04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:46.167759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:46.169585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:46.171297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:46.171297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:46.171297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:46.171297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:46.171297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:46.171297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:46.171297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:46.171297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:46.171297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:46.171297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:46.171297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:46.171297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:46.177909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 368/726] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:46.184256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a90ac-f74b-475f-ad9f-c404d9f70b04 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:46.209035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350516b-be09-4645-a33b-bf4b8ccc3f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:46.209760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350516b-be09-4645-a33b-bf4b8ccc3f4d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.210048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350516b-be09-4645-a33b-bf4b8ccc3f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.210322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6350516b-be09-4645-a33b-bf4b8ccc3f4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.222171 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350516b-be09-4645-a33b-bf4b8ccc3f4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:46.223724 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6350516b-be09-4645-a33b-bf4b8ccc3f4d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-6350516b-be09-4645-a33b-bf4b8ccc3f4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:46.240696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:46.243310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:46.245407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:46.245407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:46.245407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:46.245407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:46.245407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 359/727] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:46.249323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350516b-be09-4645-a33b-bf4b8ccc3f4d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:46.269915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:46.360168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6350516b-be09-4645-a33b-bf4b8ccc3f4d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:46.395242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871c1577-472e-4410-af3b-1486b646f414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:46.395854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c1577-472e-4410-af3b-1486b646f414 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.396064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c1577-472e-4410-af3b-1486b646f414 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.396305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871c1577-472e-4410-af3b-1486b646f414 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.396988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c1577-472e-4410-af3b-1486b646f414 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:46.397383 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c1577-472e-4410-af3b-1486b646f414 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:46.398809 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871c1577-472e-4410-af3b-1486b646f414 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:46.413713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 360/728] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:46.417695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246509a-093e-4256-ae62-2d6ba2df473b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.417991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246509a-093e-4256-ae62-2d6ba2df473b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.418270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246509a-093e-4256-ae62-2d6ba2df473b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.419550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 361/729] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:46.420595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afad2f-973c-4a06-9aaa-62b6aa9f980e None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.420874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afad2f-973c-4a06-9aaa-62b6aa9f980e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.421140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0afad2f-973c-4a06-9aaa-62b6aa9f980e None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.423332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 362/730] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:46.424059 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afad2f-973c-4a06-9aaa-62b6aa9f980e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:46.438581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8a90ac-f74b-475f-ad9f-c404d9f70b04 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:46.458879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:46.478433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5366532-39db-467a-90cb-0601aea0bc20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:46.479073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5366532-39db-467a-90cb-0601aea0bc20 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.479350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5366532-39db-467a-90cb-0601aea0bc20 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.479609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5366532-39db-467a-90cb-0601aea0bc20 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.480318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5366532-39db-467a-90cb-0601aea0bc20 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:46.480615 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5366532-39db-467a-90cb-0601aea0bc20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:46.482011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5366532-39db-467a-90cb-0601aea0bc20 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:46.490912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 369/731] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:46.492066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964cb07-c7ad-4197-bb2f-5dd607a81dde None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.492344 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964cb07-c7ad-4197-bb2f-5dd607a81dde None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.492736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8964cb07-c7ad-4197-bb2f-5dd607a81dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.508786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:46.510765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8964cb07-c7ad-4197-bb2f-5dd607a81dde None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:46.511969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8964cb07-c7ad-4197-bb2f-5dd607a81dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:46.541697 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0afad2f-973c-4a06-9aaa-62b6aa9f980e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:46.577736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26cae0-4b94-4945-b690-c2f968019c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:46.578377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26cae0-4b94-4945-b690-c2f968019c50 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.578654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26cae0-4b94-4945-b690-c2f968019c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.578947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26cae0-4b94-4945-b690-c2f968019c50 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.581152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 370/732] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:46.587011 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26cae0-4b94-4945-b690-c2f968019c50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:46.588450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26cae0-4b94-4945-b690-c2f968019c50 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:46.601864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6c6f-30c2-404b-97da-e71332ad8025 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.601864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6c6f-30c2-404b-97da-e71332ad8025 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.601864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bb6c6f-30c2-404b-97da-e71332ad8025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-3a26cae0-4b94-4945-b690-c2f968019c50 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:46.608418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:46.609628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:46.610874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:46.610874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:46.610874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:46.610874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:46.610874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:46.610874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:46.610874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:46.610874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:46.610874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 11:50:46.610874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:46.610874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 363/733] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Aug 1 11:50:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:46.610874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26cae0-4b94-4945-b690-c2f968019c50 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:46.619107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-18bb6c6f-30c2-404b-97da-e71332ad8025 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:46.620291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-18bb6c6f-30c2-404b-97da-e71332ad8025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:46.685992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 371/734] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 11:50:46.686722 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb6c6f-30c2-404b-97da-e71332ad8025 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:46.713756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26cae0-4b94-4945-b690-c2f968019c50 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:46.730516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:46.742646 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:46.748029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bb4a6-84ef-4a75-a92f-5a5143f60d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:46.748672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bb4a6-84ef-4a75-a92f-5a5143f60d53 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.749227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bb4a6-84ef-4a75-a92f-5a5143f60d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.749604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6bb4a6-84ef-4a75-a92f-5a5143f60d53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.759992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bb4a6-84ef-4a75-a92f-5a5143f60d53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:46.761475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6bb4a6-84ef-4a75-a92f-5a5143f60d53 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-fa6bb4a6-84ef-4a75-a92f-5a5143f60d53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:46.776026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:46.776966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:46.777945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:46.777945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:46.777945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:46.777945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:46.777945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 364/735] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:46.777945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bb4a6-84ef-4a75-a92f-5a5143f60d53 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:46.790217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bb6c6f-30c2-404b-97da-e71332ad8025 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:46.824658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a325ff-82de-43bf-834f-cac64c0de220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:46.825391 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a325ff-82de-43bf-834f-cac64c0de220 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.825671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a325ff-82de-43bf-834f-cac64c0de220 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.825945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a325ff-82de-43bf-834f-cac64c0de220 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.826636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a325ff-82de-43bf-834f-cac64c0de220 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:46.828009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a325ff-82de-43bf-834f-cac64c0de220 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:46.844714 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 372/736] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:50:46 2022] POST /identity/v3/services => generated 240 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:50:46.846559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0772216-0e47-4417-9fe2-ce0df5121dae None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.846844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0772216-0e47-4417-9fe2-ce0df5121dae None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.847162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0772216-0e47-4417-9fe2-ce0df5121dae None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.848573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 373/737] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:46.850238 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0772216-0e47-4417-9fe2-ce0df5121dae None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:46.894702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6bb4a6-84ef-4a75-a92f-5a5143f60d53 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:46.946867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535cd69-887f-4676-b660-83d3a19cfc4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:46.947615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535cd69-887f-4676-b660-83d3a19cfc4e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:46.948018 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535cd69-887f-4676-b660-83d3a19cfc4e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:46.948396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535cd69-887f-4676-b660-83d3a19cfc4e None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:46.949370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535cd69-887f-4676-b660-83d3a19cfc4e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:46.949869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535cd69-887f-4676-b660-83d3a19cfc4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:46.951518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a535cd69-887f-4676-b660-83d3a19cfc4e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:46.977914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 365/738] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Aug 1 11:50:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:46.977914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535cd69-887f-4676-b660-83d3a19cfc4e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:46.993206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:46.997777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0772216-0e47-4417-9fe2-ce0df5121dae None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:47.026697 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:47.040734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdf2b02-2fdd-4acf-a001-c9cd0bdb2349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:47.041603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf2b02-2fdd-4acf-a001-c9cd0bdb2349 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:47.041979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf2b02-2fdd-4acf-a001-c9cd0bdb2349 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:47.042321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdf2b02-2fdd-4acf-a001-c9cd0bdb2349 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:47.043015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf2b02-2fdd-4acf-a001-c9cd0bdb2349 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:47.044385 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdf2b02-2fdd-4acf-a001-c9cd0bdb2349 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:47.065033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 374/739] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:50:46 2022] POST /identity/v3/services => generated 251 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:50:47.065033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6239b-2a4b-4884-a6ef-0c069fe113ae None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:47.065033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6239b-2a4b-4884-a6ef-0c069fe113ae None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:47.065033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f6239b-2a4b-4884-a6ef-0c069fe113ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:47.091677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-88f6239b-2a4b-4884-a6ef-0c069fe113ae None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:47.093194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-88f6239b-2a4b-4884-a6ef-0c069fe113ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:47.097143 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a535cd69-887f-4676-b660-83d3a19cfc4e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:47.144837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbff84-5d7b-4e6f-b3cc-8f12e0f0723b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:47.145789 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbff84-5d7b-4e6f-b3cc-8f12e0f0723b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:47.146174 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbff84-5d7b-4e6f-b3cc-8f12e0f0723b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:47.146656 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dbff84-5d7b-4e6f-b3cc-8f12e0f0723b None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:47.147643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbff84-5d7b-4e6f-b3cc-8f12e0f0723b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:47.148056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbff84-5d7b-4e6f-b3cc-8f12e0f0723b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:47.149904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dbff84-5d7b-4e6f-b3cc-8f12e0f0723b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:47.164959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 366/740] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:47.166185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbff84-5d7b-4e6f-b3cc-8f12e0f0723b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:47.196592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 375/741] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:50:47.197667 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6239b-2a4b-4884-a6ef-0c069fe113ae None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:47.317475 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:47.333807 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f6239b-2a4b-4884-a6ef-0c069fe113ae None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:47.378982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca6090-bc18-4652-95d1-b6a1c064bf93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:47.379899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca6090-bc18-4652-95d1-b6a1c064bf93 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:47.380171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca6090-bc18-4652-95d1-b6a1c064bf93 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:47.380436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca6090-bc18-4652-95d1-b6a1c064bf93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:47.390740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca6090-bc18-4652-95d1-b6a1c064bf93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:47.393192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cca6090-bc18-4652-95d1-b6a1c064bf93 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0cca6090-bc18-4652-95d1-b6a1c064bf93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:47.410102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:47.411146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:47.412084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:47.412084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:47.412084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:47.412084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:47.412084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:47.412084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:47.412084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:47.412084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:47.412084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:50:47.412084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:47.413711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 376/742] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Aug 1 11:50:47 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:47.414213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca6090-bc18-4652-95d1-b6a1c064bf93 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:47.428229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:47.439056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dbff84-5d7b-4e6f-b3cc-8f12e0f0723b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:47.485145 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f21962-0018-4b10-a90e-1293c497f2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:47.486687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f21962-0018-4b10-a90e-1293c497f2c7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:47.487113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f21962-0018-4b10-a90e-1293c497f2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:47.487760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f21962-0018-4b10-a90e-1293c497f2c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:47.530125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca6090-bc18-4652-95d1-b6a1c064bf93 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:47.568516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0294afb-c59f-4888-b507-88804de3a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:47.569371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0294afb-c59f-4888-b507-88804de3a0ca None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:47.569720 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0294afb-c59f-4888-b507-88804de3a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:47.570063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0294afb-c59f-4888-b507-88804de3a0ca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:47.578069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f21962-0018-4b10-a90e-1293c497f2c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:47.580603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f21962-0018-4b10-a90e-1293c497f2c7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:47.582330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0294afb-c59f-4888-b507-88804de3a0ca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b0294afb-c59f-4888-b507-88804de3a0ca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:47.588069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:47.589202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:47.590201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:47.590201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:47.590201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:47.590201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:47.590201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:47.590201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:47.590201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:47.590201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:47.590201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:47.590201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:47.590201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:47.590201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:47.590823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 377/743] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:47.591058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0294afb-c59f-4888-b507-88804de3a0ca None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:47.607357 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:47.695252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:47.706512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 367/744] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:47 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:50:47.707851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f21962-0018-4b10-a90e-1293c497f2c7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:47.730248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0294afb-c59f-4888-b507-88804de3a0ca None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:47.774221 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889e7a2-6835-468e-ace3-25ce1ede713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:47.775119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889e7a2-6835-468e-ace3-25ce1ede713b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:47.776045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889e7a2-6835-468e-ace3-25ce1ede713b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:47.776465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b889e7a2-6835-468e-ace3-25ce1ede713b None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:47.777696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889e7a2-6835-468e-ace3-25ce1ede713b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:47.778144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889e7a2-6835-468e-ace3-25ce1ede713b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:47.780646 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b889e7a2-6835-468e-ace3-25ce1ede713b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:47.809493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 378/745] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Aug 1 11:50:47 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:47.809493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889e7a2-6835-468e-ace3-25ce1ede713b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:47.839210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f21962-0018-4b10-a90e-1293c497f2c7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:47.882134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:47.890059 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5eef76-6b70-416e-bc7f-808d43347320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:47.891006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5eef76-6b70-416e-bc7f-808d43347320 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:47.891492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5eef76-6b70-416e-bc7f-808d43347320 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:47.892580 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5eef76-6b70-416e-bc7f-808d43347320 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:47.893558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5eef76-6b70-416e-bc7f-808d43347320 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:47.894549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5eef76-6b70-416e-bc7f-808d43347320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:47.896558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5eef76-6b70-416e-bc7f-808d43347320 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:47.908958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 368/746] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:47.910347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5eef76-6b70-416e-bc7f-808d43347320 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:47.925267 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b889e7a2-6835-468e-ace3-25ce1ede713b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:47.969010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d6cf-8fef-4993-b18f-42075aded789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:47.970626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d6cf-8fef-4993-b18f-42075aded789 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:47.970755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d6cf-8fef-4993-b18f-42075aded789 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:47.971130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4774d6cf-8fef-4993-b18f-42075aded789 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:47.986946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774d6cf-8fef-4993-b18f-42075aded789 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:47.988633 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4774d6cf-8fef-4993-b18f-42075aded789 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:47.995082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-4774d6cf-8fef-4993-b18f-42075aded789 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:48.009185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:48.010275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:48.011398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:48.011398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:48.011398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:48.011398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:48.013659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 379/747] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:48.014766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d6cf-8fef-4993-b18f-42075aded789 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:48.052571 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5eef76-6b70-416e-bc7f-808d43347320 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:48.089831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0a270-a043-4d8c-86b4-80db81f7f85f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:48.090613 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0a270-a043-4d8c-86b4-80db81f7f85f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:48.090994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0a270-a043-4d8c-86b4-80db81f7f85f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:48.091363 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0a270-a043-4d8c-86b4-80db81f7f85f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:48.103271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0a270-a043-4d8c-86b4-80db81f7f85f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:48.104833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e0a270-a043-4d8c-86b4-80db81f7f85f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-b4e0a270-a043-4d8c-86b4-80db81f7f85f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:48.121643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:48.122747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:48.123863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:48.123863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:48.123863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:48.123863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:48.129359 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 369/748] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:48.129359 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0a270-a043-4d8c-86b4-80db81f7f85f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:48.155509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4774d6cf-8fef-4993-b18f-42075aded789 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:48.180865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:48.201262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff8f77-12b2-4459-bfde-ab294d04802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:48.202231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff8f77-12b2-4459-bfde-ab294d04802f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:48.202810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff8f77-12b2-4459-bfde-ab294d04802f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:48.203293 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff8f77-12b2-4459-bfde-ab294d04802f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:48.216227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff8f77-12b2-4459-bfde-ab294d04802f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:48.218135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff8f77-12b2-4459-bfde-ab294d04802f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0eff8f77-12b2-4459-bfde-ab294d04802f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:48.233908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:48.234819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:48.236279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:48.236279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:48.236279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:48.236279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:48.242891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e0a270-a043-4d8c-86b4-80db81f7f85f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:48.243235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 380/749] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:48.244353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff8f77-12b2-4459-bfde-ab294d04802f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:48.252206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:48.284230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3858b-7784-42ec-b33b-fa4cfc854b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:48.284895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3858b-7784-42ec-b33b-fa4cfc854b85 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:48.285385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3858b-7784-42ec-b33b-fa4cfc854b85 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:48.285666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e3858b-7784-42ec-b33b-fa4cfc854b85 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:48.286393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3858b-7784-42ec-b33b-fa4cfc854b85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:48.286703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3858b-7784-42ec-b33b-fa4cfc854b85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:48.289977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e3858b-7784-42ec-b33b-fa4cfc854b85 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:48.307708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 370/750] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:48.308806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3858b-7784-42ec-b33b-fa4cfc854b85 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:48.390521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff8f77-12b2-4459-bfde-ab294d04802f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:48.424988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e3858b-7784-42ec-b33b-fa4cfc854b85 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:48.432562 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ace5a-c4a1-4195-ad28-3becc935911d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:48.433522 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ace5a-c4a1-4195-ad28-3becc935911d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:48.434074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ace5a-c4a1-4195-ad28-3becc935911d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:48.434572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080ace5a-c4a1-4195-ad28-3becc935911d None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:48.435476 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ace5a-c4a1-4195-ad28-3becc935911d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:48.435985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ace5a-c4a1-4195-ad28-3becc935911d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:48.437605 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080ace5a-c4a1-4195-ad28-3becc935911d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:48.455282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 381/751] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:48.456564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ace5a-c4a1-4195-ad28-3becc935911d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:48.466959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681510c7-00bd-4643-8eb6-41066eee1355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:48.467618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681510c7-00bd-4643-8eb6-41066eee1355 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:48.467915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681510c7-00bd-4643-8eb6-41066eee1355 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:48.468191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681510c7-00bd-4643-8eb6-41066eee1355 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:48.469401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681510c7-00bd-4643-8eb6-41066eee1355 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:48.469712 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681510c7-00bd-4643-8eb6-41066eee1355 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:48.472100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681510c7-00bd-4643-8eb6-41066eee1355 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:48.494173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 371/752] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:48.494173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681510c7-00bd-4643-8eb6-41066eee1355 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:48.502688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:48.527859 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:48.588386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080ace5a-c4a1-4195-ad28-3becc935911d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:48.607977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681510c7-00bd-4643-8eb6-41066eee1355 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:48.624983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce53705-48eb-43d6-b380-a868e80387c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:48.625660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce53705-48eb-43d6-b380-a868e80387c8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:48.625942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce53705-48eb-43d6-b380-a868e80387c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:48.626242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce53705-48eb-43d6-b380-a868e80387c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:48.635335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce53705-48eb-43d6-b380-a868e80387c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:48.636997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce53705-48eb-43d6-b380-a868e80387c8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:48.645810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936fff5-6e96-4918-a00c-a57b220cb34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:48.646953 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936fff5-6e96-4918-a00c-a57b220cb34c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:48.647461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936fff5-6e96-4918-a00c-a57b220cb34c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:48.647950 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936fff5-6e96-4918-a00c-a57b220cb34c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-1ce53705-48eb-43d6-b380-a868e80387c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:48.650409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:48.651287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:48.652192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:48.652192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:48.652192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:48.652192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:48.652192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:48.652192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:48.652192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:48.652192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:48.656581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 382/753] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:48.657979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce53705-48eb-43d6-b380-a868e80387c8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:48.662099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936fff5-6e96-4918-a00c-a57b220cb34c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:48.663781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c936fff5-6e96-4918-a00c-a57b220cb34c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-c936fff5-6e96-4918-a00c-a57b220cb34c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:48.676833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:48.677779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:48.678700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:48.678700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:48.678700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:48.678700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:48.678700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:48.678700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:48.678700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:48.678700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:48.685573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 372/754] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:48.686724 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936fff5-6e96-4918-a00c-a57b220cb34c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:48.770848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:48.781776 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce53705-48eb-43d6-b380-a868e80387c8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:48.803516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:48.817741 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936fff5-6e96-4918-a00c-a57b220cb34c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:48.829109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298b85-fbbc-42a5-8daf-efda46cee310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:48.830644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298b85-fbbc-42a5-8daf-efda46cee310 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:48.831160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298b85-fbbc-42a5-8daf-efda46cee310 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:48.831447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53298b85-fbbc-42a5-8daf-efda46cee310 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:48.840307 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53298b85-fbbc-42a5-8daf-efda46cee310 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:48.842481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53298b85-fbbc-42a5-8daf-efda46cee310 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:48.856122 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a661a6-d72b-4809-87f1-8c3085bb9c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:48.857021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a661a6-d72b-4809-87f1-8c3085bb9c6f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:48.857539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a661a6-d72b-4809-87f1-8c3085bb9c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:48.858054 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a661a6-d72b-4809-87f1-8c3085bb9c6f None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-53298b85-fbbc-42a5-8daf-efda46cee310 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:48.858241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:48.859113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:48.860100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:48.860100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:48.860100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:48.860100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:48.860100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:48.860100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:48.860100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:48.860100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:48.860100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 11:50:48.860100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:48.860100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 383/755] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:48.862136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a661a6-d72b-4809-87f1-8c3085bb9c6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:48.862689 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a661a6-d72b-4809-87f1-8c3085bb9c6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:48.864343 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a661a6-d72b-4809-87f1-8c3085bb9c6f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:48.864636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298b85-fbbc-42a5-8daf-efda46cee310 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:48.878418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 373/756] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:48.879536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a661a6-d72b-4809-87f1-8c3085bb9c6f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:48.981405 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53298b85-fbbc-42a5-8daf-efda46cee310 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:48.990019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a661a6-d72b-4809-87f1-8c3085bb9c6f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:49.015872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13980465-d863-4f87-acec-341c80e7acb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:49.016514 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980465-d863-4f87-acec-341c80e7acb1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.016790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980465-d863-4f87-acec-341c80e7acb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.017606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13980465-d863-4f87-acec-341c80e7acb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.018345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13980465-d863-4f87-acec-341c80e7acb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:49.018646 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13980465-d863-4f87-acec-341c80e7acb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:49.020086 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13980465-d863-4f87-acec-341c80e7acb1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:49.025679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfaba5-093f-4e60-a55e-9c888a4c2e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:49.026295 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfaba5-093f-4e60-a55e-9c888a4c2e9e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.026571 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfaba5-093f-4e60-a55e-9c888a4c2e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.026839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bfaba5-093f-4e60-a55e-9c888a4c2e9e None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.027625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfaba5-093f-4e60-a55e-9c888a4c2e9e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:49.027928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfaba5-093f-4e60-a55e-9c888a4c2e9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:49.029365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bfaba5-093f-4e60-a55e-9c888a4c2e9e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:49.037861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 384/757] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:49.037861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93887b41-12cc-4fa5-8793-a0de77a511b7 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.037861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93887b41-12cc-4fa5-8793-a0de77a511b7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.037861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93887b41-12cc-4fa5-8793-a0de77a511b7 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.040742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 385/758] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:49.041535 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93887b41-12cc-4fa5-8793-a0de77a511b7 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:49.050062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 374/759] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Aug 1 11:50:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:49.051087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfaba5-093f-4e60-a55e-9c888a4c2e9e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:49.059859 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:49.060908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:49.154781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93887b41-12cc-4fa5-8793-a0de77a511b7 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:49.165519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bfaba5-093f-4e60-a55e-9c888a4c2e9e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:49.189821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485e54e8-2a77-49bf-9924-385a92ef4932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:49.190438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e54e8-2a77-49bf-9924-385a92ef4932 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.190743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e54e8-2a77-49bf-9924-385a92ef4932 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.190987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485e54e8-2a77-49bf-9924-385a92ef4932 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.191769 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e54e8-2a77-49bf-9924-385a92ef4932 None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=fc14241a25484946a0ecc59c9776ac62) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:49.192075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e54e8-2a77-49bf-9924-385a92ef4932 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:49.193546 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485e54e8-2a77-49bf-9924-385a92ef4932 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:49.199244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 386/760] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:49 2022] GET /identity/v3/role_assignments?user.id=fc14241a25484946a0ecc59c9776ac62&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:49.200232 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb5973-7d71-4c0b-a57a-4341206935d3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.200514 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb5973-7d71-4c0b-a57a-4341206935d3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.200788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb5973-7d71-4c0b-a57a-4341206935d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.212582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250d359-84ca-4437-955a-f867fdccb77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:49.213288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250d359-84ca-4437-955a-f867fdccb77d None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.213593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250d359-84ca-4437-955a-f867fdccb77d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.213869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250d359-84ca-4437-955a-f867fdccb77d None admin] PATH_INFO: `/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/f85279b6b3474c77be0d8d569feea5f2/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.215924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250d359-84ca-4437-955a-f867fdccb77d None admin] RBAC: Authorizing `identity:create_grant(project_id=99857fcf20fd4cb8b7def2bc2de521bc, user_id=f85279b6b3474c77be0d8d569feea5f2, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:49.217483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250d359-84ca-4437-955a-f867fdccb77d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:49.231567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-34fb5973-7d71-4c0b-a57a-4341206935d3 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:49.233074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-34fb5973-7d71-4c0b-a57a-4341206935d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:49.235017 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 375/761] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:50:49 2022] PUT /identity/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/f85279b6b3474c77be0d8d569feea5f2/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:50:49.243238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250d359-84ca-4437-955a-f867fdccb77d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:49.325167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 387/762] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:50:49.326637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6a024-c051-4bcb-9326-7e59b9688af1 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.326929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6a024-c051-4bcb-9326-7e59b9688af1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.327202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6a024-c051-4bcb-9326-7e59b9688af1 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.333544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 388/763] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:49.335000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbc7f7-3291-4e10-9f1a-e397ba0bce64 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.335291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbc7f7-3291-4e10-9f1a-e397ba0bce64 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.335566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cbc7f7-3291-4e10-9f1a-e397ba0bce64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.348922 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:49.356712 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:49.368965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d8cbc7f7-3291-4e10-9f1a-e397ba0bce64 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:49.372073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d8cbc7f7-3291-4e10-9f1a-e397ba0bce64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:49.401676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250d359-84ca-4437-955a-f867fdccb77d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:49.455458 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801a9bd-14bb-4c92-a13b-83ec4776efd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:49.456042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801a9bd-14bb-4c92-a13b-83ec4776efd9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.456317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801a9bd-14bb-4c92-a13b-83ec4776efd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.456619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801a9bd-14bb-4c92-a13b-83ec4776efd9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.458790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 389/764] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:50:49.459772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbc7f7-3291-4e10-9f1a-e397ba0bce64 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:49.527666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801a9bd-14bb-4c92-a13b-83ec4776efd9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:49.529121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801a9bd-14bb-4c92-a13b-83ec4776efd9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:49.572555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cbc7f7-3291-4e10-9f1a-e397ba0bce64 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:49.595764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:49.613257 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f2763-3cca-4f26-9219-b42aab28935b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:49.614004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f2763-3cca-4f26-9219-b42aab28935b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.614287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f2763-3cca-4f26-9219-b42aab28935b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.614560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21f2763-3cca-4f26-9219-b42aab28935b None admin] PATH_INFO: `/v3/services/network` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.615189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f2763-3cca-4f26-9219-b42aab28935b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:49.616798 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21f2763-3cca-4f26-9219-b42aab28935b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:49.619571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c21f2763-3cca-4f26-9219-b42aab28935b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:49.629070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:49.630103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:49.630929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 390/765] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:49 2022] GET /identity/v3/services/network => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:49.631717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f2763-3cca-4f26-9219-b42aab28935b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:49.637207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 376/766] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:50:49.638131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801a9bd-14bb-4c92-a13b-83ec4776efd9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:49.745691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801a9bd-14bb-4c92-a13b-83ec4776efd9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:49.746015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21f2763-3cca-4f26-9219-b42aab28935b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:49.780928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc9367-4567-4a00-93d9-a32f55feaa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:49.781589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc9367-4567-4a00-93d9-a32f55feaa1f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.781870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc9367-4567-4a00-93d9-a32f55feaa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.782142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcc9367-4567-4a00-93d9-a32f55feaa1f None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.783442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc9367-4567-4a00-93d9-a32f55feaa1f None admin] RBAC: Adding query filter params (name=network) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:49.783746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc9367-4567-4a00-93d9-a32f55feaa1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:49.785115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcc9367-4567-4a00-93d9-a32f55feaa1f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:49.785752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39385a-c9b2-46aa-9981-96b7fd086081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:49.786576 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39385a-c9b2-46aa-9981-96b7fd086081 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.787161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39385a-c9b2-46aa-9981-96b7fd086081 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.787440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39385a-c9b2-46aa-9981-96b7fd086081 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.788365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39385a-c9b2-46aa-9981-96b7fd086081 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:49.789702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 377/767] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:50:49 2022] GET /identity/v3/services?name=network => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:49.789989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39385a-c9b2-46aa-9981-96b7fd086081 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:49.790582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc9367-4567-4a00-93d9-a32f55feaa1f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-1e39385a-c9b2-46aa-9981-96b7fd086081 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:49.806039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:49.807847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:49.808968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 391/768] 10.222.0.42 () {56 vars in 1129 bytes} [Mon Aug 1 11:50:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:49.810052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39385a-c9b2-46aa-9981-96b7fd086081 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:49.831010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:49.915793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcc9367-4567-4a00-93d9-a32f55feaa1f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:49.956386 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f70e9-4450-447f-8eed-b7a92c78c6a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:49.957546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f70e9-4450-447f-8eed-b7a92c78c6a1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:49.958093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f70e9-4450-447f-8eed-b7a92c78c6a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:49.958574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19f70e9-4450-447f-8eed-b7a92c78c6a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:49.973667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f70e9-4450-447f-8eed-b7a92c78c6a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:49.975978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19f70e9-4450-447f-8eed-b7a92c78c6a1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d19f70e9-4450-447f-8eed-b7a92c78c6a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:49.996939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:49.998094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:49.999223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:49.999223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:49.999223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:49.999223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:50.001029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 378/769] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:50.002565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f70e9-4450-447f-8eed-b7a92c78c6a1 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:50.035710 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:50.077788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39385a-c9b2-46aa-9981-96b7fd086081 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:50.103469 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:50.121756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbfcc7-f608-45e8-9029-29a667478ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:50.122827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbfcc7-f608-45e8-9029-29a667478ef8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:50.123259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbfcc7-f608-45e8-9029-29a667478ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:50.123680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbbfcc7-f608-45e8-9029-29a667478ef8 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:50.124526 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbfcc7-f608-45e8-9029-29a667478ef8 None admin] RBAC: Adding query filter params (type=network) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:50.124654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19f70e9-4450-447f-8eed-b7a92c78c6a1 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:50.125087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbfcc7-f608-45e8-9029-29a667478ef8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:50.127342 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbbfcc7-f608-45e8-9029-29a667478ef8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:50.133929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 392/770] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:50:49 2022] GET /identity/v3/services?type=network => generated 350 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:50.135265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbfcc7-f608-45e8-9029-29a667478ef8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:50.162688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd58791-0e05-4f77-9283-eb155d2b3370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:50.163931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58791-0e05-4f77-9283-eb155d2b3370 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:50.164302 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58791-0e05-4f77-9283-eb155d2b3370 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:50.164667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd58791-0e05-4f77-9283-eb155d2b3370 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:50.165669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd58791-0e05-4f77-9283-eb155d2b3370 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:50.165992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd58791-0e05-4f77-9283-eb155d2b3370 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:50.167763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd58791-0e05-4f77-9283-eb155d2b3370 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:50.173313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 379/771] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Aug 1 11:50:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:50.174416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd58791-0e05-4f77-9283-eb155d2b3370 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:50.255874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbbfcc7-f608-45e8-9029-29a667478ef8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:50.283640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:50.295836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a54ef-db54-4521-afbc-efcd98e3d7c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:50.296598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a54ef-db54-4521-afbc-efcd98e3d7c8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:50.296972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a54ef-db54-4521-afbc-efcd98e3d7c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:50.297354 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a54ef-db54-4521-afbc-efcd98e3d7c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:50.298723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a54ef-db54-4521-afbc-efcd98e3d7c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:50.299121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a54ef-db54-4521-afbc-efcd98e3d7c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:50.299667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd58791-0e05-4f77-9283-eb155d2b3370 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:50.300687 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a54ef-db54-4521-afbc-efcd98e3d7c8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:50.318628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 393/772] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:50.319539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a54ef-db54-4521-afbc-efcd98e3d7c8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:50.345275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a862cb7-1adf-48c1-adb9-9085f30a31c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:50.346432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a862cb7-1adf-48c1-adb9-9085f30a31c0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:50.346874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a862cb7-1adf-48c1-adb9-9085f30a31c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:50.347726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a862cb7-1adf-48c1-adb9-9085f30a31c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:50.348976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a862cb7-1adf-48c1-adb9-9085f30a31c0 None admin] RBAC: Adding query filter params (interface=public, service_id=327a91eeb9a24ba4822a988988fa9c7b, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:50.349517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a862cb7-1adf-48c1-adb9-9085f30a31c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:50.352246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a862cb7-1adf-48c1-adb9-9085f30a31c0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:50.362989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 380/773] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Aug 1 11:50:50 2022] GET /identity/v3/endpoints?service_id=327a91eeb9a24ba4822a988988fa9c7b&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:50.364524 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a862cb7-1adf-48c1-adb9-9085f30a31c0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:50.382452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:50.442610 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a54ef-db54-4521-afbc-efcd98e3d7c8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:50.478291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab82a3f-d721-43fa-baa2-d4e0aaea606a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:50.479082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab82a3f-d721-43fa-baa2-d4e0aaea606a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:50.479367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab82a3f-d721-43fa-baa2-d4e0aaea606a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:50.479962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab82a3f-d721-43fa-baa2-d4e0aaea606a None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:50.480996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab82a3f-d721-43fa-baa2-d4e0aaea606a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:50.481317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab82a3f-d721-43fa-baa2-d4e0aaea606a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:50.483183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab82a3f-d721-43fa-baa2-d4e0aaea606a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:50.486572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a862cb7-1adf-48c1-adb9-9085f30a31c0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:50.490536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 394/774] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Aug 1 11:50:50 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:50.491366 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab82a3f-d721-43fa-baa2-d4e0aaea606a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:50.533965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53b3d-866e-41ba-817a-159f088b4c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:50.534595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53b3d-866e-41ba-817a-159f088b4c7b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:50.534878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53b3d-866e-41ba-817a-159f088b4c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:50.535152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b53b3d-866e-41ba-817a-159f088b4c7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:50.544694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b53b3d-866e-41ba-817a-159f088b4c7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:50.546805 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b53b3d-866e-41ba-817a-159f088b4c7b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:50.551298 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-69b53b3d-866e-41ba-817a-159f088b4c7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:50.566069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:50.567208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:50.568350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:50.568350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:50.568350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:50.568350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:50.568350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:50.568350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:50.568350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:50.568350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:50.575717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 381/775] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:50.575717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53b3d-866e-41ba-817a-159f088b4c7b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:50.612243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab82a3f-d721-43fa-baa2-d4e0aaea606a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:50.659650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de3233-3897-4f4b-89a5-b0e5e75a6d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:50.660248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de3233-3897-4f4b-89a5-b0e5e75a6d7e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:50.660533 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de3233-3897-4f4b-89a5-b0e5e75a6d7e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:50.660790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9de3233-3897-4f4b-89a5-b0e5e75a6d7e None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:50.661466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de3233-3897-4f4b-89a5-b0e5e75a6d7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:50.663080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9de3233-3897-4f4b-89a5-b0e5e75a6d7e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:50.668661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:50.672896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 395/776] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Aug 1 11:50:50 2022] GET /identity/v3/services => generated 772 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:50.674459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de3233-3897-4f4b-89a5-b0e5e75a6d7e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:50.710511 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b53b3d-866e-41ba-817a-159f088b4c7b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:50.776901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269610a-a105-42b6-9ee5-57ef26c78d86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:50.777568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269610a-a105-42b6-9ee5-57ef26c78d86 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:50.777846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269610a-a105-42b6-9ee5-57ef26c78d86 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:50.778117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0269610a-a105-42b6-9ee5-57ef26c78d86 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:50.778879 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269610a-a105-42b6-9ee5-57ef26c78d86 None admin] RBAC: Adding query filter params (interface=public, service_id=ed305c0e91b142f3bab454b45d634331, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:50.779190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269610a-a105-42b6-9ee5-57ef26c78d86 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:50.780699 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0269610a-a105-42b6-9ee5-57ef26c78d86 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:50.795744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 382/777] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Aug 1 11:50:50 2022] GET /identity/v3/endpoints?service_id=ed305c0e91b142f3bab454b45d634331&interface=public®ion_id=RegionOne => generated 194 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:50.801248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269610a-a105-42b6-9ee5-57ef26c78d86 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:50.849719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9de3233-3897-4f4b-89a5-b0e5e75a6d7e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:50.876275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:50.912161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab352233-b16d-4390-9046-455ab8dfd8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:50.912790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab352233-b16d-4390-9046-455ab8dfd8e1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:50.913068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab352233-b16d-4390-9046-455ab8dfd8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:50.913365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab352233-b16d-4390-9046-455ab8dfd8e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:50.914253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab352233-b16d-4390-9046-455ab8dfd8e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:50.914707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab352233-b16d-4390-9046-455ab8dfd8e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:50.916277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab352233-b16d-4390-9046-455ab8dfd8e1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:50.933079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 396/778] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:50.938215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab352233-b16d-4390-9046-455ab8dfd8e1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:50.981595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0269610a-a105-42b6-9ee5-57ef26c78d86 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:51.026182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21843e47-e1d4-4cbe-9730-3fed8aac459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:51.027134 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21843e47-e1d4-4cbe-9730-3fed8aac459d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:51.027662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21843e47-e1d4-4cbe-9730-3fed8aac459d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:51.028084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21843e47-e1d4-4cbe-9730-3fed8aac459d None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:51.028984 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21843e47-e1d4-4cbe-9730-3fed8aac459d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:51.030621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21843e47-e1d4-4cbe-9730-3fed8aac459d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:51.033589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:51.045260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 383/779] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Aug 1 11:50:50 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:51.084302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab352233-b16d-4390-9046-455ab8dfd8e1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:51.121655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe7a9a-8eac-442c-a222-1d13f8363b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:51.122267 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe7a9a-8eac-442c-a222-1d13f8363b08 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:51.122539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe7a9a-8eac-442c-a222-1d13f8363b08 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:51.122805 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe7a9a-8eac-442c-a222-1d13f8363b08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:51.123587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe7a9a-8eac-442c-a222-1d13f8363b08 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=e2dfb83ec65645459d41579b4b036ee5) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:51.123889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe7a9a-8eac-442c-a222-1d13f8363b08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:51.125349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe7a9a-8eac-442c-a222-1d13f8363b08 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:51.131916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 397/780] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:50 2022] GET /identity/v3/role_assignments?user.id=e2dfb83ec65645459d41579b4b036ee5&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=0195bf688a7e464e8ff594afe80b050e => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:51.445686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1153c-5d01-4eca-9401-c8b5eadf966a None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:51.446371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1153c-5d01-4eca-9401-c8b5eadf966a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:51.446875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1153c-5d01-4eca-9401-c8b5eadf966a None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:51.448670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 384/781] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:51.454107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f811c-7306-4bd2-ac57-ac28640fe5e0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:51.454742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f811c-7306-4bd2-ac57-ac28640fe5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:51.455223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f811c-7306-4bd2-ac57-ac28640fe5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:51.465083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943a51e-039a-4de6-853f-9391da932b55 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:51.465406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943a51e-039a-4de6-853f-9391da932b55 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:51.465667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f943a51e-039a-4de6-853f-9391da932b55 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:51.467211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 385/782] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:51.472975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e35e80-d059-4999-8232-0366ef7a8d42 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:51.473257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e35e80-d059-4999-8232-0366ef7a8d42 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:51.473558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e35e80-d059-4999-8232-0366ef7a8d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:51.487015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1c7f811c-7306-4bd2-ac57-ac28640fe5e0 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:51.488586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1c7f811c-7306-4bd2-ac57-ac28640fe5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:51.492811 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f7e35e80-d059-4999-8232-0366ef7a8d42 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:51.494031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f7e35e80-d059-4999-8232-0366ef7a8d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:51.545858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:51.564493 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 386/783] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:50:51.587123 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e35e80-d059-4999-8232-0366ef7a8d42 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:51.612522 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 398/784] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:50:51.662764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f811c-7306-4bd2-ac57-ac28640fe5e0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:51.691423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e35e80-d059-4999-8232-0366ef7a8d42 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:51.720776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:51.728211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da79df0-b3c9-4611-877f-a5835a440c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:51.728862 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da79df0-b3c9-4611-877f-a5835a440c78 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:51.729142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da79df0-b3c9-4611-877f-a5835a440c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:51.729453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da79df0-b3c9-4611-877f-a5835a440c78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:51.741208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da79df0-b3c9-4611-877f-a5835a440c78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-2da79df0-b3c9-4611-877f-a5835a440c78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:51.746285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:51.747494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:51.748546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:51.748546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:51.748546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:51.748546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:51.748546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:51.748546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:51.748546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:51.748546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:51.748546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:51.748546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:51.748546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:51.748546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:51.755386 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 387/785] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:51.761422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da79df0-b3c9-4611-877f-a5835a440c78 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:51.829601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f811c-7306-4bd2-ac57-ac28640fe5e0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:51.868346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da79df0-b3c9-4611-877f-a5835a440c78 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:51.894014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d5d62-5568-4c97-b574-82477c075e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:51.894673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d5d62-5568-4c97-b574-82477c075e7c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:51.894956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d5d62-5568-4c97-b574-82477c075e7c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:51.895230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d5d62-5568-4c97-b574-82477c075e7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:51.904668 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8275e49-cf53-4050-b84e-2b702a71e72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:51.905312 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8275e49-cf53-4050-b84e-2b702a71e72b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:51.905613 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8275e49-cf53-4050-b84e-2b702a71e72b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:51.905891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8275e49-cf53-4050-b84e-2b702a71e72b None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:51.906621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8275e49-cf53-4050-b84e-2b702a71e72b None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:51.906925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8275e49-cf53-4050-b84e-2b702a71e72b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:51.908514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8275e49-cf53-4050-b84e-2b702a71e72b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:51.914126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d5d62-5568-4c97-b574-82477c075e7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:51.917899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 388/786] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:51.923954 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8275e49-cf53-4050-b84e-2b702a71e72b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-cf6d5d62-5568-4c97-b574-82477c075e7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:51.927650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:51.930181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:51.933130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:51.933130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:51.933130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:51.933130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:51.933130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:51.933130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:51.933130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:51.933130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:51.933130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:51.933130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:51.933130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:51.933130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:51.935312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 399/787] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:51.935312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d5d62-5568-4c97-b574-82477c075e7c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:51.978252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:51.999573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:52.045105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8275e49-cf53-4050-b84e-2b702a71e72b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:52.104275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d5d62-5568-4c97-b574-82477c075e7c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:52.116105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67317dd0-157b-4027-b006-dd7ee9981d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:52.116751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67317dd0-157b-4027-b006-dd7ee9981d12 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:52.117021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67317dd0-157b-4027-b006-dd7ee9981d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:52.117284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67317dd0-157b-4027-b006-dd7ee9981d12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:52.136736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67317dd0-157b-4027-b006-dd7ee9981d12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:52.138234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67317dd0-157b-4027-b006-dd7ee9981d12 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-67317dd0-157b-4027-b006-dd7ee9981d12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:52.164305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:52.166551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:52.168977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:52.168977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:52.168977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:52.168977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:52.168977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 389/788] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:52.172040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67317dd0-157b-4027-b006-dd7ee9981d12 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:52.178408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded02b15-21f7-4621-aa0e-19c11e808b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:52.179024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded02b15-21f7-4621-aa0e-19c11e808b47 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:52.179296 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded02b15-21f7-4621-aa0e-19c11e808b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:52.179561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded02b15-21f7-4621-aa0e-19c11e808b47 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:52.180281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded02b15-21f7-4621-aa0e-19c11e808b47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:52.180606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded02b15-21f7-4621-aa0e-19c11e808b47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:52.182860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded02b15-21f7-4621-aa0e-19c11e808b47 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:52.206868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 400/789] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:52.208888 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded02b15-21f7-4621-aa0e-19c11e808b47 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:52.327538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67317dd0-157b-4027-b006-dd7ee9981d12 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:52.329373 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:52.369287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca59927-2148-49d2-91a5-752bd39a9d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:52.370316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca59927-2148-49d2-91a5-752bd39a9d8f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:52.370807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca59927-2148-49d2-91a5-752bd39a9d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:52.372627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca59927-2148-49d2-91a5-752bd39a9d8f None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:52.373561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca59927-2148-49d2-91a5-752bd39a9d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:52.374098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca59927-2148-49d2-91a5-752bd39a9d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:52.377389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca59927-2148-49d2-91a5-752bd39a9d8f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:52.396374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 390/790] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:52.405343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded02b15-21f7-4621-aa0e-19c11e808b47 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:52.405343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:52.406606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca59927-2148-49d2-91a5-752bd39a9d8f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:52.458092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50f763-d18b-4bb5-85c9-dad56ea2802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:52.459262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f763-d18b-4bb5-85c9-dad56ea2802d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:52.459760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f763-d18b-4bb5-85c9-dad56ea2802d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:52.460258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db50f763-d18b-4bb5-85c9-dad56ea2802d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:52.490397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50f763-d18b-4bb5-85c9-dad56ea2802d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:52.492222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db50f763-d18b-4bb5-85c9-dad56ea2802d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-db50f763-d18b-4bb5-85c9-dad56ea2802d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:52.522832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:52.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:52.524694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:52.524694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:52.524694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:52.524694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:52.524914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca59927-2148-49d2-91a5-752bd39a9d8f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:52.535461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 401/791] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:52.540898 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50f763-d18b-4bb5-85c9-dad56ea2802d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:52.564615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95240b33-6922-48c3-b7e8-604d04b4bae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:52.565262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95240b33-6922-48c3-b7e8-604d04b4bae9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:52.565478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95240b33-6922-48c3-b7e8-604d04b4bae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:52.565744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95240b33-6922-48c3-b7e8-604d04b4bae9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:52.583696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95240b33-6922-48c3-b7e8-604d04b4bae9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:52.585182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95240b33-6922-48c3-b7e8-604d04b4bae9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-95240b33-6922-48c3-b7e8-604d04b4bae9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:52.620442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:52.621499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:52.622438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:52.622438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:52.622438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:52.622438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:52.622438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:52.622438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:52.622438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:52.622438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:52.622438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 11:50:52.622438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:52.622972 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 391/792] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Aug 1 11:50:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:52.630534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95240b33-6922-48c3-b7e8-604d04b4bae9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:52.665010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:52.755970 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db50f763-d18b-4bb5-85c9-dad56ea2802d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:52.813963 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95240b33-6922-48c3-b7e8-604d04b4bae9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:52.816522 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31afa0e-7a72-4253-860f-6bb029fd032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:52.817092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31afa0e-7a72-4253-860f-6bb029fd032b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:52.817394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31afa0e-7a72-4253-860f-6bb029fd032b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:52.817669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31afa0e-7a72-4253-860f-6bb029fd032b None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:52.818361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31afa0e-7a72-4253-860f-6bb029fd032b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:52.818664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31afa0e-7a72-4253-860f-6bb029fd032b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:52.820041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31afa0e-7a72-4253-860f-6bb029fd032b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:52.843989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 402/793] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:52.845925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31afa0e-7a72-4253-860f-6bb029fd032b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:52.849593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:52.891579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946940b2-7876-4f26-a9b6-f18e6b17ad91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:52.892775 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946940b2-7876-4f26-a9b6-f18e6b17ad91 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:52.893058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946940b2-7876-4f26-a9b6-f18e6b17ad91 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:52.893356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946940b2-7876-4f26-a9b6-f18e6b17ad91 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:52.894161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946940b2-7876-4f26-a9b6-f18e6b17ad91 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:52.894468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946940b2-7876-4f26-a9b6-f18e6b17ad91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:52.895895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946940b2-7876-4f26-a9b6-f18e6b17ad91 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:52.934683 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 392/794] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Aug 1 11:50:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:52.941670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946940b2-7876-4f26-a9b6-f18e6b17ad91 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:52.948704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31afa0e-7a72-4253-860f-6bb029fd032b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:53.000958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a03d44-ef3c-4870-b155-4c6f97f631b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:53.002820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a03d44-ef3c-4870-b155-4c6f97f631b3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.003094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a03d44-ef3c-4870-b155-4c6f97f631b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.003360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a03d44-ef3c-4870-b155-4c6f97f631b3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.019462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a03d44-ef3c-4870-b155-4c6f97f631b3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:53.020936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a03d44-ef3c-4870-b155-4c6f97f631b3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-31a03d44-ef3c-4870-b155-4c6f97f631b3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:53.038734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:53.041062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:53.043480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:53.043480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:53.043480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:53.043480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:53.043480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:53.043480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:53.043480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:53.043480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:53.043480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:50:53.043480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:53.049348 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 403/795] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Aug 1 11:50:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:53.051460 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a03d44-ef3c-4870-b155-4c6f97f631b3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:53.091173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:53.113437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946940b2-7876-4f26-a9b6-f18e6b17ad91 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:53.145692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:53.150537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce4b28-1170-49bc-8fa7-8505380b7fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:53.151191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce4b28-1170-49bc-8fa7-8505380b7fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.151474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce4b28-1170-49bc-8fa7-8505380b7fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.151749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ce4b28-1170-49bc-8fa7-8505380b7fa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.162545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce4b28-1170-49bc-8fa7-8505380b7fa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:53.164018 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ce4b28-1170-49bc-8fa7-8505380b7fa3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-91ce4b28-1170-49bc-8fa7-8505380b7fa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:53.179913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:53.181021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:53.182021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:53.182021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:53.182021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:53.182021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:53.182021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 393/796] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:53.190251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce4b28-1170-49bc-8fa7-8505380b7fa3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:53.201792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a03d44-ef3c-4870-b155-4c6f97f631b3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:53.250398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82a0a85-8d88-486e-8404-adf6b500fa59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:53.251205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a0a85-8d88-486e-8404-adf6b500fa59 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.251489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a0a85-8d88-486e-8404-adf6b500fa59 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.251758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a0a85-8d88-486e-8404-adf6b500fa59 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.252557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a0a85-8d88-486e-8404-adf6b500fa59 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:53.252862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a0a85-8d88-486e-8404-adf6b500fa59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:53.255124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82a0a85-8d88-486e-8404-adf6b500fa59 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:53.280478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 404/797] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Aug 1 11:50:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:53.281926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea6aaf-6ba5-4b61-81ae-abb28b003c55 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.282356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea6aaf-6ba5-4b61-81ae-abb28b003c55 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.283283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ea6aaf-6ba5-4b61-81ae-abb28b003c55 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.288831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 405/798] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:53.289813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea6aaf-6ba5-4b61-81ae-abb28b003c55 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:53.361105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ce4b28-1170-49bc-8fa7-8505380b7fa3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:53.398415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:53.404392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5e9f86-6320-4618-a626-92a92c1287b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:53.405010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e9f86-6320-4618-a626-92a92c1287b6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.405283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e9f86-6320-4618-a626-92a92c1287b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.405578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5e9f86-6320-4618-a626-92a92c1287b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.406268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e9f86-6320-4618-a626-92a92c1287b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:53.406565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e9f86-6320-4618-a626-92a92c1287b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:53.409198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5e9f86-6320-4618-a626-92a92c1287b6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:53.422739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ea6aaf-6ba5-4b61-81ae-abb28b003c55 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:53.425502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 394/799] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:53.427827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f38c0f-1948-40b0-a7a9-5402ddbb5734 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.428113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f38c0f-1948-40b0-a7a9-5402ddbb5734 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.428379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f38c0f-1948-40b0-a7a9-5402ddbb5734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.450392 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:53.451508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b6f38c0f-1948-40b0-a7a9-5402ddbb5734 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:53.453249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b6f38c0f-1948-40b0-a7a9-5402ddbb5734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:53.465528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ff6b1-c1fd-466a-b396-39162aad7b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:53.466508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ff6b1-c1fd-466a-b396-39162aad7b46 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.467166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ff6b1-c1fd-466a-b396-39162aad7b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.467649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443ff6b1-c1fd-466a-b396-39162aad7b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.529400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 395/800] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:50:53.530329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f38c0f-1948-40b0-a7a9-5402ddbb5734 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:53.546681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ff6b1-c1fd-466a-b396-39162aad7b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:53.549308 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443ff6b1-c1fd-466a-b396-39162aad7b46 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:53.632545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f38c0f-1948-40b0-a7a9-5402ddbb5734 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:53.655208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:53.660288 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 406/801] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:53 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:50:53.660288 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ff6b1-c1fd-466a-b396-39162aad7b46 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:53.668079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39d8197-f479-461b-a0c8-f6afc638ec8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:53.668713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d8197-f479-461b-a0c8-f6afc638ec8e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.668986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d8197-f479-461b-a0c8-f6afc638ec8e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.669252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39d8197-f479-461b-a0c8-f6afc638ec8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.676791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d8197-f479-461b-a0c8-f6afc638ec8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:53.678257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39d8197-f479-461b-a0c8-f6afc638ec8e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:53.681927 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-b39d8197-f479-461b-a0c8-f6afc638ec8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:53.689619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:53.690507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:53.691408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:53.691408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:53.691408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:53.691408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:53.691408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:53.691408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:53.691408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:53.691408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:53.691408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 396/802] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:53.692078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36925870-4140-4900-9dcf-6d3958815bcf None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.692511 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36925870-4140-4900-9dcf-6d3958815bcf None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.692689 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36925870-4140-4900-9dcf-6d3958815bcf None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.693989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 397/803] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:53.694986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9218f5e-decc-4456-98dc-068adb869367 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.695710 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9218f5e-decc-4456-98dc-068adb869367 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.695987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9218f5e-decc-4456-98dc-068adb869367 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.697421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 398/804] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:53.698424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9218f5e-decc-4456-98dc-068adb869367 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:53.767966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443ff6b1-c1fd-466a-b396-39162aad7b46 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:53.801469 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9218f5e-decc-4456-98dc-068adb869367 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:53.802432 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2a7a8-ade0-4e70-a46e-e5ac5efc14b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:53.803068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2a7a8-ade0-4e70-a46e-e5ac5efc14b0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.803349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2a7a8-ade0-4e70-a46e-e5ac5efc14b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.803623 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc2a7a8-ade0-4e70-a46e-e5ac5efc14b0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.804245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2a7a8-ade0-4e70-a46e-e5ac5efc14b0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:53.805660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc2a7a8-ade0-4e70-a46e-e5ac5efc14b0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-3dc2a7a8-ade0-4e70-a46e-e5ac5efc14b0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:53.814539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:53.815739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:53.816838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 407/805] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:53 2022] GET /identity/v3/services/network => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:53.817914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2a7a8-ade0-4e70-a46e-e5ac5efc14b0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:53.837671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4573a85-46a1-4ebb-a12e-ab9cbb34f7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:53.838304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4573a85-46a1-4ebb-a12e-ab9cbb34f7bc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.838583 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4573a85-46a1-4ebb-a12e-ab9cbb34f7bc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.838855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4573a85-46a1-4ebb-a12e-ab9cbb34f7bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.849527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4573a85-46a1-4ebb-a12e-ab9cbb34f7bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:53.850962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4573a85-46a1-4ebb-a12e-ab9cbb34f7bc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-c4573a85-46a1-4ebb-a12e-ab9cbb34f7bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:53.865650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:53.866550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:53.867482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:53.867482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:53.867482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:53.867482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:53.867482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 399/806] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:53.867897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c8ce6-6687-48d8-bff6-da699b997483 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.868192 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c8ce6-6687-48d8-bff6-da699b997483 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.868467 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509c8ce6-6687-48d8-bff6-da699b997483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.885704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-509c8ce6-6687-48d8-bff6-da699b997483 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:53.886829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-509c8ce6-6687-48d8-bff6-da699b997483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:53.905885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:53.913316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:53.921798 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc2a7a8-ade0-4e70-a46e-e5ac5efc14b0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:53.952887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 400/807] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:50:53.954184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7082319-0ede-4879-b13f-f673df519d10 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.954477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7082319-0ede-4879-b13f-f673df519d10 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.954751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7082319-0ede-4879-b13f-f673df519d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.961039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c478-0b1c-40e0-9466-36520c5ea035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:53.961708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c478-0b1c-40e0-9466-36520c5ea035 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:53.961994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c478-0b1c-40e0-9466-36520c5ea035 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:53.962269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5400c478-0b1c-40e0-9466-36520c5ea035 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:53.963026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400c478-0b1c-40e0-9466-36520c5ea035 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:53.963335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400c478-0b1c-40e0-9466-36520c5ea035 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:53.965232 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5400c478-0b1c-40e0-9466-36520c5ea035 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:53.978922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d7082319-0ede-4879-b13f-f673df519d10 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:53.980131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d7082319-0ede-4879-b13f-f673df519d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:53.982341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 408/808] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:53.983230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c478-0b1c-40e0-9466-36520c5ea035 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:54.047300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 401/809] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:50:54.048125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7082319-0ede-4879-b13f-f673df519d10 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:54.083534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5400c478-0b1c-40e0-9466-36520c5ea035 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:54.117389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fa557-4c8b-4cf1-9577-bbd62fce3cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:54.118004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fa557-4c8b-4cf1-9577-bbd62fce3cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:54.118283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fa557-4c8b-4cf1-9577-bbd62fce3cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:54.118556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910fa557-4c8b-4cf1-9577-bbd62fce3cc1 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:54.119234 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fa557-4c8b-4cf1-9577-bbd62fce3cc1 None admin] RBAC: Adding query filter params (name=network) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:54.119540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fa557-4c8b-4cf1-9577-bbd62fce3cc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:54.120919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910fa557-4c8b-4cf1-9577-bbd62fce3cc1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:54.125256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 409/810] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:50:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:54.126069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fa557-4c8b-4cf1-9577-bbd62fce3cc1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:54.137214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:54.145077 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:54.151800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7082319-0ede-4879-b13f-f673df519d10 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:54.186164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5853c-4607-4410-8a90-c5fa25d08072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:54.186778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5853c-4607-4410-8a90-c5fa25d08072 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:54.187056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5853c-4607-4410-8a90-c5fa25d08072 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:54.187324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5853c-4607-4410-8a90-c5fa25d08072 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:54.188003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5853c-4607-4410-8a90-c5fa25d08072 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:54.188576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5853c-4607-4410-8a90-c5fa25d08072 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:54.189751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5853c-4607-4410-8a90-c5fa25d08072 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:54.200761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 402/811] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:54.201582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5853c-4607-4410-8a90-c5fa25d08072 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:54.226645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910fa557-4c8b-4cf1-9577-bbd62fce3cc1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:54.261067 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f466f4-bc6e-4f6d-97f3-a7e7635edcf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:54.261748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f466f4-bc6e-4f6d-97f3-a7e7635edcf8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:54.262029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f466f4-bc6e-4f6d-97f3-a7e7635edcf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:54.262299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f466f4-bc6e-4f6d-97f3-a7e7635edcf8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:54.262931 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f466f4-bc6e-4f6d-97f3-a7e7635edcf8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:54.264316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f466f4-bc6e-4f6d-97f3-a7e7635edcf8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-62f466f4-bc6e-4f6d-97f3-a7e7635edcf8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:54.274154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:54.275343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:54.276170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 410/812] 10.222.0.42 () {56 vars in 1129 bytes} [Mon Aug 1 11:50:54 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:54.277397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f466f4-bc6e-4f6d-97f3-a7e7635edcf8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:54.310590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5853c-4607-4410-8a90-c5fa25d08072 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:54.344291 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffedc7-79e7-4eb0-b369-601e43884899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:54.345631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffedc7-79e7-4eb0-b369-601e43884899 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:54.345918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffedc7-79e7-4eb0-b369-601e43884899 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:54.346203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abffedc7-79e7-4eb0-b369-601e43884899 None admin] PATH_INFO: `/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/fc14241a25484946a0ecc59c9776ac62/roles/17e82eb8c8384f43a591d08c9cf1f63e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:54.359221 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:54.360592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffedc7-79e7-4eb0-b369-601e43884899 None admin] RBAC: Authorizing `identity:create_grant(project_id=99857fcf20fd4cb8b7def2bc2de521bc, user_id=fc14241a25484946a0ecc59c9776ac62, role_id=17e82eb8c8384f43a591d08c9cf1f63e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:54.362301 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abffedc7-79e7-4eb0-b369-601e43884899 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:54.374297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 403/813] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:50:54 2022] PUT /identity/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/fc14241a25484946a0ecc59c9776ac62/roles/17e82eb8c8384f43a591d08c9cf1f63e => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:50:54.375239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffedc7-79e7-4eb0-b369-601e43884899 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:54.379840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:54.388417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f466f4-bc6e-4f6d-97f3-a7e7635edcf8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:54.425448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ad413-5017-4b95-b96c-27574b9783b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:54.426285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ad413-5017-4b95-b96c-27574b9783b0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:54.426667 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ad413-5017-4b95-b96c-27574b9783b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:54.427041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ad413-5017-4b95-b96c-27574b9783b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:54.439291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ad413-5017-4b95-b96c-27574b9783b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b12ad413-5017-4b95-b96c-27574b9783b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:54.444964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:54.446208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:54.447253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:54.447253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:54.447253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:54.447253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:54.447253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:54.447253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:54.447253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:54.447253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:54.447253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:54.447253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:54.447253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:54.447253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:54.448168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 411/814] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:54.449004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ad413-5017-4b95-b96c-27574b9783b0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:54.503346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abffedc7-79e7-4eb0-b369-601e43884899 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:54.543725 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91787c87-d392-4688-a55a-66a7ce00dd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:54.544361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91787c87-d392-4688-a55a-66a7ce00dd9c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:54.544791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91787c87-d392-4688-a55a-66a7ce00dd9c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:54.545076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91787c87-d392-4688-a55a-66a7ce00dd9c None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:54.546183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91787c87-d392-4688-a55a-66a7ce00dd9c None admin] RBAC: Adding query filter params (type=network) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:54.546502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91787c87-d392-4688-a55a-66a7ce00dd9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:54.548343 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91787c87-d392-4688-a55a-66a7ce00dd9c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:54.556323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 404/815] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:50:54 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:54.557372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91787c87-d392-4688-a55a-66a7ce00dd9c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:54.564815 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ad413-5017-4b95-b96c-27574b9783b0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:54.600089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d735e1-53f4-48fc-a668-60e7ccaeab32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:54.601361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d735e1-53f4-48fc-a668-60e7ccaeab32 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:54.601702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d735e1-53f4-48fc-a668-60e7ccaeab32 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:54.601978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d735e1-53f4-48fc-a668-60e7ccaeab32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:54.604095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:54.609287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d735e1-53f4-48fc-a668-60e7ccaeab32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:54.611193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d735e1-53f4-48fc-a668-60e7ccaeab32 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-73d735e1-53f4-48fc-a668-60e7ccaeab32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:54.624259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:54.625237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:54.626711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:54.626711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:54.626711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:54.626711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:54.626711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:54.626711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:54.626711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:54.626711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:54.626711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 412/816] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:54.627200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d735e1-53f4-48fc-a668-60e7ccaeab32 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:54.644501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:54.681963 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91787c87-d392-4688-a55a-66a7ce00dd9c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:54.719114 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26d8f4-1540-4b0c-bb0d-b95ec0cf3676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:54.719739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26d8f4-1540-4b0c-bb0d-b95ec0cf3676 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:54.720048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26d8f4-1540-4b0c-bb0d-b95ec0cf3676 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:54.720320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc26d8f4-1540-4b0c-bb0d-b95ec0cf3676 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:54.720997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26d8f4-1540-4b0c-bb0d-b95ec0cf3676 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:54.721328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26d8f4-1540-4b0c-bb0d-b95ec0cf3676 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:54.722706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc26d8f4-1540-4b0c-bb0d-b95ec0cf3676 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:54.732076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 405/817] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Aug 1 11:50:54 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:54.732076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26d8f4-1540-4b0c-bb0d-b95ec0cf3676 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:54.739226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d735e1-53f4-48fc-a668-60e7ccaeab32 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:54.776210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758283db-b01e-437a-9b14-1b2387e4f5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:54.776862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758283db-b01e-437a-9b14-1b2387e4f5ca None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:54.777088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758283db-b01e-437a-9b14-1b2387e4f5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:54.777403 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758283db-b01e-437a-9b14-1b2387e4f5ca None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:54.778126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758283db-b01e-437a-9b14-1b2387e4f5ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:54.778431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758283db-b01e-437a-9b14-1b2387e4f5ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:54.779808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758283db-b01e-437a-9b14-1b2387e4f5ca None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:54.788795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 413/818] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:54.789521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758283db-b01e-437a-9b14-1b2387e4f5ca None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:54.845148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc26d8f4-1540-4b0c-bb0d-b95ec0cf3676 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:54.852926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:54.876947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:54.882670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995f410-9752-449f-87a4-35dc1728ed42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:54.883344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995f410-9752-449f-87a4-35dc1728ed42 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:54.883560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995f410-9752-449f-87a4-35dc1728ed42 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:54.883827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995f410-9752-449f-87a4-35dc1728ed42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:54.884527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995f410-9752-449f-87a4-35dc1728ed42 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:54.885931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d995f410-9752-449f-87a4-35dc1728ed42 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:54.901596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758283db-b01e-437a-9b14-1b2387e4f5ca None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:54.909270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 406/819] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 11:50:54 2022] POST /identity/v3/endpoints => generated 327 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:50:54.910495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995f410-9752-449f-87a4-35dc1728ed42 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:54.955046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1f5df-6f06-4462-88a3-8997967486ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:54.955811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1f5df-6f06-4462-88a3-8997967486ed None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:54.956098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1f5df-6f06-4462-88a3-8997967486ed None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:54.956373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd1f5df-6f06-4462-88a3-8997967486ed None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:54.957130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1f5df-6f06-4462-88a3-8997967486ed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:54.957566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1f5df-6f06-4462-88a3-8997967486ed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:54.959099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd1f5df-6f06-4462-88a3-8997967486ed None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:54.974580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 414/820] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:54.975457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1f5df-6f06-4462-88a3-8997967486ed None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:55.053895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d995f410-9752-449f-87a4-35dc1728ed42 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:55.091937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af348d9-659f-4b24-a1ef-9949accd5af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:55.092761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af348d9-659f-4b24-a1ef-9949accd5af5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:55.093153 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af348d9-659f-4b24-a1ef-9949accd5af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:55.093455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af348d9-659f-4b24-a1ef-9949accd5af5 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:55.094140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af348d9-659f-4b24-a1ef-9949accd5af5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:55.094446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af348d9-659f-4b24-a1ef-9949accd5af5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:55.094935 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd1f5df-6f06-4462-88a3-8997967486ed None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:55.096385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af348d9-659f-4b24-a1ef-9949accd5af5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:55.102324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 407/821] 10.222.0.42 () {56 vars in 1124 bytes} [Mon Aug 1 11:50:54 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:55.103138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af348d9-659f-4b24-a1ef-9949accd5af5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:55.115844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:55.147160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fbc56-e46e-43b6-a391-f617c4c3cfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:55.147829 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fbc56-e46e-43b6-a391-f617c4c3cfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:55.148109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fbc56-e46e-43b6-a391-f617c4c3cfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:55.148403 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15fbc56-e46e-43b6-a391-f617c4c3cfd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:55.159873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fbc56-e46e-43b6-a391-f617c4c3cfd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:55.161267 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15fbc56-e46e-43b6-a391-f617c4c3cfd2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:55.171875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-a15fbc56-e46e-43b6-a391-f617c4c3cfd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:55.183478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:55.184416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:55.185363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:55.185363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:55.185363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:55.185363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:55.185363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 415/822] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:55.185363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fbc56-e46e-43b6-a391-f617c4c3cfd2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:55.226677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af348d9-659f-4b24-a1ef-9949accd5af5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:55.261031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209adce5-8b8d-4810-9ebf-885c3f844716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:55.261671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209adce5-8b8d-4810-9ebf-885c3f844716 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:55.261945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209adce5-8b8d-4810-9ebf-885c3f844716 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:55.262212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209adce5-8b8d-4810-9ebf-885c3f844716 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:55.262987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209adce5-8b8d-4810-9ebf-885c3f844716 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=f85279b6b3474c77be0d8d569feea5f2) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:55.263289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209adce5-8b8d-4810-9ebf-885c3f844716 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:55.264703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209adce5-8b8d-4810-9ebf-885c3f844716 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:55.271665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 408/823] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:55 2022] GET /identity/v3/role_assignments?user.id=f85279b6b3474c77be0d8d569feea5f2&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=0195bf688a7e464e8ff594afe80b050e => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:55.278754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209adce5-8b8d-4810-9ebf-885c3f844716 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:55.299018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15fbc56-e46e-43b6-a391-f617c4c3cfd2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:55.346889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7257156-c62d-4bb6-aac5-c6e267302a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:55.347296 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7257156-c62d-4bb6-aac5-c6e267302a3b None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:55.347577 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7257156-c62d-4bb6-aac5-c6e267302a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:55.347845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7257156-c62d-4bb6-aac5-c6e267302a3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:55.348703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7257156-c62d-4bb6-aac5-c6e267302a3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:55.350082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7257156-c62d-4bb6-aac5-c6e267302a3b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:55.379215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 416/824] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 11:50:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:50:55.426726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209adce5-8b8d-4810-9ebf-885c3f844716 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:55.446921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:55.474462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b724e8-4402-40f5-b02e-92c997d21864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:55.475086 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b724e8-4402-40f5-b02e-92c997d21864 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:55.475374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b724e8-4402-40f5-b02e-92c997d21864 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:55.475646 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b724e8-4402-40f5-b02e-92c997d21864 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:55.476594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b724e8-4402-40f5-b02e-92c997d21864 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:55.476897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b724e8-4402-40f5-b02e-92c997d21864 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:55.478330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b724e8-4402-40f5-b02e-92c997d21864 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:55.493482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 409/825] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:55.499102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7257156-c62d-4bb6-aac5-c6e267302a3b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:55.529214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:55.618630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7257156-c62d-4bb6-aac5-c6e267302a3b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:55.653785 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9e6b1-7e08-4033-b299-aea1f8189d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:55.654794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9e6b1-7e08-4033-b299-aea1f8189d1b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:55.655270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9e6b1-7e08-4033-b299-aea1f8189d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:55.655737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9e6b1-7e08-4033-b299-aea1f8189d1b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:55.663872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9e6b1-7e08-4033-b299-aea1f8189d1b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:55.665626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9e6b1-7e08-4033-b299-aea1f8189d1b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d7c9e6b1-7e08-4033-b299-aea1f8189d1b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:55.678016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:55.678946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:55.679894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:55.679894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:55.679894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:55.679894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:55.679894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:55.679894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:55.679894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:55.679894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:55.679894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 11:50:55.679894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:55.682444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 417/826] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:55.689350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b724e8-4402-40f5-b02e-92c997d21864 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:55.799040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b724e8-4402-40f5-b02e-92c997d21864 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:55.836875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffe94d-22d2-4727-8937-3a44fb4ddf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:55.837861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffe94d-22d2-4727-8937-3a44fb4ddf91 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:55.838354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffe94d-22d2-4727-8937-3a44fb4ddf91 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:55.838819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ffe94d-22d2-4727-8937-3a44fb4ddf91 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:55.839813 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffe94d-22d2-4727-8937-3a44fb4ddf91 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:55.840313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffe94d-22d2-4727-8937-3a44fb4ddf91 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:55.842018 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ffe94d-22d2-4727-8937-3a44fb4ddf91 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:55.861277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 410/827] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Aug 1 11:50:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:55.871494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9e6b1-7e08-4033-b299-aea1f8189d1b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:55.956924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:55.977258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9e6b1-7e08-4033-b299-aea1f8189d1b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:56.012631 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77f78f-d92b-4c3b-9237-60de2325206f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:56.013726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77f78f-d92b-4c3b-9237-60de2325206f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:56.014012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77f78f-d92b-4c3b-9237-60de2325206f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:56.014284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77f78f-d92b-4c3b-9237-60de2325206f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:56.025367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77f78f-d92b-4c3b-9237-60de2325206f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:56.026837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77f78f-d92b-4c3b-9237-60de2325206f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-cd77f78f-d92b-4c3b-9237-60de2325206f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:56.042049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:56.042978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:56.044277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:56.044277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:56.044277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:56.044277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:56.044277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 418/828] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:56.049633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffe94d-22d2-4727-8937-3a44fb4ddf91 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:56.080275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:56.155887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ffe94d-22d2-4727-8937-3a44fb4ddf91 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:56.191912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844263d-d5a5-43d9-8276-59c6b580b451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:56.192526 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844263d-d5a5-43d9-8276-59c6b580b451 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:56.192799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844263d-d5a5-43d9-8276-59c6b580b451 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:56.193068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844263d-d5a5-43d9-8276-59c6b580b451 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:56.193849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844263d-d5a5-43d9-8276-59c6b580b451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:56.194152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844263d-d5a5-43d9-8276-59c6b580b451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:56.195588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844263d-d5a5-43d9-8276-59c6b580b451 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:56.207586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 411/829] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:56.212683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77f78f-d92b-4c3b-9237-60de2325206f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:56.320857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77f78f-d92b-4c3b-9237-60de2325206f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:56.350485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:56.355685 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a1bd1f-cbfc-44d6-a003-35c912b71a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:56.356327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bd1f-cbfc-44d6-a003-35c912b71a69 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:56.357036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bd1f-cbfc-44d6-a003-35c912b71a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:56.357669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a1bd1f-cbfc-44d6-a003-35c912b71a69 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:56.364855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1bd1f-cbfc-44d6-a003-35c912b71a69 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:56.366473 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a1bd1f-cbfc-44d6-a003-35c912b71a69 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-86a1bd1f-cbfc-44d6-a003-35c912b71a69 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:56.378947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:56.379830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:56.381194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:56.381194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:56.381194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:56.381194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:56.381194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:56.381194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:56.381194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:56.381194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:56.381194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 419/830] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:56.385871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844263d-d5a5-43d9-8276-59c6b580b451 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:56.457697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8550d-3b1f-46f3-addf-550c4bc79fa0 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:56.457938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8550d-3b1f-46f3-addf-550c4bc79fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:56.458167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8550d-3b1f-46f3-addf-550c4bc79fa0 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:56.459764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 420/831] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:50:56.466451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd131f-d2ba-4109-8ac1-b397ca7a8abb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:56.466847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd131f-d2ba-4109-8ac1-b397ca7a8abb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:56.467225 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bd131f-d2ba-4109-8ac1-b397ca7a8abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:56.479266 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:56.486519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-98bd131f-d2ba-4109-8ac1-b397ca7a8abb None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:56.487831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-98bd131f-d2ba-4109-8ac1-b397ca7a8abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:56.490414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844263d-d5a5-43d9-8276-59c6b580b451 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:56.531733 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365299e7-42b6-4818-ba07-13508ec55c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:56.532967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365299e7-42b6-4818-ba07-13508ec55c26 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:56.533244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365299e7-42b6-4818-ba07-13508ec55c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:56.533541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365299e7-42b6-4818-ba07-13508ec55c26 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:56.534778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365299e7-42b6-4818-ba07-13508ec55c26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:56.535082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365299e7-42b6-4818-ba07-13508ec55c26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:56.537251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365299e7-42b6-4818-ba07-13508ec55c26 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:56.554096 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 412/832] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:56.559491 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365299e7-42b6-4818-ba07-13508ec55c26 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:56.577123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 421/833] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:50:56.594817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd131f-d2ba-4109-8ac1-b397ca7a8abb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:56.681401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365299e7-42b6-4818-ba07-13508ec55c26 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:56.712662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bd131f-d2ba-4109-8ac1-b397ca7a8abb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:56.719964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ffe82-fd77-4bc0-8213-4b836d4b397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:56.720689 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ffe82-fd77-4bc0-8213-4b836d4b397f None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:56.720972 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ffe82-fd77-4bc0-8213-4b836d4b397f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:56.721244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ffe82-fd77-4bc0-8213-4b836d4b397f None admin] PATH_INFO: `/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/e2dfb83ec65645459d41579b4b036ee5/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:56.723396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ffe82-fd77-4bc0-8213-4b836d4b397f None admin] RBAC: Authorizing `identity:create_grant(project_id=99857fcf20fd4cb8b7def2bc2de521bc, user_id=e2dfb83ec65645459d41579b4b036ee5, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:56.724833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ffe82-fd77-4bc0-8213-4b836d4b397f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:56.740785 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:56.745340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 413/834] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:50:56 2022] PUT /identity/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/e2dfb83ec65645459d41579b4b036ee5/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:50:56.764654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d297e-36ad-4e80-985d-aeda79e5dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:56.765771 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d297e-36ad-4e80-985d-aeda79e5dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:56.766256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d297e-36ad-4e80-985d-aeda79e5dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:56.767272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d297e-36ad-4e80-985d-aeda79e5dcc5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:56.780853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d297e-36ad-4e80-985d-aeda79e5dcc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-526d297e-36ad-4e80-985d-aeda79e5dcc5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:56.786744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:56.787744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:56.788603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:56.788603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:56.788603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:56.788603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:56.788603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:56.788603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:56.788603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:56.788603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:56.788603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:56.788603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:56.788603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:50:56.788603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:56.791144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 422/835] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:50:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:56.796977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ffe82-fd77-4bc0-8213-4b836d4b397f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:56.837898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:56.911551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ffe82-fd77-4bc0-8213-4b836d4b397f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:56.947122 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75403f2a-d057-406f-b378-7dd3d760e53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:56.947746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75403f2a-d057-406f-b378-7dd3d760e53d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:56.948026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75403f2a-d057-406f-b378-7dd3d760e53d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:56.948298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75403f2a-d057-406f-b378-7dd3d760e53d None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:56.949012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75403f2a-d057-406f-b378-7dd3d760e53d None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:56.949383 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75403f2a-d057-406f-b378-7dd3d760e53d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:56.950863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75403f2a-d057-406f-b378-7dd3d760e53d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:56.962426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 414/836] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:50:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:50:56.969261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d297e-36ad-4e80-985d-aeda79e5dcc5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:57.077645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d297e-36ad-4e80-985d-aeda79e5dcc5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:57.114558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658b55f-0551-4ace-9e4c-722e48868256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:57.115205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658b55f-0551-4ace-9e4c-722e48868256 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:57.115486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658b55f-0551-4ace-9e4c-722e48868256 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:57.115755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8658b55f-0551-4ace-9e4c-722e48868256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:57.127295 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658b55f-0551-4ace-9e4c-722e48868256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:57.128770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8658b55f-0551-4ace-9e4c-722e48868256 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8658b55f-0551-4ace-9e4c-722e48868256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:57.144488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:57.145451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:57.146361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:57.146361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:57.146361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:57.146361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:57.146361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 423/837] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:50:57.152686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75403f2a-d057-406f-b378-7dd3d760e53d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:57.228559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:57.265458 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75403f2a-d057-406f-b378-7dd3d760e53d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:57.311292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0638c25-5357-4c5d-aad9-f8985f3f45a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:57.311932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0638c25-5357-4c5d-aad9-f8985f3f45a6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:57.312213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0638c25-5357-4c5d-aad9-f8985f3f45a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:57.312487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0638c25-5357-4c5d-aad9-f8985f3f45a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:57.313180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0638c25-5357-4c5d-aad9-f8985f3f45a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:57.313588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0638c25-5357-4c5d-aad9-f8985f3f45a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:57.315452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0638c25-5357-4c5d-aad9-f8985f3f45a6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:57.328141 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 415/838] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:57.333870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658b55f-0551-4ace-9e4c-722e48868256 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:57.373756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:57.441889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8658b55f-0551-4ace-9e4c-722e48868256 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:57.477651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfc3b0-f440-48c8-bf48-6d29126435bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:57.478292 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfc3b0-f440-48c8-bf48-6d29126435bf None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:57.478622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfc3b0-f440-48c8-bf48-6d29126435bf None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:57.478892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dfc3b0-f440-48c8-bf48-6d29126435bf None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:57.487317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfc3b0-f440-48c8-bf48-6d29126435bf None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:57.488852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dfc3b0-f440-48c8-bf48-6d29126435bf None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:57.490896 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36b1cc-cb56-45c7-b205-40676093a19b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:57.491178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36b1cc-cb56-45c7-b205-40676093a19b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:57.491449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36b1cc-cb56-45c7-b205-40676093a19b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:57.492921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 416/839] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:50:57.497772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7e5c8-fe5d-4031-a150-3f42d43a3513 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:57.498140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7e5c8-fe5d-4031-a150-3f42d43a3513 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:57.498491 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7e5c8-fe5d-4031-a150-3f42d43a3513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-a6dfc3b0-f440-48c8-bf48-6d29126435bf None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:57.505572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:57.506527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:57.507466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:57.507466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:57.507466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:57.507466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:57.507466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:57.507466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:57.507466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:57.507466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:57.507466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 11:50:57.507466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:50:57.508004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 424/840] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Aug 1 11:50:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:57.514859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfc3b0-f440-48c8-bf48-6d29126435bf None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:57.520155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-42f7e5c8-fe5d-4031-a150-3f42d43a3513 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:57.523287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-42f7e5c8-fe5d-4031-a150-3f42d43a3513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:57.594732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 417/841] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:50:57.596014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8608aa-9f0e-4827-ba4d-b107e57065bd None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:57.596299 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8608aa-9f0e-4827-ba4d-b107e57065bd None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:57.596572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8608aa-9f0e-4827-ba4d-b107e57065bd None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:57.602076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 418/842] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:50:57.603505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f70528-6270-4b81-8fd6-8bddbf7e5c0f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:57.603984 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f70528-6270-4b81-8fd6-8bddbf7e5c0f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:57.604256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f70528-6270-4b81-8fd6-8bddbf7e5c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:57.622372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d7f70528-6270-4b81-8fd6-8bddbf7e5c0f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:57.623555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d7f70528-6270-4b81-8fd6-8bddbf7e5c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:57.633644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:57.641322 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dfc3b0-f440-48c8-bf48-6d29126435bf None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:57.676853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b3e66-3522-441a-aa35-57dd5218f219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:57.677529 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3e66-3522-441a-aa35-57dd5218f219 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:57.677808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3e66-3522-441a-aa35-57dd5218f219 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:57.678081 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b3e66-3522-441a-aa35-57dd5218f219 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:57.678872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b3e66-3522-441a-aa35-57dd5218f219 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:57.679180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b3e66-3522-441a-aa35-57dd5218f219 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:57.680616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b3e66-3522-441a-aa35-57dd5218f219 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:57.684554 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:57.696462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 419/843] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:57 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:50:57.698443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f70528-6270-4b81-8fd6-8bddbf7e5c0f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:57.705175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 425/844] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Aug 1 11:50:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:57.706277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b3e66-3522-441a-aa35-57dd5218f219 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:57.812978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f70528-6270-4b81-8fd6-8bddbf7e5c0f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:57.816487 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b3e66-3522-441a-aa35-57dd5218f219 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:57.847691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc666e9-297d-427b-b8e0-600137e823d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:57.848327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc666e9-297d-427b-b8e0-600137e823d3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:57.848601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc666e9-297d-427b-b8e0-600137e823d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:57.848867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc666e9-297d-427b-b8e0-600137e823d3 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:57.849509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc666e9-297d-427b-b8e0-600137e823d3 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:57.850874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc666e9-297d-427b-b8e0-600137e823d3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:57.855543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6455c1-3fef-48b7-9516-bd8b8e5b1542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:57.856152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6455c1-3fef-48b7-9516-bd8b8e5b1542 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:57.856431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6455c1-3fef-48b7-9516-bd8b8e5b1542 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:57.856699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6455c1-3fef-48b7-9516-bd8b8e5b1542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-8bc666e9-297d-427b-b8e0-600137e823d3 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:57.860117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:57.861654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:57.862501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 420/845] 10.222.0.42 () {56 vars in 1132 bytes} [Mon Aug 1 11:50:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:57.863354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc666e9-297d-427b-b8e0-600137e823d3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:57.885027 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:57.927860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:57.935964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6455c1-3fef-48b7-9516-bd8b8e5b1542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:57.937658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6455c1-3fef-48b7-9516-bd8b8e5b1542 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:57.975857 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc666e9-297d-427b-b8e0-600137e823d3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:58.014076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626acf9c-8090-48f9-a134-11ccbc4ea7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:58.014721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626acf9c-8090-48f9-a134-11ccbc4ea7bd None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:58.014998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626acf9c-8090-48f9-a134-11ccbc4ea7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:58.015270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626acf9c-8090-48f9-a134-11ccbc4ea7bd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:58.015897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626acf9c-8090-48f9-a134-11ccbc4ea7bd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:58.017286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626acf9c-8090-48f9-a134-11ccbc4ea7bd None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-626acf9c-8090-48f9-a134-11ccbc4ea7bd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:58.026003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:58.026988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:58.027840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 421/846] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:50:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:58.028673 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626acf9c-8090-48f9-a134-11ccbc4ea7bd None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:58.070640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 426/847] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:50:57 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:50:58.072629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6455c1-3fef-48b7-9516-bd8b8e5b1542 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:58.129133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:58.138337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626acf9c-8090-48f9-a134-11ccbc4ea7bd None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:58.158664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:58.175780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d3199-6449-4586-baf3-8c0984a3377a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:58.176461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d3199-6449-4586-baf3-8c0984a3377a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:58.176849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d3199-6449-4586-baf3-8c0984a3377a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:58.177128 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d3199-6449-4586-baf3-8c0984a3377a None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:58.177837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d3199-6449-4586-baf3-8c0984a3377a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:58.178144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d3199-6449-4586-baf3-8c0984a3377a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:58.179508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d3199-6449-4586-baf3-8c0984a3377a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:58.180557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6455c1-3fef-48b7-9516-bd8b8e5b1542 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:58.189017 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 422/848] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Aug 1 11:50:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:58.189017 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d3199-6449-4586-baf3-8c0984a3377a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:58.217738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb65290-5eef-48d7-8ee5-b13b911a28c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:58.218356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb65290-5eef-48d7-8ee5-b13b911a28c2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:58.218635 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb65290-5eef-48d7-8ee5-b13b911a28c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:58.218909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb65290-5eef-48d7-8ee5-b13b911a28c2 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:58.219576 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb65290-5eef-48d7-8ee5-b13b911a28c2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:58.220378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb65290-5eef-48d7-8ee5-b13b911a28c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:58.221790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb65290-5eef-48d7-8ee5-b13b911a28c2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:58.229345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 427/849] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:50:58 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:58.229345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb65290-5eef-48d7-8ee5-b13b911a28c2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:58.307429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d3199-6449-4586-baf3-8c0984a3377a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:58.342262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf0a9b-388f-4089-a24a-3baefe1271e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:58.342825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf0a9b-388f-4089-a24a-3baefe1271e6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:58.343102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf0a9b-388f-4089-a24a-3baefe1271e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:58.343376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf0a9b-388f-4089-a24a-3baefe1271e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:58.343508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb65290-5eef-48d7-8ee5-b13b911a28c2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:58.359502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf0a9b-388f-4089-a24a-3baefe1271e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:58.361368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:58.361918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf0a9b-388f-4089-a24a-3baefe1271e6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-03cf0a9b-388f-4089-a24a-3baefe1271e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:58.379778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:58.380874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:58.382075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:58.382075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:58.382075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:58.382075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:58.382360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc564d14-e4b2-4350-8421-8fd84ac44cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:58.382360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc564d14-e4b2-4350-8421-8fd84ac44cec None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:58.382360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc564d14-e4b2-4350-8421-8fd84ac44cec None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:58.382360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc564d14-e4b2-4350-8421-8fd84ac44cec None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:58.382683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc564d14-e4b2-4350-8421-8fd84ac44cec None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:58.382683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc564d14-e4b2-4350-8421-8fd84ac44cec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:58.383333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc564d14-e4b2-4350-8421-8fd84ac44cec None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:58.388282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 423/850] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:58.388282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf0a9b-388f-4089-a24a-3baefe1271e6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:58.388494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 428/851] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Aug 1 11:50:58 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:58.389032 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc564d14-e4b2-4350-8421-8fd84ac44cec None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:58.439136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:58.515249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf0a9b-388f-4089-a24a-3baefe1271e6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:58.519790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc564d14-e4b2-4350-8421-8fd84ac44cec None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:58.554957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d89d-082d-43c9-b115-5cc793bc4249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:58.555695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d89d-082d-43c9-b115-5cc793bc4249 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:58.556143 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d89d-082d-43c9-b115-5cc793bc4249 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:58.556488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f69d89d-082d-43c9-b115-5cc793bc4249 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:58.557254 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d89d-082d-43c9-b115-5cc793bc4249 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:58.557660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d89d-082d-43c9-b115-5cc793bc4249 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:58.559270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f69d89d-082d-43c9-b115-5cc793bc4249 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:58.572127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 424/852] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:50:58 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:58.572359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ffcf3-a059-4861-8dea-837000c61a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:58.572359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ffcf3-a059-4861-8dea-837000c61a92 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:58.572359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ffcf3-a059-4861-8dea-837000c61a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:58.572359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ffcf3-a059-4861-8dea-837000c61a92 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:58.572783 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ffcf3-a059-4861-8dea-837000c61a92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:58.572783 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ffcf3-a059-4861-8dea-837000c61a92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:58.573911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ffcf3-a059-4861-8dea-837000c61a92 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:58.589584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 429/853] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:58.607510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d89d-082d-43c9-b115-5cc793bc4249 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:58.721684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f69d89d-082d-43c9-b115-5cc793bc4249 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:58.729622 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:58.758940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220bbdc-5074-4dcb-b77a-7cbe9d6c0ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:58.759595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220bbdc-5074-4dcb-b77a-7cbe9d6c0ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:58.759872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220bbdc-5074-4dcb-b77a-7cbe9d6c0ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:58.760142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220bbdc-5074-4dcb-b77a-7cbe9d6c0ed7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:58.768028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220bbdc-5074-4dcb-b77a-7cbe9d6c0ed7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:58.769569 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220bbdc-5074-4dcb-b77a-7cbe9d6c0ed7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d220bbdc-5074-4dcb-b77a-7cbe9d6c0ed7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:50:58.781231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:58.782255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:58.784070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:50:58.784070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:50:58.784070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:50:58.784070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:50:58.784070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:50:58.784070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:50:58.784070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:50:58.784070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:58.784070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 425/854] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:50:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:58.789169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ffcf3-a059-4861-8dea-837000c61a92 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:58.834059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:58.896294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ffcf3-a059-4861-8dea-837000c61a92 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:58.896467 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d70ee-c298-4a7e-8a47-3f8532b85bc1 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:58.896875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d70ee-c298-4a7e-8a47-3f8532b85bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:58.896948 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d70ee-c298-4a7e-8a47-3f8532b85bc1 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:58.898540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 426/855] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:50:58.903873 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31804317-fc99-472a-a4b1-108a36f95b0c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:58.904432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31804317-fc99-472a-a4b1-108a36f95b0c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:58.904936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31804317-fc99-472a-a4b1-108a36f95b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:58.926034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-31804317-fc99-472a-a4b1-108a36f95b0c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:50:58.928230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-31804317-fc99-472a-a4b1-108a36f95b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:50:58.932131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe835c4-b259-467b-a197-b00f785b6cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:58.933045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe835c4-b259-467b-a197-b00f785b6cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:58.933448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe835c4-b259-467b-a197-b00f785b6cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:58.933818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe835c4-b259-467b-a197-b00f785b6cf0 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:58.934664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe835c4-b259-467b-a197-b00f785b6cf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:58.935084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe835c4-b259-467b-a197-b00f785b6cf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:58.936621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe835c4-b259-467b-a197-b00f785b6cf0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:58.958660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 430/856] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:50:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:58.964900 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe835c4-b259-467b-a197-b00f785b6cf0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:59.023954 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 427/857] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:50:58 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:50:59.043496 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31804317-fc99-472a-a4b1-108a36f95b0c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:59.095739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:59.100554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe835c4-b259-467b-a197-b00f785b6cf0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:59.138208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0545104-61df-47ae-9586-e8fd3cf98b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:59.138985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0545104-61df-47ae-9586-e8fd3cf98b7a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:59.139362 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0545104-61df-47ae-9586-e8fd3cf98b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:59.139729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0545104-61df-47ae-9586-e8fd3cf98b7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:59.140663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0545104-61df-47ae-9586-e8fd3cf98b7a None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=fc14241a25484946a0ecc59c9776ac62) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:59.141144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0545104-61df-47ae-9586-e8fd3cf98b7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:59.143297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0545104-61df-47ae-9586-e8fd3cf98b7a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:59.155656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 431/858] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:50:58 2022] GET /identity/v3/role_assignments?user.id=fc14241a25484946a0ecc59c9776ac62&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:59.161289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:59.169911 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31804317-fc99-472a-a4b1-108a36f95b0c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:59.210907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf1775-d799-4fe2-a52c-6ee59bbc5097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:59.211628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf1775-d799-4fe2-a52c-6ee59bbc5097 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:59.213326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf1775-d799-4fe2-a52c-6ee59bbc5097 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:59.213637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf1775-d799-4fe2-a52c-6ee59bbc5097 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:59.226937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf1775-d799-4fe2-a52c-6ee59bbc5097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d2bf1775-d799-4fe2-a52c-6ee59bbc5097 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:50:59.232113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:59.233063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:59.233924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 428/859] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:59.240399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0545104-61df-47ae-9586-e8fd3cf98b7a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:59.354848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0545104-61df-47ae-9586-e8fd3cf98b7a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:59.390857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b864d-36a3-4333-b2ef-d7712a35cfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:59.391568 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b864d-36a3-4333-b2ef-d7712a35cfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:59.391852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b864d-36a3-4333-b2ef-d7712a35cfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:59.392126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79b864d-36a3-4333-b2ef-d7712a35cfa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:59.392850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b864d-36a3-4333-b2ef-d7712a35cfa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:59.393147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b864d-36a3-4333-b2ef-d7712a35cfa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:59.394563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79b864d-36a3-4333-b2ef-d7712a35cfa8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:59.403317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 432/860] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:50:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:59.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf1775-d799-4fe2-a52c-6ee59bbc5097 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:59.517628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf1775-d799-4fe2-a52c-6ee59bbc5097 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:59.552274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635c3de-7852-4df4-b69c-317f38136b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:59.552979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635c3de-7852-4df4-b69c-317f38136b25 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:59.553260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635c3de-7852-4df4-b69c-317f38136b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:59.553559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f635c3de-7852-4df4-b69c-317f38136b25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:59.564943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635c3de-7852-4df4-b69c-317f38136b25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:59.566682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f635c3de-7852-4df4-b69c-317f38136b25 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-f635c3de-7852-4df4-b69c-317f38136b25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:50:59.582494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:59.583403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:59.584292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:50:59.584292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:50:59.584292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:50:59.584292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:59.586503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 429/861] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:50:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:59.591812 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b864d-36a3-4333-b2ef-d7712a35cfa8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:59.630059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:59.707481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79b864d-36a3-4333-b2ef-d7712a35cfa8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:59.745756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0750d2-2f33-4919-9b16-3b9e1c189a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:59.746743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0750d2-2f33-4919-9b16-3b9e1c189a59 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:59.747225 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0750d2-2f33-4919-9b16-3b9e1c189a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:59.747695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0750d2-2f33-4919-9b16-3b9e1c189a59 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:59.748603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0750d2-2f33-4919-9b16-3b9e1c189a59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:50:59.749107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0750d2-2f33-4919-9b16-3b9e1c189a59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:59.750718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0750d2-2f33-4919-9b16-3b9e1c189a59 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:59.767751 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 433/862] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:50:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:50:59.773189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635c3de-7852-4df4-b69c-317f38136b25 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:50:59.776533 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:50:59.887267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f635c3de-7852-4df4-b69c-317f38136b25 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:50:59.923410 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d7719-6b1e-4951-a8d6-afedf4c4b002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:50:59.924295 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d7719-6b1e-4951-a8d6-afedf4c4b002 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:50:59.924295 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d7719-6b1e-4951-a8d6-afedf4c4b002 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:50:59.924584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d7719-6b1e-4951-a8d6-afedf4c4b002 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:50:59.934350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d7719-6b1e-4951-a8d6-afedf4c4b002 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:50:59.935797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d7719-6b1e-4951-a8d6-afedf4c4b002 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d49d7719-6b1e-4951-a8d6-afedf4c4b002 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:50:59.954574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:50:59.955582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:50:59.956536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:50:59.956536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:50:59.956536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:50:59.956536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:50:59.956536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:50:59.956536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:50:59.956536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:50:59.956536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:50:59.956536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 11:50:59.956536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:50:59.956536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 430/863] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:50:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:50:59.965521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0750d2-2f33-4919-9b16-3b9e1c189a59 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:00.057810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:00.075531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0750d2-2f33-4919-9b16-3b9e1c189a59 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:00.111900 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3367032-2e06-45d2-a325-36467abbef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:00.112523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3367032-2e06-45d2-a325-36467abbef92 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:00.112770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3367032-2e06-45d2-a325-36467abbef92 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:00.113045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3367032-2e06-45d2-a325-36467abbef92 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:00.113937 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3367032-2e06-45d2-a325-36467abbef92 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:00.114246 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3367032-2e06-45d2-a325-36467abbef92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:00.115768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3367032-2e06-45d2-a325-36467abbef92 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:00.133557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 434/864] 10.222.0.42 () {56 vars in 1135 bytes} [Mon Aug 1 11:50:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:00.139151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d7719-6b1e-4951-a8d6-afedf4c4b002 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:00.202955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:00.246013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d7719-6b1e-4951-a8d6-afedf4c4b002 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:00.285072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cbd887-e1e2-4d57-8cee-dc2a55ef9ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:00.285728 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbd887-e1e2-4d57-8cee-dc2a55ef9ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:00.286004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbd887-e1e2-4d57-8cee-dc2a55ef9ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:00.286271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cbd887-e1e2-4d57-8cee-dc2a55ef9ba9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:00.355435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbd887-e1e2-4d57-8cee-dc2a55ef9ba9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:00.356874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cbd887-e1e2-4d57-8cee-dc2a55ef9ba9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:00.417476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:00.459012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 431/865] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:51:00 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:51:00.464336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3367032-2e06-45d2-a325-36467abbef92 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:00.525510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b3f19-037f-413b-8073-9e92820a8c55 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:00.526114 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b3f19-037f-413b-8073-9e92820a8c55 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:00.526607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b3f19-037f-413b-8073-9e92820a8c55 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:00.529339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 432/866] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:00.533990 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499146a-f1e1-42c2-a024-edd5f4eca60a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:00.534504 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499146a-f1e1-42c2-a024-edd5f4eca60a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:00.534991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499146a-f1e1-42c2-a024-edd5f4eca60a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:00.554034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b499146a-f1e1-42c2-a024-edd5f4eca60a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:00.555635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b499146a-f1e1-42c2-a024-edd5f4eca60a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:00.573371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3367032-2e06-45d2-a325-36467abbef92 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:00.619717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ffe06-0c26-4442-9f71-f15d90f08d61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:00.620353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ffe06-0c26-4442-9f71-f15d90f08d61 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:00.620632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ffe06-0c26-4442-9f71-f15d90f08d61 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:00.620901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834ffe06-0c26-4442-9f71-f15d90f08d61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:00.631384 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ffe06-0c26-4442-9f71-f15d90f08d61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:00.632932 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834ffe06-0c26-4442-9f71-f15d90f08d61 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:00.637564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 433/867] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:00.640506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-834ffe06-0c26-4442-9f71-f15d90f08d61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:00.653339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:00.654255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:00.655162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:00.655162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:00.655162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:00.655162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:00.655162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 435/868] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:00.656098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499146a-f1e1-42c2-a024-edd5f4eca60a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:00.659864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ffe06-0c26-4442-9f71-f15d90f08d61 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:00.760723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:00.769201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834ffe06-0c26-4442-9f71-f15d90f08d61 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:00.770925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499146a-f1e1-42c2-a024-edd5f4eca60a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:00.805989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c16b7-21c9-4778-8964-57569340da61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:00.806531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c16b7-21c9-4778-8964-57569340da61 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:00.806813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c16b7-21c9-4778-8964-57569340da61 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:00.807127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c16b7-21c9-4778-8964-57569340da61 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:00.807717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bab30-137c-49a0-ba28-84d2728a5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:00.807827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c16b7-21c9-4778-8964-57569340da61 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:00.808330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bab30-137c-49a0-ba28-84d2728a5123 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:00.808607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bab30-137c-49a0-ba28-84d2728a5123 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:00.808877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bab30-137c-49a0-ba28-84d2728a5123 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:00.809128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c16b7-21c9-4778-8964-57569340da61 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:00.809606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bab30-137c-49a0-ba28-84d2728a5123 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:00.809909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bab30-137c-49a0-ba28-84d2728a5123 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:00.811258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617bab30-137c-49a0-ba28-84d2728a5123 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:00.824590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 434/869] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:00.825660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20d300-4771-4783-8f4d-1daf5d9bd3c3 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:00.825941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20d300-4771-4783-8f4d-1daf5d9bd3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:00.826211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20d300-4771-4783-8f4d-1daf5d9bd3c3 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:00.835461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 435/870] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:00.835653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 436/871] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:51:00 2022] POST /identity/v3/services => generated 269 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 11:51:00.835736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20d300-4771-4783-8f4d-1daf5d9bd3c3 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:00.837468 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60afa50-6a86-4f24-8343-e9cc9fbffcff None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:00.837959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60afa50-6a86-4f24-8343-e9cc9fbffcff None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:00.838388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60afa50-6a86-4f24-8343-e9cc9fbffcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:00.862983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b60afa50-6a86-4f24-8343-e9cc9fbffcff None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:00.865222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b60afa50-6a86-4f24-8343-e9cc9fbffcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:00.943026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:00.961271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20d300-4771-4783-8f4d-1daf5d9bd3c3 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:00.976632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 437/872] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:00 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:01.000349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60afa50-6a86-4f24-8343-e9cc9fbffcff None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:01.011878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f389c1-a876-430d-bfd4-2fd98d4f3a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:01.012525 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f389c1-a876-430d-bfd4-2fd98d4f3a9d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:01.012800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f389c1-a876-430d-bfd4-2fd98d4f3a9d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:01.013066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f389c1-a876-430d-bfd4-2fd98d4f3a9d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:01.021087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f389c1-a876-430d-bfd4-2fd98d4f3a9d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:01.023583 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f389c1-a876-430d-bfd4-2fd98d4f3a9d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-c1f389c1-a876-430d-bfd4-2fd98d4f3a9d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:51:01.036835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:01.038001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:01.039231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:51:01.039231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:51:01.039231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:51:01.039231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:51:01.039231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:51:01.039231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:51:01.039231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:01.039231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:01.039231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 436/873] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:51:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:01.044463 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f389c1-a876-430d-bfd4-2fd98d4f3a9d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:01.058595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:01.132875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60afa50-6a86-4f24-8343-e9cc9fbffcff None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:01.160598 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f389c1-a876-430d-bfd4-2fd98d4f3a9d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:01.171035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9efa9-573e-4149-bf8f-96aa8e043ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:01.171904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9efa9-573e-4149-bf8f-96aa8e043ba2 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:01.172369 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9efa9-573e-4149-bf8f-96aa8e043ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:01.173338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9efa9-573e-4149-bf8f-96aa8e043ba2 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:01.174273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9efa9-573e-4149-bf8f-96aa8e043ba2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:01.175903 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9efa9-573e-4149-bf8f-96aa8e043ba2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:01.194639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 438/874] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:51:00 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 11:51:01.203849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655f8e69-e619-45dd-a239-d45db89a1992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:01.204569 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f8e69-e619-45dd-a239-d45db89a1992 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:01.204857 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f8e69-e619-45dd-a239-d45db89a1992 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:01.205125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655f8e69-e619-45dd-a239-d45db89a1992 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:01.205920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f8e69-e619-45dd-a239-d45db89a1992 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:01.206228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f8e69-e619-45dd-a239-d45db89a1992 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:01.207730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655f8e69-e619-45dd-a239-d45db89a1992 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:01.224581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 437/875] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:51:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:01.230686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9efa9-573e-4149-bf8f-96aa8e043ba2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:01.290738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:01.356534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9efa9-573e-4149-bf8f-96aa8e043ba2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:01.392684 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db5552-e57c-43e8-9c92-1563cb5ef809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:01.393326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5552-e57c-43e8-9c92-1563cb5ef809 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:01.393601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5552-e57c-43e8-9c92-1563cb5ef809 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:01.393868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db5552-e57c-43e8-9c92-1563cb5ef809 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:01.394643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db5552-e57c-43e8-9c92-1563cb5ef809 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=e2dfb83ec65645459d41579b4b036ee5) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:01.394944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db5552-e57c-43e8-9c92-1563cb5ef809 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:01.396375 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db5552-e57c-43e8-9c92-1563cb5ef809 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:01.402734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 439/876] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:51:01 2022] GET /identity/v3/role_assignments?user.id=e2dfb83ec65645459d41579b4b036ee5&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=0195bf688a7e464e8ff594afe80b050e => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:01.410786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d74e3f-67b6-42b5-ba10-67aeebc1c2de None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:01.411065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d74e3f-67b6-42b5-ba10-67aeebc1c2de None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:01.411342 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d74e3f-67b6-42b5-ba10-67aeebc1c2de None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:01.413074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 438/877] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:01.418849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4cf10-a980-4ec1-a885-a4307f6035ef None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:01.419137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4cf10-a980-4ec1-a885-a4307f6035ef None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:01.419423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4cf10-a980-4ec1-a885-a4307f6035ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:01.439757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5bf4cf10-a980-4ec1-a885-a4307f6035ef None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:01.440983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5bf4cf10-a980-4ec1-a885-a4307f6035ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:01.520526 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 440/878] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:01.545282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d74e3f-67b6-42b5-ba10-67aeebc1c2de None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:01.619147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:01.662147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d74e3f-67b6-42b5-ba10-67aeebc1c2de None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:01.699805 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e9099-e641-40e0-b120-0911d50d9a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:01.700488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e9099-e641-40e0-b120-0911d50d9a0a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:01.700769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e9099-e641-40e0-b120-0911d50d9a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:01.701041 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4e9099-e641-40e0-b120-0911d50d9a0a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:01.711987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4e9099-e641-40e0-b120-0911d50d9a0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-3b4e9099-e641-40e0-b120-0911d50d9a0a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:51:01.716991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:01.718180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:01.719304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 439/879] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Aug 1 11:51:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:01.724554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4cf10-a980-4ec1-a885-a4307f6035ef None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:01.769870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:01.831257 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf4cf10-a980-4ec1-a885-a4307f6035ef None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:01.871728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5223e0f-4f7e-4a9c-b28f-227b3fd2602c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:01.872267 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5223e0f-4f7e-4a9c-b28f-227b3fd2602c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:01.872547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5223e0f-4f7e-4a9c-b28f-227b3fd2602c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:01.872882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5223e0f-4f7e-4a9c-b28f-227b3fd2602c None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:01.873634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5223e0f-4f7e-4a9c-b28f-227b3fd2602c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:01.873938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5223e0f-4f7e-4a9c-b28f-227b3fd2602c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:01.875317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5223e0f-4f7e-4a9c-b28f-227b3fd2602c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:01.884839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 441/880] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Aug 1 11:51:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:01.890407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e9099-e641-40e0-b120-0911d50d9a0a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:02.002602 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4e9099-e641-40e0-b120-0911d50d9a0a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:02.033727 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:02.044897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f08a3-aaeb-4f63-862b-7428c8ce1eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:02.045565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f08a3-aaeb-4f63-862b-7428c8ce1eec None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:02.045844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f08a3-aaeb-4f63-862b-7428c8ce1eec None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:02.046115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f08a3-aaeb-4f63-862b-7428c8ce1eec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:02.056467 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f08a3-aaeb-4f63-862b-7428c8ce1eec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:02.057964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f08a3-aaeb-4f63-862b-7428c8ce1eec None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d23f08a3-aaeb-4f63-862b-7428c8ce1eec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:02.073686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:02.074609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:02.075975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:02.075975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:02.075975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:02.075975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:02.075975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 440/881] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:02.081752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5223e0f-4f7e-4a9c-b28f-227b3fd2602c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:02.186902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5223e0f-4f7e-4a9c-b28f-227b3fd2602c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:02.188949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:02.222702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b02dcb-f515-4161-933e-e4f895232532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:02.223324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b02dcb-f515-4161-933e-e4f895232532 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:02.223604 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b02dcb-f515-4161-933e-e4f895232532 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:02.223875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b02dcb-f515-4161-933e-e4f895232532 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:02.224555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b02dcb-f515-4161-933e-e4f895232532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:02.224858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b02dcb-f515-4161-933e-e4f895232532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:02.226559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b02dcb-f515-4161-933e-e4f895232532 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:02.239363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 442/882] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:02.244890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f08a3-aaeb-4f63-862b-7428c8ce1eec None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:02.349375 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f08a3-aaeb-4f63-862b-7428c8ce1eec None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:02.386616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09857ba-6313-4e24-9225-1d672169bca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:02.387264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09857ba-6313-4e24-9225-1d672169bca0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:02.387602 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09857ba-6313-4e24-9225-1d672169bca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:02.387882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09857ba-6313-4e24-9225-1d672169bca0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:02.395787 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09857ba-6313-4e24-9225-1d672169bca0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:02.397238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09857ba-6313-4e24-9225-1d672169bca0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-b09857ba-6313-4e24-9225-1d672169bca0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:51:02.408678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:02.409644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:02.410955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:02.410955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:02.410955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:51:02.410955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:51:02.410955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:51:02.410955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:51:02.410955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:51:02.410955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:51:02.410955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 11:51:02.410955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:02.410955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 441/883] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Aug 1 11:51:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:02.415774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b02dcb-f515-4161-933e-e4f895232532 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:02.518233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b02dcb-f515-4161-933e-e4f895232532 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:02.553117 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b5d74-7f79-4dd4-8ef9-db6fd5eef5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:02.553765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b5d74-7f79-4dd4-8ef9-db6fd5eef5aa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:02.554044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b5d74-7f79-4dd4-8ef9-db6fd5eef5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:02.554313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b5d74-7f79-4dd4-8ef9-db6fd5eef5aa None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:02.555100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b5d74-7f79-4dd4-8ef9-db6fd5eef5aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:02.555401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b5d74-7f79-4dd4-8ef9-db6fd5eef5aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:02.556835 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b5d74-7f79-4dd4-8ef9-db6fd5eef5aa None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:02.575310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 443/884] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Aug 1 11:51:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:02.581001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09857ba-6313-4e24-9225-1d672169bca0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:02.617941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:02.685214 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09857ba-6313-4e24-9225-1d672169bca0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:02.723229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67372426-5a7b-4de0-9e54-604ebe4643e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:02.723857 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67372426-5a7b-4de0-9e54-604ebe4643e3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:02.724137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67372426-5a7b-4de0-9e54-604ebe4643e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:02.724412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67372426-5a7b-4de0-9e54-604ebe4643e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:02.794616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67372426-5a7b-4de0-9e54-604ebe4643e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:02.796087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67372426-5a7b-4de0-9e54-604ebe4643e3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:02.830588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:02.901839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 442/885] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:51:02 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:51:02.907734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b5d74-7f79-4dd4-8ef9-db6fd5eef5aa None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:02.930791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:03.013446 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b5d74-7f79-4dd4-8ef9-db6fd5eef5aa None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:03.029587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8683f-2aa7-4ce9-9652-88dd4d095ac4 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.030083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8683f-2aa7-4ce9-9652-88dd4d095ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.030194 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c8683f-2aa7-4ce9-9652-88dd4d095ac4 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.031728 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 443/886] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:03.037420 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acaf44-06fd-476a-b872-1fdf783c564d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.037703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acaf44-06fd-476a-b872-1fdf783c564d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.037978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acaf44-06fd-476a-b872-1fdf783c564d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.050628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce419582-d82f-41e8-ac17-67f4ffbd31fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:03.051202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce419582-d82f-41e8-ac17-67f4ffbd31fa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.051478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce419582-d82f-41e8-ac17-67f4ffbd31fa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.051749 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce419582-d82f-41e8-ac17-67f4ffbd31fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.056161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e2acaf44-06fd-476a-b872-1fdf783c564d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:03.057383 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e2acaf44-06fd-476a-b872-1fdf783c564d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:03.062670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce419582-d82f-41e8-ac17-67f4ffbd31fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:03.064300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce419582-d82f-41e8-ac17-67f4ffbd31fa None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ce419582-d82f-41e8-ac17-67f4ffbd31fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:03.079988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:03.081098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:03.082457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:03.082457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:03.082457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:03.082457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:03.086020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 444/887] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:03.086848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce419582-d82f-41e8-ac17-67f4ffbd31fa None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:03.136888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 444/888] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:03.155930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acaf44-06fd-476a-b872-1fdf783c564d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:03.164556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:03.195978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce419582-d82f-41e8-ac17-67f4ffbd31fa None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:03.230243 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:03.232693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ff335-c7c7-4e74-a226-c861337dbdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:03.233344 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff335-c7c7-4e74-a226-c861337dbdf4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.233632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff335-c7c7-4e74-a226-c861337dbdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.233907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ff335-c7c7-4e74-a226-c861337dbdf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.234602 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff335-c7c7-4e74-a226-c861337dbdf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:03.234907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff335-c7c7-4e74-a226-c861337dbdf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:03.236325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ff335-c7c7-4e74-a226-c861337dbdf4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:03.253427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 445/889] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:03.254485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ff335-c7c7-4e74-a226-c861337dbdf4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:03.270842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acaf44-06fd-476a-b872-1fdf783c564d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:03.317734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffca5c1-78df-4fb7-a74a-4a1782e7f278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:03.318578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffca5c1-78df-4fb7-a74a-4a1782e7f278 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.318860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffca5c1-78df-4fb7-a74a-4a1782e7f278 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.319156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffca5c1-78df-4fb7-a74a-4a1782e7f278 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.319908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffca5c1-78df-4fb7-a74a-4a1782e7f278 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:03.321435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffca5c1-78df-4fb7-a74a-4a1782e7f278 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-2ffca5c1-78df-4fb7-a74a-4a1782e7f278 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:03.331169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:03.332099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 11:51:03.332927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:03.337681 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 445/890] 10.222.0.42 () {56 vars in 1132 bytes} [Mon Aug 1 11:51:03 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:03.337681 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2ae75-0186-4570-be6d-5c9fc4cceb8a None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.337932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2ae75-0186-4570-be6d-5c9fc4cceb8a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.338320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b2ae75-0186-4570-be6d-5c9fc4cceb8a None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.339709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 446/891] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:03.340668 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2ae75-0186-4570-be6d-5c9fc4cceb8a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:03.367317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ff335-c7c7-4e74-a226-c861337dbdf4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:03.402515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:03.409348 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821af837-7f62-4ca6-9254-45a8259b5eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:03.410055 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821af837-7f62-4ca6-9254-45a8259b5eef None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.410335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821af837-7f62-4ca6-9254-45a8259b5eef None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.410628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821af837-7f62-4ca6-9254-45a8259b5eef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.417452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821af837-7f62-4ca6-9254-45a8259b5eef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:03.418914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821af837-7f62-4ca6-9254-45a8259b5eef None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-821af837-7f62-4ca6-9254-45a8259b5eef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:51:03.431104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:03.432041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:03.432951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:51:03.432951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:51:03.432951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:51:03.432951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:51:03.432951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:51:03.432951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:51:03.432951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:03.432951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:03.437271 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 446/892] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:51:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:03.438922 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a4266-7883-4bcd-9d27-fe49d691437c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.439209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a4266-7883-4bcd-9d27-fe49d691437c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.439484 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667a4266-7883-4bcd-9d27-fe49d691437c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.457372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b2ae75-0186-4570-be6d-5c9fc4cceb8a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:03.458032 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-667a4266-7883-4bcd-9d27-fe49d691437c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:03.459224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-667a4266-7883-4bcd-9d27-fe49d691437c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:03.488793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:03.495455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836386f3-9b93-4c35-aa1d-cfc5660d5d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:03.496086 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836386f3-9b93-4c35-aa1d-cfc5660d5d88 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.496362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836386f3-9b93-4c35-aa1d-cfc5660d5d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.496630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836386f3-9b93-4c35-aa1d-cfc5660d5d88 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.497320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836386f3-9b93-4c35-aa1d-cfc5660d5d88 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:03.497629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836386f3-9b93-4c35-aa1d-cfc5660d5d88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:03.498996 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836386f3-9b93-4c35-aa1d-cfc5660d5d88 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:03.504437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 447/893] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Aug 1 11:51:03 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:03.505054 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836386f3-9b93-4c35-aa1d-cfc5660d5d88 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:03.534415 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 447/894] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:03.535091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a4266-7883-4bcd-9d27-fe49d691437c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:03.627413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836386f3-9b93-4c35-aa1d-cfc5660d5d88 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:03.637132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667a4266-7883-4bcd-9d27-fe49d691437c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:03.660588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3526af-8fb6-4a70-b4db-f6dac786451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:03.660994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:03.661198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3526af-8fb6-4a70-b4db-f6dac786451a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.661516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3526af-8fb6-4a70-b4db-f6dac786451a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.661789 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3526af-8fb6-4a70-b4db-f6dac786451a None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.662600 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3526af-8fb6-4a70-b4db-f6dac786451a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:03.662941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3526af-8fb6-4a70-b4db-f6dac786451a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:03.664438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3526af-8fb6-4a70-b4db-f6dac786451a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:03.672685 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1608c55-6a35-4fc4-a36a-e23a873ec397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:03.673315 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608c55-6a35-4fc4-a36a-e23a873ec397 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.673637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608c55-6a35-4fc4-a36a-e23a873ec397 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.673909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1608c55-6a35-4fc4-a36a-e23a873ec397 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.674619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608c55-6a35-4fc4-a36a-e23a873ec397 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:03.674921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608c55-6a35-4fc4-a36a-e23a873ec397 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:03.676228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 448/895] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:51:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:03.676327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1608c55-6a35-4fc4-a36a-e23a873ec397 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:03.677081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3526af-8fb6-4a70-b4db-f6dac786451a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:03.685218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 448/896] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Aug 1 11:51:03 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:03.686444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdab04-cb92-4e2b-b71d-7b7d4e047187 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.686728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdab04-cb92-4e2b-b71d-7b7d4e047187 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.686995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdab04-cb92-4e2b-b71d-7b7d4e047187 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.689617 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 449/897] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:03.689617 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdab04-cb92-4e2b-b71d-7b7d4e047187 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:03.732740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:03.777136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3526af-8fb6-4a70-b4db-f6dac786451a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:03.790377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdab04-cb92-4e2b-b71d-7b7d4e047187 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:03.810458 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6bb2c-a6c2-405d-8e59-a09b874548a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:03.811090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6bb2c-a6c2-405d-8e59-a09b874548a3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.811370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6bb2c-a6c2-405d-8e59-a09b874548a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.811640 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a6bb2c-a6c2-405d-8e59-a09b874548a3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.812259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6bb2c-a6c2-405d-8e59-a09b874548a3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:03.814204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a6bb2c-a6c2-405d-8e59-a09b874548a3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-95a6bb2c-a6c2-405d-8e59-a09b874548a3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:03.822927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:03.823893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:03.824766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 449/898] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:51:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:03.825621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6bb2c-a6c2-405d-8e59-a09b874548a3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:03.830070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92344ca2-025f-46dd-8c0f-12c8901f8a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:03.830688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92344ca2-025f-46dd-8c0f-12c8901f8a2b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.830972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92344ca2-025f-46dd-8c0f-12c8901f8a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.831243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92344ca2-025f-46dd-8c0f-12c8901f8a2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.832026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92344ca2-025f-46dd-8c0f-12c8901f8a2b None admin] RBAC: Adding query filter params (role.id=56fa13e514a34e459d15f9e505fc072d, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=fc14241a25484946a0ecc59c9776ac62) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:03.832334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92344ca2-025f-46dd-8c0f-12c8901f8a2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:03.833806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92344ca2-025f-46dd-8c0f-12c8901f8a2b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:03.839522 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 450/899] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:51:03 2022] GET /identity/v3/role_assignments?user.id=fc14241a25484946a0ecc59c9776ac62&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=56fa13e514a34e459d15f9e505fc072d => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:03.840647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587266a7-e0e1-44bf-860e-ddf34a7d2b35 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.840930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587266a7-e0e1-44bf-860e-ddf34a7d2b35 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.841212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587266a7-e0e1-44bf-860e-ddf34a7d2b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.866775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-587266a7-e0e1-44bf-860e-ddf34a7d2b35 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:03.868797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-587266a7-e0e1-44bf-860e-ddf34a7d2b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:03.922261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:03.940270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a6bb2c-a6c2-405d-8e59-a09b874548a3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:03.948740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 451/900] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:03.953995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587266a7-e0e1-44bf-860e-ddf34a7d2b35 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:03.967221 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:03.988933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb71a5-bb04-4221-b43b-239148a4dfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:03.989860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb71a5-bb04-4221-b43b-239148a4dfe7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:03.990134 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb71a5-bb04-4221-b43b-239148a4dfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:03.990402 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bb71a5-bb04-4221-b43b-239148a4dfe7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:03.991166 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb71a5-bb04-4221-b43b-239148a4dfe7 None admin] RBAC: Adding query filter params (interface=public, service_id=3f78057d9fa74ef9be797127e8a9a5be, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:03.991471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb71a5-bb04-4221-b43b-239148a4dfe7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:03.992880 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bb71a5-bb04-4221-b43b-239148a4dfe7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:03.998780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 450/901] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Aug 1 11:51:03 2022] GET /identity/v3/endpoints?service_id=3f78057d9fa74ef9be797127e8a9a5be&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:03.999576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb71a5-bb04-4221-b43b-239148a4dfe7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:04.069259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587266a7-e0e1-44bf-860e-ddf34a7d2b35 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:04.104925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29655b-10bf-40c7-afa6-6a04a028e87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:04.105569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29655b-10bf-40c7-afa6-6a04a028e87e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:04.105849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29655b-10bf-40c7-afa6-6a04a028e87e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:04.106119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be29655b-10bf-40c7-afa6-6a04a028e87e None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:04.106792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29655b-10bf-40c7-afa6-6a04a028e87e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:04.107093 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29655b-10bf-40c7-afa6-6a04a028e87e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:04.108466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be29655b-10bf-40c7-afa6-6a04a028e87e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:04.113825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 452/902] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:51:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:04.114596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29655b-10bf-40c7-afa6-6a04a028e87e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:04.116007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bb71a5-bb04-4221-b43b-239148a4dfe7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:04.158807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24a579-c019-449a-93c6-c7c984e09be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:04.160051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a579-c019-449a-93c6-c7c984e09be7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:04.160517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a579-c019-449a-93c6-c7c984e09be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:04.160969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c24a579-c019-449a-93c6-c7c984e09be7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:04.161475 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:04.162161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24a579-c019-449a-93c6-c7c984e09be7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:04.164468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c24a579-c019-449a-93c6-c7c984e09be7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-1c24a579-c019-449a-93c6-c7c984e09be7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:04.177441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:04.178473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:04.179326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:04.180091 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 451/903] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Aug 1 11:51:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:04.180814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24a579-c019-449a-93c6-c7c984e09be7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:04.225659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be29655b-10bf-40c7-afa6-6a04a028e87e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:04.228888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:04.264568 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f60a6-e97f-495d-8915-215fea64c0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:04.265373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f60a6-e97f-495d-8915-215fea64c0d5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:04.266025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f60a6-e97f-495d-8915-215fea64c0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:04.266302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270f60a6-e97f-495d-8915-215fea64c0d5 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:04.267133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f60a6-e97f-495d-8915-215fea64c0d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:04.268508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270f60a6-e97f-495d-8915-215fea64c0d5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:04.281338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 453/904] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Aug 1 11:51:04 2022] GET /identity/v3/services => generated 1268 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 11:51:04.281338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f60a6-e97f-495d-8915-215fea64c0d5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:04.294658 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c24a579-c019-449a-93c6-c7c984e09be7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:04.342578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ba2f3-89cc-4321-a851-c6cfa88d9077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:04.343992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ba2f3-89cc-4321-a851-c6cfa88d9077 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:04.345011 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ba2f3-89cc-4321-a851-c6cfa88d9077 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:04.345580 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ba2f3-89cc-4321-a851-c6cfa88d9077 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:04.346497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ba2f3-89cc-4321-a851-c6cfa88d9077 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:04.347641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ba2f3-89cc-4321-a851-c6cfa88d9077 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:04.349720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ba2f3-89cc-4321-a851-c6cfa88d9077 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:04.357897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 452/905] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:51:04 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:04.364742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ba2f3-89cc-4321-a851-c6cfa88d9077 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:04.408894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270f60a6-e97f-495d-8915-215fea64c0d5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:04.419807 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:04.450537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871663f-8d90-45ab-8f85-50b05d772538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:04.451169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871663f-8d90-45ab-8f85-50b05d772538 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:04.451520 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871663f-8d90-45ab-8f85-50b05d772538 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:04.451879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5871663f-8d90-45ab-8f85-50b05d772538 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:04.452613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871663f-8d90-45ab-8f85-50b05d772538 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:04.452923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871663f-8d90-45ab-8f85-50b05d772538 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:04.455005 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5871663f-8d90-45ab-8f85-50b05d772538 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:04.464813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 454/906] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Aug 1 11:51:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:04.466260 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871663f-8d90-45ab-8f85-50b05d772538 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:04.496168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ba2f3-89cc-4321-a851-c6cfa88d9077 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:04.508941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:04.539934 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249c630-895b-4de2-8d6c-6502774ef34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:04.541523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249c630-895b-4de2-8d6c-6502774ef34d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:04.542011 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249c630-895b-4de2-8d6c-6502774ef34d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:04.542502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249c630-895b-4de2-8d6c-6502774ef34d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:04.543457 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249c630-895b-4de2-8d6c-6502774ef34d None admin] RBAC: Adding query filter params (interface=public, service_id=f251c28110a848e1a6c7956e95754165, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:04.544111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249c630-895b-4de2-8d6c-6502774ef34d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:04.546631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249c630-895b-4de2-8d6c-6502774ef34d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:04.558922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 453/907] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Aug 1 11:51:04 2022] GET /identity/v3/endpoints?service_id=f251c28110a848e1a6c7956e95754165&interface=public®ion_id=RegionOne => generated 194 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:04.566291 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249c630-895b-4de2-8d6c-6502774ef34d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:04.585441 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5871663f-8d90-45ab-8f85-50b05d772538 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:04.622886 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a4ad2a-6e47-477b-b502-b7066111415e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:04.623506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4ad2a-6e47-477b-b502-b7066111415e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:04.623786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4ad2a-6e47-477b-b502-b7066111415e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:04.624056 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a4ad2a-6e47-477b-b502-b7066111415e None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:04.624846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4ad2a-6e47-477b-b502-b7066111415e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:04.625160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4ad2a-6e47-477b-b502-b7066111415e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:04.626601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a4ad2a-6e47-477b-b502-b7066111415e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:04.631691 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 455/908] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Aug 1 11:51:04 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:04.689749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249c630-895b-4de2-8d6c-6502774ef34d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:04.728465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f330be36-2a3c-40e2-a62d-d4ddca512324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:04.729010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330be36-2a3c-40e2-a62d-d4ddca512324 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:04.729289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330be36-2a3c-40e2-a62d-d4ddca512324 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:04.729586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f330be36-2a3c-40e2-a62d-d4ddca512324 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:04.730246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330be36-2a3c-40e2-a62d-d4ddca512324 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:04.731696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f330be36-2a3c-40e2-a62d-d4ddca512324 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:04.738494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 454/909] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Aug 1 11:51:04 2022] GET /identity/v3/services => generated 1268 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 11:51:05.864166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc16b7-ae11-4925-bcad-d1302c6e5fe7 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:05.864693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc16b7-ae11-4925-bcad-d1302c6e5fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:05.864693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfc16b7-ae11-4925-bcad-d1302c6e5fe7 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:05.866336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 456/910] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:05.871752 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f6efa-e00c-4dbc-910d-fba1e0d5344a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:05.872566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f6efa-e00c-4dbc-910d-fba1e0d5344a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:05.873038 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827f6efa-e00c-4dbc-910d-fba1e0d5344a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:05.891581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-827f6efa-e00c-4dbc-910d-fba1e0d5344a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:05.893229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-827f6efa-e00c-4dbc-910d-fba1e0d5344a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:05.927224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:05.966024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 455/911] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:05.988976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc16b7-ae11-4925-bcad-d1302c6e5fe7 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:06.027427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:06.102240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfc16b7-ae11-4925-bcad-d1302c6e5fe7 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:06.137186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf786a09-0e6f-4ecc-90b5-c4a5d9973560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:06.137782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf786a09-0e6f-4ecc-90b5-c4a5d9973560 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:06.138055 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf786a09-0e6f-4ecc-90b5-c4a5d9973560 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:06.138326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf786a09-0e6f-4ecc-90b5-c4a5d9973560 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:06.149556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf786a09-0e6f-4ecc-90b5-c4a5d9973560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-bf786a09-0e6f-4ecc-90b5-c4a5d9973560 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:51:06.154638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:06.155527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:06.156598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 457/912] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Aug 1 11:51:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:06.163969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f6efa-e00c-4dbc-910d-fba1e0d5344a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:06.265876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827f6efa-e00c-4dbc-910d-fba1e0d5344a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:06.302430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c1996-c8b4-4d67-ad58-f518bf3edc8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:06.303055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c1996-c8b4-4d67-ad58-f518bf3edc8d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:06.303331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c1996-c8b4-4d67-ad58-f518bf3edc8d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:06.309318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c1996-c8b4-4d67-ad58-f518bf3edc8d None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:06.309318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c1996-c8b4-4d67-ad58-f518bf3edc8d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:06.309318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c1996-c8b4-4d67-ad58-f518bf3edc8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:06.309318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c1996-c8b4-4d67-ad58-f518bf3edc8d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:06.314791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 456/913] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Aug 1 11:51:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:06.320392 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf786a09-0e6f-4ecc-90b5-c4a5d9973560 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:06.395058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268c1b-6162-43b6-b086-ff23c409636c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:06.395678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268c1b-6162-43b6-b086-ff23c409636c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:06.396210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a268c1b-6162-43b6-b086-ff23c409636c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:06.398056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 457/914] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:51:06.403206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771a2bc-ca0f-401f-bba6-7af4def95d86 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:06.403734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771a2bc-ca0f-401f-bba6-7af4def95d86 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:06.404242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2771a2bc-ca0f-401f-bba6-7af4def95d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:06.423540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2771a2bc-ca0f-401f-bba6-7af4def95d86 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:06.425137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2771a2bc-ca0f-401f-bba6-7af4def95d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:06.425890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:06.432789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf786a09-0e6f-4ecc-90b5-c4a5d9973560 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:06.455250 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:06.478316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66a6c3-548f-4465-8fd5-ce15fd9bc2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:06.479669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66a6c3-548f-4465-8fd5-ce15fd9bc2fb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:06.480380 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66a6c3-548f-4465-8fd5-ce15fd9bc2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:06.480836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf66a6c3-548f-4465-8fd5-ce15fd9bc2fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:06.494499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66a6c3-548f-4465-8fd5-ce15fd9bc2fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:06.496193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf66a6c3-548f-4465-8fd5-ce15fd9bc2fb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:06.509395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 458/915] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-bf66a6c3-548f-4465-8fd5-ce15fd9bc2fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:06.512336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:06.513215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:06.514159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:06.514159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:06.514159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:06.514159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:06.516125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 458/916] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:06.522313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771a2bc-ca0f-401f-bba6-7af4def95d86 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:06.539008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66a6c3-548f-4465-8fd5-ce15fd9bc2fb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:06.625384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2771a2bc-ca0f-401f-bba6-7af4def95d86 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:06.671582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc1ec8-dfdb-4b41-a160-131967ce92fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:06.672561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc1ec8-dfdb-4b41-a160-131967ce92fe None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:06.673552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf66a6c3-548f-4465-8fd5-ce15fd9bc2fb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:06.673665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc1ec8-dfdb-4b41-a160-131967ce92fe None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:06.674108 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc1ec8-dfdb-4b41-a160-131967ce92fe None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:06.675033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc1ec8-dfdb-4b41-a160-131967ce92fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:06.675463 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc1ec8-dfdb-4b41-a160-131967ce92fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:06.677144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc1ec8-dfdb-4b41-a160-131967ce92fe None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:06.693755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 459/917] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:06.695316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc1ec8-dfdb-4b41-a160-131967ce92fe None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:06.714064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af57dc03-da4d-4896-a87a-a1c62479230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:06.714701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57dc03-da4d-4896-a87a-a1c62479230d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:06.714981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57dc03-da4d-4896-a87a-a1c62479230d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:06.715256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af57dc03-da4d-4896-a87a-a1c62479230d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:06.715884 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57dc03-da4d-4896-a87a-a1c62479230d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:06.717337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af57dc03-da4d-4896-a87a-a1c62479230d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:06.717925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-af57dc03-da4d-4896-a87a-a1c62479230d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:06.728697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:06.729806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 11:51:06.730745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:06.732920 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 459/918] 10.222.0.42 () {56 vars in 1132 bytes} [Mon Aug 1 11:51:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:06.734318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a23ed-c9ed-4564-a688-1c26e084d402 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:06.734596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a23ed-c9ed-4564-a688-1c26e084d402 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:06.734861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a23ed-c9ed-4564-a688-1c26e084d402 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:06.736838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 460/919] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:06.739521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a23ed-c9ed-4564-a688-1c26e084d402 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:06.757501 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:06.812039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc1ec8-dfdb-4b41-a160-131967ce92fe None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:06.848986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861172a-5b74-48f6-ba57-5282678e8b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:06.849989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861172a-5b74-48f6-ba57-5282678e8b1d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:06.850269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861172a-5b74-48f6-ba57-5282678e8b1d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:06.850588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861172a-5b74-48f6-ba57-5282678e8b1d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:06.855726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a23ed-c9ed-4564-a688-1c26e084d402 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:06.858713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861172a-5b74-48f6-ba57-5282678e8b1d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:06.860507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861172a-5b74-48f6-ba57-5282678e8b1d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d861172a-5b74-48f6-ba57-5282678e8b1d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:51:06.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:06.873439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 460/920] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Aug 1 11:51:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57130f-d354-420d-96f7-aa65f04e2e5e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:06.874489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57130f-d354-420d-96f7-aa65f04e2e5e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:06.875213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f57130f-d354-420d-96f7-aa65f04e2e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:06.892700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3f57130f-d354-420d-96f7-aa65f04e2e5e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:06.893479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f13b7ed-ab01-4242-9716-27653a517781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:06.893951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3f57130f-d354-420d-96f7-aa65f04e2e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:06.894095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13b7ed-ab01-4242-9716-27653a517781 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:06.894374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13b7ed-ab01-4242-9716-27653a517781 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:06.894644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f13b7ed-ab01-4242-9716-27653a517781 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:06.895311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13b7ed-ab01-4242-9716-27653a517781 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:06.895610 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13b7ed-ab01-4242-9716-27653a517781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:06.896999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f13b7ed-ab01-4242-9716-27653a517781 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:06.906561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 461/921] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Aug 1 11:51:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:06.906561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80744404-9239-4dcc-ac87-7646c6ddafa8 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:06.906561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80744404-9239-4dcc-ac87-7646c6ddafa8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:06.906561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80744404-9239-4dcc-ac87-7646c6ddafa8 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:06.906561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 462/922] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:06.906561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80744404-9239-4dcc-ac87-7646c6ddafa8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:06.966316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 461/923] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:06.967087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57130f-d354-420d-96f7-aa65f04e2e5e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:06.980533 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:06.987713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:07.012411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80744404-9239-4dcc-ac87-7646c6ddafa8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:07.045240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93142071-c789-4b23-9039-86d68ba89c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:07.045892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142071-c789-4b23-9039-86d68ba89c2b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:07.046172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142071-c789-4b23-9039-86d68ba89c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:07.046445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93142071-c789-4b23-9039-86d68ba89c2b None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:07.047232 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142071-c789-4b23-9039-86d68ba89c2b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:07.048025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142071-c789-4b23-9039-86d68ba89c2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:07.049500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93142071-c789-4b23-9039-86d68ba89c2b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:07.067190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 463/924] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Aug 1 11:51:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:07.067971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f57130f-d354-420d-96f7-aa65f04e2e5e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:07.068353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba558f-826a-418f-912d-a11b3ce5e910 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:07.068635 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba558f-826a-418f-912d-a11b3ce5e910 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:07.068906 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afba558f-826a-418f-912d-a11b3ce5e910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:07.085785 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-afba558f-826a-418f-912d-a11b3ce5e910 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:07.086965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-afba558f-826a-418f-912d-a11b3ce5e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:07.104126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095f4a3-ddac-4267-babb-4657c2d92b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:07.104729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095f4a3-ddac-4267-babb-4657c2d92b9f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:07.105011 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095f4a3-ddac-4267-babb-4657c2d92b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:07.105279 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7095f4a3-ddac-4267-babb-4657c2d92b9f None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:07.106036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095f4a3-ddac-4267-babb-4657c2d92b9f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:07.106331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095f4a3-ddac-4267-babb-4657c2d92b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:07.107679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7095f4a3-ddac-4267-babb-4657c2d92b9f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:07.112987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 462/925] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Aug 1 11:51:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:07.113675 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095f4a3-ddac-4267-babb-4657c2d92b9f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:07.158292 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 464/926] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:07 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:07.159123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba558f-826a-418f-912d-a11b3ce5e910 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:07.189026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:07.216124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7095f4a3-ddac-4267-babb-4657c2d92b9f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:07.243374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:07.255101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93287c-b4a6-4dea-a3b5-70fca3b3cd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:07.255715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93287c-b4a6-4dea-a3b5-70fca3b3cd40 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:07.255994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93287c-b4a6-4dea-a3b5-70fca3b3cd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:07.256265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb93287c-b4a6-4dea-a3b5-70fca3b3cd40 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:07.256949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93287c-b4a6-4dea-a3b5-70fca3b3cd40 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:07.258345 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb93287c-b4a6-4dea-a3b5-70fca3b3cd40 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:07.273826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 463/927] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:51:07 2022] POST /identity/v3/services => generated 241 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:51:07.274619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93287c-b4a6-4dea-a3b5-70fca3b3cd40 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:07.298381 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afba558f-826a-418f-912d-a11b3ce5e910 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:07.344165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a90e-c1af-4540-83cc-111dd3470d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:07.346184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a90e-c1af-4540-83cc-111dd3470d00 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:07.346497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a90e-c1af-4540-83cc-111dd3470d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:07.346821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b75a90e-c1af-4540-83cc-111dd3470d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:07.358951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75a90e-c1af-4540-83cc-111dd3470d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:07.361119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b75a90e-c1af-4540-83cc-111dd3470d00 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-3b75a90e-c1af-4540-83cc-111dd3470d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:07.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:07.378323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:07.379990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:07.379990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:07.379990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:07.379990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:07.379990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 465/928] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:07.379990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a90e-c1af-4540-83cc-111dd3470d00 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:07.408587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb93287c-b4a6-4dea-a3b5-70fca3b3cd40 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:07.447955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162320e5-ed20-46ad-8002-ab3c26f3a008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:07.448583 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162320e5-ed20-46ad-8002-ab3c26f3a008 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:07.448861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162320e5-ed20-46ad-8002-ab3c26f3a008 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:07.449134 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162320e5-ed20-46ad-8002-ab3c26f3a008 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:07.449885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162320e5-ed20-46ad-8002-ab3c26f3a008 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:07.451260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162320e5-ed20-46ad-8002-ab3c26f3a008 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:07.455907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:07.479851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 464/929] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 11:51:07 2022] POST /identity/v3/endpoints => generated 347 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:51:07.480838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162320e5-ed20-46ad-8002-ab3c26f3a008 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:07.502725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b75a90e-c1af-4540-83cc-111dd3470d00 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:07.518948 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:07.564911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736cc73-8c58-4935-a2d3-ef5a55e179a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:07.566047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736cc73-8c58-4935-a2d3-ef5a55e179a8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:07.566563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736cc73-8c58-4935-a2d3-ef5a55e179a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:07.567030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f736cc73-8c58-4935-a2d3-ef5a55e179a8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:07.568163 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736cc73-8c58-4935-a2d3-ef5a55e179a8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:07.569934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f736cc73-8c58-4935-a2d3-ef5a55e179a8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f736cc73-8c58-4935-a2d3-ef5a55e179a8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:07.588240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:07.589334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 11:51:07.590244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:07.591886 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 466/930] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:51:07 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:07.598371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736cc73-8c58-4935-a2d3-ef5a55e179a8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:07.652930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162320e5-ed20-46ad-8002-ab3c26f3a008 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:07.696506 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926191-ed59-4823-87c5-8d5ee9e0f107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:07.697615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926191-ed59-4823-87c5-8d5ee9e0f107 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:07.698703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926191-ed59-4823-87c5-8d5ee9e0f107 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:07.698703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26926191-ed59-4823-87c5-8d5ee9e0f107 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:07.699127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926191-ed59-4823-87c5-8d5ee9e0f107 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:07.699532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926191-ed59-4823-87c5-8d5ee9e0f107 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:07.700999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26926191-ed59-4823-87c5-8d5ee9e0f107 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:07.715313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 465/931] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:07.721877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926191-ed59-4823-87c5-8d5ee9e0f107 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:07.723716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f736cc73-8c58-4935-a2d3-ef5a55e179a8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:07.767905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58863b66-a741-4d8d-9cd8-0a2ba24b46d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:07.768662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58863b66-a741-4d8d-9cd8-0a2ba24b46d2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:07.769013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58863b66-a741-4d8d-9cd8-0a2ba24b46d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:07.769199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58863b66-a741-4d8d-9cd8-0a2ba24b46d2 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:07.769924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58863b66-a741-4d8d-9cd8-0a2ba24b46d2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:07.770223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58863b66-a741-4d8d-9cd8-0a2ba24b46d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:07.771641 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58863b66-a741-4d8d-9cd8-0a2ba24b46d2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:07.776956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 467/932] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:51:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:07.782730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58863b66-a741-4d8d-9cd8-0a2ba24b46d2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:07.790854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:07.825526 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:07.858227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26926191-ed59-4823-87c5-8d5ee9e0f107 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:07.902530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022da28-19b5-473a-8156-38fe784e850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:07.904580 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022da28-19b5-473a-8156-38fe784e850f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:07.905349 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022da28-19b5-473a-8156-38fe784e850f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:07.905792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5022da28-19b5-473a-8156-38fe784e850f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:07.907382 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58863b66-a741-4d8d-9cd8-0a2ba24b46d2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:07.915234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022da28-19b5-473a-8156-38fe784e850f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:07.916901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5022da28-19b5-473a-8156-38fe784e850f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-5022da28-19b5-473a-8156-38fe784e850f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:51:07.933210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:07.934429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:07.935547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:51:07.935547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:51:07.935547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:51:07.935547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:51:07.935547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:51:07.935547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:51:07.935547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:07.935547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:07.939014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 466/933] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:51:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:07.944995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022da28-19b5-473a-8156-38fe784e850f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:07.961006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08175d7-bcca-4d28-bbb4-3de35f39c57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:07.961710 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08175d7-bcca-4d28-bbb4-3de35f39c57e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:07.962105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08175d7-bcca-4d28-bbb4-3de35f39c57e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:07.962387 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08175d7-bcca-4d28-bbb4-3de35f39c57e None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:07.963095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08175d7-bcca-4d28-bbb4-3de35f39c57e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:07.963368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08175d7-bcca-4d28-bbb4-3de35f39c57e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:07.964882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08175d7-bcca-4d28-bbb4-3de35f39c57e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:07.975231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 468/934] 10.222.0.42 () {56 vars in 1114 bytes} [Mon Aug 1 11:51:07 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:07.976794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08175d7-bcca-4d28-bbb4-3de35f39c57e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:08.073914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5022da28-19b5-473a-8156-38fe784e850f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:08.088707 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:08.102082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:08.105665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08175d7-bcca-4d28-bbb4-3de35f39c57e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:08.129103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c6618-ccbb-4d14-8373-0a9ea2f891db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:08.130331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c6618-ccbb-4d14-8373-0a9ea2f891db None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:08.130852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c6618-ccbb-4d14-8373-0a9ea2f891db None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:08.131538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c6618-ccbb-4d14-8373-0a9ea2f891db None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:08.133165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c6618-ccbb-4d14-8373-0a9ea2f891db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:08.133699 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c6618-ccbb-4d14-8373-0a9ea2f891db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:08.136244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c6618-ccbb-4d14-8373-0a9ea2f891db None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:08.143461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cac66-f3b3-4dab-8dac-00c38180187a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:08.144084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cac66-f3b3-4dab-8dac-00c38180187a None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:08.144361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cac66-f3b3-4dab-8dac-00c38180187a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:08.144633 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cac66-f3b3-4dab-8dac-00c38180187a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:08.145359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cac66-f3b3-4dab-8dac-00c38180187a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:08.146969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cac66-f3b3-4dab-8dac-00c38180187a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:08.152894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 467/935] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:51:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:08.158438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c6618-ccbb-4d14-8373-0a9ea2f891db None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:08.181025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 469/936] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 11:51:07 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 11:51:08.308303 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c6618-ccbb-4d14-8373-0a9ea2f891db None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:08.353356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da6f47c-5757-43d8-8a0c-c4563100d37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:08.353960 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6f47c-5757-43d8-8a0c-c4563100d37b None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:08.354234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6f47c-5757-43d8-8a0c-c4563100d37b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:08.354499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da6f47c-5757-43d8-8a0c-c4563100d37b None admin] PATH_INFO: `/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/fc14241a25484946a0ecc59c9776ac62/roles/56fa13e514a34e459d15f9e505fc072d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:08.356695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6f47c-5757-43d8-8a0c-c4563100d37b None admin] RBAC: Authorizing `identity:create_grant(project_id=99857fcf20fd4cb8b7def2bc2de521bc, user_id=fc14241a25484946a0ecc59c9776ac62, role_id=56fa13e514a34e459d15f9e505fc072d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:08.358259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da6f47c-5757-43d8-8a0c-c4563100d37b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:08.372040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 468/937] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:51:08 2022] PUT /identity/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/fc14241a25484946a0ecc59c9776ac62/roles/56fa13e514a34e459d15f9e505fc072d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:51:09.353796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eb782-2fb3-4c78-b5dd-1a83d823ef4d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:09.354333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eb782-2fb3-4c78-b5dd-1a83d823ef4d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:09.354333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835eb782-2fb3-4c78-b5dd-1a83d823ef4d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:09.355972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 470/938] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:09.361264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426859da-9a0b-4ff3-8b66-fcfb04405751 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:09.361694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426859da-9a0b-4ff3-8b66-fcfb04405751 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:09.361881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426859da-9a0b-4ff3-8b66-fcfb04405751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:09.380526 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-426859da-9a0b-4ff3-8b66-fcfb04405751 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:09.381782 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-426859da-9a0b-4ff3-8b66-fcfb04405751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:09.403574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:09.456296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 469/939] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:09.478897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eb782-2fb3-4c78-b5dd-1a83d823ef4d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:09.587606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835eb782-2fb3-4c78-b5dd-1a83d823ef4d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:09.609259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5646658-c7ce-4c26-be1e-4113e4915c4e None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:09.609593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5646658-c7ce-4c26-be1e-4113e4915c4e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:09.609843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5646658-c7ce-4c26-be1e-4113e4915c4e None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:09.611345 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 470/940] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:09.616067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952279e-0ffa-4d04-a6a5-b18178199fc3 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:09.616353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952279e-0ffa-4d04-a6a5-b18178199fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:09.616622 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952279e-0ffa-4d04-a6a5-b18178199fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:09.625204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086af18-40a0-4bbd-986e-63c682a31dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:09.626638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086af18-40a0-4bbd-986e-63c682a31dc6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:09.627146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086af18-40a0-4bbd-986e-63c682a31dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:09.627639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b086af18-40a0-4bbd-986e-63c682a31dc6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:09.628464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086af18-40a0-4bbd-986e-63c682a31dc6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:09.630206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b086af18-40a0-4bbd-986e-63c682a31dc6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:09.634607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2952279e-0ffa-4d04-a6a5-b18178199fc3 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:09.635778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2952279e-0ffa-4d04-a6a5-b18178199fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b086af18-40a0-4bbd-986e-63c682a31dc6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:09.640250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:09.641840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:09.642700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:09.645083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 471/941] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Aug 1 11:51:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:09.651319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086af18-40a0-4bbd-986e-63c682a31dc6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:09.675258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:09.721390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 471/942] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:09 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:09.744991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952279e-0ffa-4d04-a6a5-b18178199fc3 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:09.768127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b086af18-40a0-4bbd-986e-63c682a31dc6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:09.805092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d7be1-5b06-41f9-b4f5-37f85b0fa236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:09.806177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d7be1-5b06-41f9-b4f5-37f85b0fa236 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:09.806678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d7be1-5b06-41f9-b4f5-37f85b0fa236 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:09.807144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d7be1-5b06-41f9-b4f5-37f85b0fa236 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:09.808122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d7be1-5b06-41f9-b4f5-37f85b0fa236 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:09.808670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d7be1-5b06-41f9-b4f5-37f85b0fa236 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:09.810277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d7be1-5b06-41f9-b4f5-37f85b0fa236 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:09.816562 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 472/943] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Aug 1 11:51:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:09.821831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d7be1-5b06-41f9-b4f5-37f85b0fa236 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:09.838468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:09.858606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952279e-0ffa-4d04-a6a5-b18178199fc3 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:09.912076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcc338-47c8-426b-8abb-58afa5b77177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:09.912920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcc338-47c8-426b-8abb-58afa5b77177 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:09.913316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcc338-47c8-426b-8abb-58afa5b77177 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:09.913714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dcc338-47c8-426b-8abb-58afa5b77177 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:09.914466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcc338-47c8-426b-8abb-58afa5b77177 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:09.916053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dcc338-47c8-426b-8abb-58afa5b77177 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:09.928494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-e3dcc338-47c8-426b-8abb-58afa5b77177 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:09.934867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:09.935883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:09.942317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 472/944] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:51:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:09.946542 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcc338-47c8-426b-8abb-58afa5b77177 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:09.954549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d7be1-5b06-41f9-b4f5-37f85b0fa236 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:10.001827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce48f71-a6c7-40c7-bcd1-8a5816af97e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:10.003639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce48f71-a6c7-40c7-bcd1-8a5816af97e9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:10.003920 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce48f71-a6c7-40c7-bcd1-8a5816af97e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:10.004188 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce48f71-a6c7-40c7-bcd1-8a5816af97e9 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:10.004864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce48f71-a6c7-40c7-bcd1-8a5816af97e9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:10.005160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce48f71-a6c7-40c7-bcd1-8a5816af97e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:10.007282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce48f71-a6c7-40c7-bcd1-8a5816af97e9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:10.019687 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 473/945] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Aug 1 11:51:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:10.020529 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce48f71-a6c7-40c7-bcd1-8a5816af97e9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:10.083019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dcc338-47c8-426b-8abb-58afa5b77177 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:10.124982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce48f71-a6c7-40c7-bcd1-8a5816af97e9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:10.125743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848cc38-986a-4608-9699-80140d95f7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:10.126715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848cc38-986a-4608-9699-80140d95f7c2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:10.127315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848cc38-986a-4608-9699-80140d95f7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:10.127794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9848cc38-986a-4608-9699-80140d95f7c2 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:10.128675 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848cc38-986a-4608-9699-80140d95f7c2 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:10.129183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848cc38-986a-4608-9699-80140d95f7c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:10.130781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9848cc38-986a-4608-9699-80140d95f7c2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:10.136804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 473/946] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:51:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:10.143782 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848cc38-986a-4608-9699-80140d95f7c2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:10.165185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:10.174145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b918ce7-9b9b-44bb-9b1e-38a3141d80bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:10.174771 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b918ce7-9b9b-44bb-9b1e-38a3141d80bc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:10.175758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b918ce7-9b9b-44bb-9b1e-38a3141d80bc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:10.176248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b918ce7-9b9b-44bb-9b1e-38a3141d80bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:10.177730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b918ce7-9b9b-44bb-9b1e-38a3141d80bc None admin] RBAC: Adding query filter params (interface=public, service_id=e1c49b323dec428683ca97d7d315a341, region_id=RegionOne) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:10.178037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b918ce7-9b9b-44bb-9b1e-38a3141d80bc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:10.179428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b918ce7-9b9b-44bb-9b1e-38a3141d80bc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:10.193656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 474/947] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Aug 1 11:51:10 2022] GET /identity/v3/endpoints?service_id=e1c49b323dec428683ca97d7d315a341&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:10.195740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b918ce7-9b9b-44bb-9b1e-38a3141d80bc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:10.211373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:10.286239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9848cc38-986a-4608-9699-80140d95f7c2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:10.323984 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b918ce7-9b9b-44bb-9b1e-38a3141d80bc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:10.336487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3a25f-7845-4617-989f-935efd761e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:10.337489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3a25f-7845-4617-989f-935efd761e3f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:10.337947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3a25f-7845-4617-989f-935efd761e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:10.338640 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3a25f-7845-4617-989f-935efd761e3f None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:10.339967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3a25f-7845-4617-989f-935efd761e3f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:10.340477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3a25f-7845-4617-989f-935efd761e3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:10.342533 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3a25f-7845-4617-989f-935efd761e3f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:10.349670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 474/948] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:51:10 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:10.366587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b6e8b9-7caf-4485-95c4-e74f07072bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:10.367875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6e8b9-7caf-4485-95c4-e74f07072bcc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:10.368362 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6e8b9-7caf-4485-95c4-e74f07072bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:10.368808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b6e8b9-7caf-4485-95c4-e74f07072bcc None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:10.369704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6e8b9-7caf-4485-95c4-e74f07072bcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:10.372376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b6e8b9-7caf-4485-95c4-e74f07072bcc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:10.378023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbef915-aa6f-40c3-964d-3120a7df6c32 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:10.378542 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbef915-aa6f-40c3-964d-3120a7df6c32 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:10.378542 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbef915-aa6f-40c3-964d-3120a7df6c32 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:10.380162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 475/949] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:51:10.381660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 475/950] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Aug 1 11:51:10 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 11:51:10.385566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477a0d7-23ef-4a04-a69f-5f3adbc6ecae None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:10.385855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477a0d7-23ef-4a04-a69f-5f3adbc6ecae None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:10.386131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0477a0d7-23ef-4a04-a69f-5f3adbc6ecae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:10.412022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0477a0d7-23ef-4a04-a69f-5f3adbc6ecae None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:10.413289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0477a0d7-23ef-4a04-a69f-5f3adbc6ecae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:10.429805 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24758a0f-57fd-42f0-ac67-ff04e54c9fc6 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:10.430416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24758a0f-57fd-42f0-ac67-ff04e54c9fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:10.430866 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24758a0f-57fd-42f0-ac67-ff04e54c9fc6 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:10.432442 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 476/951] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:51:10.438633 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59100188-6552-4ebf-9178-cb24bccafe19 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:10.438907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59100188-6552-4ebf-9178-cb24bccafe19 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:10.439182 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59100188-6552-4ebf-9178-cb24bccafe19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:10.459314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-59100188-6552-4ebf-9178-cb24bccafe19 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:10.460575 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-59100188-6552-4ebf-9178-cb24bccafe19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:10.510603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 476/952] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:10.535727 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477a0d7-23ef-4a04-a69f-5f3adbc6ecae None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:10.546917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:10.552227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 477/953] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:10.575030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59100188-6552-4ebf-9178-cb24bccafe19 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:10.592678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:10.659531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0477a0d7-23ef-4a04-a69f-5f3adbc6ecae None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:10.702664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2f22f-fb71-44c9-ac34-3d9afd883a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:10.704425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2f22f-fb71-44c9-ac34-3d9afd883a44 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:10.704706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2f22f-fb71-44c9-ac34-3d9afd883a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:10.704975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2f22f-fb71-44c9-ac34-3d9afd883a44 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:10.705677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2f22f-fb71-44c9-ac34-3d9afd883a44 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:10.706584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59100188-6552-4ebf-9178-cb24bccafe19 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:10.707210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d2f22f-fb71-44c9-ac34-3d9afd883a44 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:10.711042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: WARNING keystone.server.flask.common [None req-25d2f22f-fb71-44c9-ac34-3d9afd883a44 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 01 11:51:10.737265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.sql.core [None req-25d2f22f-fb71-44c9-ac34-3d9afd883a44 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 11:51:10.737265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 11:51:10.737265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [parameters: {'id': '33dba347d9a041c29771bed5daa0156e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 11:51:10.737265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80142) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 11:51:10.754438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cc7c1-bfdf-44ab-a6ad-74468e820905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:10.755172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cc7c1-bfdf-44ab-a6ad-74468e820905 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:10.755517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cc7c1-bfdf-44ab-a6ad-74468e820905 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:10.755854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cc7c1-bfdf-44ab-a6ad-74468e820905 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-25d2f22f-fb71-44c9-ac34-3d9afd883a44 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 33dba347d9a041c29771bed5daa0156e.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 33dba347d9a041c29771bed5daa0156e. Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application conn.query(q) Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 11:51:10.758520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application result.read() Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 01 11:51:10.759508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application next(self.gen) Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application yield resource Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application next(self.gen) Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise self.value Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application session.commit() Aug 01 11:51:10.761069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self.session.flush() Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application compat.raise_( Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 11:51:10.763241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 11:51:10.765370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application conn.query(q) Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application result.read() Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 11:51:10.767888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [parameters: {'id': '33dba347d9a041c29771bed5daa0156e', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:10.768981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:10.771839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:10.774288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:10.774288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 01 11:51:10.774288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 01 11:51:10.774288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:10.774288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:10.774288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 01 11:51:10.774288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 01 11:51:10.774288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 33dba347d9a041c29771bed5daa0156e. Aug 01 11:51:10.774288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:10.774288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 477/954] 10.222.0.42 () {60 vars in 1140 bytes} [Mon Aug 1 11:51:10 2022] POST /identity/v3/projects => generated 262 bytes in 225 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:10.774288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2f22f-fb71-44c9-ac34-3d9afd883a44 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:10.777978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cc7c1-bfdf-44ab-a6ad-74468e820905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-401cc7c1-bfdf-44ab-a6ad-74468e820905 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:51:10.784817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:10.786198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:10.787096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:10.787096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:10.787096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:10.787096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:10.787096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:51:10.787096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:51:10.787096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:51:10.787096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:51:10.787096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:51:10.787096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:51:10.787096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 11:51:10.787096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:10.792447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 478/955] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Aug 1 11:51:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:10.793740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cc7c1-bfdf-44ab-a6ad-74468e820905 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:10.847509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:10.892695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2f22f-fb71-44c9-ac34-3d9afd883a44 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:10.909757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:10.929479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482901be-cf04-4147-90a3-206b0b92b657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:10.930272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482901be-cf04-4147-90a3-206b0b92b657 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:10.930448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482901be-cf04-4147-90a3-206b0b92b657 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:10.930789 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482901be-cf04-4147-90a3-206b0b92b657 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:10.937936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482901be-cf04-4147-90a3-206b0b92b657 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:10.940069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482901be-cf04-4147-90a3-206b0b92b657 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-482901be-cf04-4147-90a3-206b0b92b657 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:51:10.951845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:10.952964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:10.954825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:51:10.954825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:51:10.954825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:51:10.954825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:51:10.954825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:51:10.954825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:51:10.954825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:10.954825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:10.954825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 478/956] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:10.958686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cc7c1-bfdf-44ab-a6ad-74468e820905 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:10.962276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482901be-cf04-4147-90a3-206b0b92b657 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:11.005330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6079ccf-1a6b-4b99-8058-58cd1a9637ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:11.006192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6079ccf-1a6b-4b99-8058-58cd1a9637ac None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:11.006491 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6079ccf-1a6b-4b99-8058-58cd1a9637ac None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:11.006769 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6079ccf-1a6b-4b99-8058-58cd1a9637ac None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:11.007483 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6079ccf-1a6b-4b99-8058-58cd1a9637ac None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:11.007779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6079ccf-1a6b-4b99-8058-58cd1a9637ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:11.009180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6079ccf-1a6b-4b99-8058-58cd1a9637ac None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:11.023960 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 479/957] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Aug 1 11:51:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:11.025735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6079ccf-1a6b-4b99-8058-58cd1a9637ac None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:11.098765 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482901be-cf04-4147-90a3-206b0b92b657 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:11.130201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:11.146384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9773b4-dcc7-4f83-b475-d837a589cf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:11.147876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9773b4-dcc7-4f83-b475-d837a589cf80 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:11.148320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9773b4-dcc7-4f83-b475-d837a589cf80 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:11.149005 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9773b4-dcc7-4f83-b475-d837a589cf80 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:11.149923 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9773b4-dcc7-4f83-b475-d837a589cf80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:11.150388 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9773b4-dcc7-4f83-b475-d837a589cf80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:11.151095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6079ccf-1a6b-4b99-8058-58cd1a9637ac None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:11.152151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9773b4-dcc7-4f83-b475-d837a589cf80 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:11.185960 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 479/958] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:51:10 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:11.190053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:11.199109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e0f93-3954-4106-83b6-14e03a44c464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:11.199824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0f93-3954-4106-83b6-14e03a44c464 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:11.200179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0f93-3954-4106-83b6-14e03a44c464 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:11.200735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080e0f93-3954-4106-83b6-14e03a44c464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:11.213847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e0f93-3954-4106-83b6-14e03a44c464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:11.215395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080e0f93-3954-4106-83b6-14e03a44c464 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-080e0f93-3954-4106-83b6-14e03a44c464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:11.231726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:11.232813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:11.233739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:11.233739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:11.233739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:11.233739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:11.233739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 480/959] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:11.242346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9773b4-dcc7-4f83-b475-d837a589cf80 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:11.360830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9773b4-dcc7-4f83-b475-d837a589cf80 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:11.396252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222aecb-08fe-4cf4-9bf5-5286420df94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:11.396878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222aecb-08fe-4cf4-9bf5-5286420df94a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:11.397126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222aecb-08fe-4cf4-9bf5-5286420df94a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:11.397419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c222aecb-08fe-4cf4-9bf5-5286420df94a None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:11.398110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222aecb-08fe-4cf4-9bf5-5286420df94a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:11.398406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222aecb-08fe-4cf4-9bf5-5286420df94a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:11.399760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c222aecb-08fe-4cf4-9bf5-5286420df94a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:11.412555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 480/960] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:11.418281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e0f93-3954-4106-83b6-14e03a44c464 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:11.525927 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080e0f93-3954-4106-83b6-14e03a44c464 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:11.566536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0dcc6-644a-4bd7-a90e-78a035f1bb71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:11.567180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0dcc6-644a-4bd7-a90e-78a035f1bb71 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:11.567458 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0dcc6-644a-4bd7-a90e-78a035f1bb71 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:11.567723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e0dcc6-644a-4bd7-a90e-78a035f1bb71 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:11.576024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0dcc6-644a-4bd7-a90e-78a035f1bb71 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:11.577502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e0dcc6-644a-4bd7-a90e-78a035f1bb71 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-94e0dcc6-644a-4bd7-a90e-78a035f1bb71 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:51:11.589655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:11.590645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:11.591595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:11.591595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:11.591595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:51:11.591595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:51:11.591595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:51:11.591595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:51:11.591595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:51:11.591595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:51:11.591595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 11:51:11.591595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:11.591595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 481/961] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Aug 1 11:51:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:11.599758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222aecb-08fe-4cf4-9bf5-5286420df94a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:11.648006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:11.703104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c222aecb-08fe-4cf4-9bf5-5286420df94a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:11.738570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463911f-0f93-4b8e-9bea-eba7bca0b2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:11.739502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463911f-0f93-4b8e-9bea-eba7bca0b2b6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:11.740305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463911f-0f93-4b8e-9bea-eba7bca0b2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:11.740788 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2463911f-0f93-4b8e-9bea-eba7bca0b2b6 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:11.741810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463911f-0f93-4b8e-9bea-eba7bca0b2b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:11.742334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463911f-0f93-4b8e-9bea-eba7bca0b2b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:11.743947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2463911f-0f93-4b8e-9bea-eba7bca0b2b6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:11.765615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 481/962] 10.222.0.42 () {56 vars in 1149 bytes} [Mon Aug 1 11:51:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:11.767398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0dcc6-644a-4bd7-a90e-78a035f1bb71 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:11.812192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:11.873053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e0dcc6-644a-4bd7-a90e-78a035f1bb71 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:11.907936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef063866-4b3d-4367-98bc-33df5fc131c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:11.908935 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063866-4b3d-4367-98bc-33df5fc131c1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:11.909465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063866-4b3d-4367-98bc-33df5fc131c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:11.909961 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef063866-4b3d-4367-98bc-33df5fc131c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:11.983040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef063866-4b3d-4367-98bc-33df5fc131c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:11.984937 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef063866-4b3d-4367-98bc-33df5fc131c1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:12.027138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:12.088391 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 482/963] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:51:11 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:51:12.093962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463911f-0f93-4b8e-9bea-eba7bca0b2b6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:12.202120 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2463911f-0f93-4b8e-9bea-eba7bca0b2b6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:12.204140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:12.237910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8164c-1589-425e-b644-8e4277615bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:12.238549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8164c-1589-425e-b644-8e4277615bba None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:12.238820 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8164c-1589-425e-b644-8e4277615bba None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:12.239086 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8164c-1589-425e-b644-8e4277615bba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:12.249582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8164c-1589-425e-b644-8e4277615bba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:12.251208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d8164c-1589-425e-b644-8e4277615bba None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-93d8164c-1589-425e-b644-8e4277615bba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:12.265686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:12.267100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:12.267997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:12.267997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:12.267997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:12.267997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:12.267997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 482/964] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:12.273246 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef063866-4b3d-4367-98bc-33df5fc131c1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:12.381800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef063866-4b3d-4367-98bc-33df5fc131c1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:12.417638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4424a6-35b1-4f21-8e42-5163c5969124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:12.418259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4424a6-35b1-4f21-8e42-5163c5969124 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:12.418533 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4424a6-35b1-4f21-8e42-5163c5969124 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:12.419065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4424a6-35b1-4f21-8e42-5163c5969124 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:12.419472 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4424a6-35b1-4f21-8e42-5163c5969124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:12.419766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4424a6-35b1-4f21-8e42-5163c5969124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:12.421130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4424a6-35b1-4f21-8e42-5163c5969124 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:12.429667 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:12.432907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 483/965] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:12.438978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8164c-1589-425e-b644-8e4277615bba None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:12.489124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc30d1-21b5-4f4f-9e2a-4e26cd06e7ad None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:12.489540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc30d1-21b5-4f4f-9e2a-4e26cd06e7ad None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:12.489724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc30d1-21b5-4f4f-9e2a-4e26cd06e7ad None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:12.491512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 484/966] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:12.496745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0c967-866d-4cc5-8772-1e7c787a3ea0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:12.497034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0c967-866d-4cc5-8772-1e7c787a3ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:12.497321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f0c967-866d-4cc5-8772-1e7c787a3ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:12.517224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f2f0c967-866d-4cc5-8772-1e7c787a3ea0 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:12.518448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f2f0c967-866d-4cc5-8772-1e7c787a3ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:12.548017 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8164c-1589-425e-b644-8e4277615bba None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:12.583426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43029ee5-9ea6-4cb9-9bb5-1d9e79caa02b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:12.584064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43029ee5-9ea6-4cb9-9bb5-1d9e79caa02b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:12.584341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43029ee5-9ea6-4cb9-9bb5-1d9e79caa02b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:12.584614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43029ee5-9ea6-4cb9-9bb5-1d9e79caa02b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:12.588823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 485/967] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:12.590333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93e1f4-a690-4400-ace6-9105d700ffea None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:12.590615 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93e1f4-a690-4400-ace6-9105d700ffea None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:12.590883 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d93e1f4-a690-4400-ace6-9105d700ffea None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:12.592288 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 486/968] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:12.597513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ebac9-6dd7-41f1-85ac-a64db2ec40e4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:12.597807 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ebac9-6dd7-41f1-85ac-a64db2ec40e4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:12.598067 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ebac9-6dd7-41f1-85ac-a64db2ec40e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:12.598178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43029ee5-9ea6-4cb9-9bb5-1d9e79caa02b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:12.599745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43029ee5-9ea6-4cb9-9bb5-1d9e79caa02b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-43029ee5-9ea6-4cb9-9bb5-1d9e79caa02b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:51:12.612089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:12.613270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:12.614505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:51:12.614505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:51:12.614505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:51:12.614505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:51:12.614505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:51:12.614505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:51:12.614505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:12.614505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:12.618027 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-972ebac9-6dd7-41f1-85ac-a64db2ec40e4 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:12.619199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-972ebac9-6dd7-41f1-85ac-a64db2ec40e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:12.621006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 483/969] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:51:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:12.621864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43029ee5-9ea6-4cb9-9bb5-1d9e79caa02b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:12.637596 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:12.691566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 487/970] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:12.692335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ebac9-6dd7-41f1-85ac-a64db2ec40e4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:12.741372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43029ee5-9ea6-4cb9-9bb5-1d9e79caa02b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:12.759799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:12.776923 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4509c-a32a-4579-8e6a-151a2b66e20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:12.777692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4509c-a32a-4579-8e6a-151a2b66e20b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:12.777969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4509c-a32a-4579-8e6a-151a2b66e20b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:12.778238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4509c-a32a-4579-8e6a-151a2b66e20b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:12.778860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4509c-a32a-4579-8e6a-151a2b66e20b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:12.780253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4509c-a32a-4579-8e6a-151a2b66e20b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d9b4509c-a32a-4579-8e6a-151a2b66e20b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:12.789881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:12.790982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:12.792378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 484/971] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Aug 1 11:51:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:12.793204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4509c-a32a-4579-8e6a-151a2b66e20b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:12.809121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ebac9-6dd7-41f1-85ac-a64db2ec40e4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:12.845669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c1e7b-a1d7-4174-9663-58a6111cc7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:12.846283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c1e7b-a1d7-4174-9663-58a6111cc7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:12.846556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c1e7b-a1d7-4174-9663-58a6111cc7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:12.846821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13c1e7b-a1d7-4174-9663-58a6111cc7f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:12.847577 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c1e7b-a1d7-4174-9663-58a6111cc7f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:12.847877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c1e7b-a1d7-4174-9663-58a6111cc7f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:12.849317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13c1e7b-a1d7-4174-9663-58a6111cc7f9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:12.861861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 488/972] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:51:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:12.862662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c1e7b-a1d7-4174-9663-58a6111cc7f9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:12.883973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:12.910183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4509c-a32a-4579-8e6a-151a2b66e20b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:12.951039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf06b34-ea97-47c3-b51e-8411208e00bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:12.951657 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf06b34-ea97-47c3-b51e-8411208e00bd None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:12.951932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf06b34-ea97-47c3-b51e-8411208e00bd None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:12.952703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf06b34-ea97-47c3-b51e-8411208e00bd None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:12.953422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf06b34-ea97-47c3-b51e-8411208e00bd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:12.955964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf06b34-ea97-47c3-b51e-8411208e00bd None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:12.966456 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13c1e7b-a1d7-4174-9663-58a6111cc7f9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:12.975090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 485/973] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:51:12 2022] POST /identity/v3/services => generated 242 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:51:12.976431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf06b34-ea97-47c3-b51e-8411208e00bd None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:12.988265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:13.012558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763a58e-ade8-4647-ad4b-9a8f71519885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:13.013183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763a58e-ade8-4647-ad4b-9a8f71519885 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:13.013490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763a58e-ade8-4647-ad4b-9a8f71519885 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:13.013815 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763a58e-ade8-4647-ad4b-9a8f71519885 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:13.014715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763a58e-ade8-4647-ad4b-9a8f71519885 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:13.015042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763a58e-ade8-4647-ad4b-9a8f71519885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:13.017030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763a58e-ade8-4647-ad4b-9a8f71519885 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:13.027775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 489/974] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Aug 1 11:51:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:13.028874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763a58e-ade8-4647-ad4b-9a8f71519885 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:13.122818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf06b34-ea97-47c3-b51e-8411208e00bd None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:13.143666 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763a58e-ade8-4647-ad4b-9a8f71519885 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:13.166999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebdedf-b2bf-4bc4-b0d4-805064f098d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:13.167540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebdedf-b2bf-4bc4-b0d4-805064f098d9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:13.167818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebdedf-b2bf-4bc4-b0d4-805064f098d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:13.168087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebdedf-b2bf-4bc4-b0d4-805064f098d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:13.168863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebdedf-b2bf-4bc4-b0d4-805064f098d9 None admin] RBAC: Adding query filter params (role.id=56fa13e514a34e459d15f9e505fc072d, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=fc14241a25484946a0ecc59c9776ac62) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:13.169163 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebdedf-b2bf-4bc4-b0d4-805064f098d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:13.170619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebdedf-b2bf-4bc4-b0d4-805064f098d9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:13.176618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 486/975] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:51:12 2022] GET /identity/v3/role_assignments?user.id=fc14241a25484946a0ecc59c9776ac62&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=56fa13e514a34e459d15f9e505fc072d => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:13.186304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2c247c-31e6-4bfc-9c9a-0034501aacdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:13.187036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c247c-31e6-4bfc-9c9a-0034501aacdd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:13.187418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c247c-31e6-4bfc-9c9a-0034501aacdd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:13.187762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2c247c-31e6-4bfc-9c9a-0034501aacdd None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:13.189052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c247c-31e6-4bfc-9c9a-0034501aacdd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:13.189467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c247c-31e6-4bfc-9c9a-0034501aacdd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:13.190956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2c247c-31e6-4bfc-9c9a-0034501aacdd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:13.197186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 490/976] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Aug 1 11:51:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:13.202946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebdedf-b2bf-4bc4-b0d4-805064f098d9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:13.206915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:13.335481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebdedf-b2bf-4bc4-b0d4-805064f098d9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:13.373243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdc817-0207-4b8d-9a38-48432d6cfcaa None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:13.373699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdc817-0207-4b8d-9a38-48432d6cfcaa None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:13.374071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffdc817-0207-4b8d-9a38-48432d6cfcaa None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:13.376039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 491/977] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:51:13.377422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196fbea-4ae7-48b3-83f5-14b11d14e006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:13.378183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196fbea-4ae7-48b3-83f5-14b11d14e006 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:13.378512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196fbea-4ae7-48b3-83f5-14b11d14e006 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:13.378875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196fbea-4ae7-48b3-83f5-14b11d14e006 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:13.379917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196fbea-4ae7-48b3-83f5-14b11d14e006 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:13.381110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94560527-a419-46d2-a042-e2059fe9dedc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:13.381307 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196fbea-4ae7-48b3-83f5-14b11d14e006 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:13.381534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94560527-a419-46d2-a042-e2059fe9dedc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:13.381816 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94560527-a419-46d2-a042-e2059fe9dedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:13.403681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-94560527-a419-46d2-a042-e2059fe9dedc None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:13.404899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-94560527-a419-46d2-a042-e2059fe9dedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:13.407146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 487/978] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 11:51:13 2022] POST /identity/v3/endpoints => generated 349 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:51:13.453975 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:13.495236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 492/979] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:13.521045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196fbea-4ae7-48b3-83f5-14b11d14e006 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:13.592030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:13.638065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196fbea-4ae7-48b3-83f5-14b11d14e006 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:13.674581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c3bd1-535d-4d57-84d5-af909cd4f077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:13.675201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c3bd1-535d-4d57-84d5-af909cd4f077 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:13.675471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c3bd1-535d-4d57-84d5-af909cd4f077 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:13.675737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c3bd1-535d-4d57-84d5-af909cd4f077 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:13.676404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c3bd1-535d-4d57-84d5-af909cd4f077 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:13.677855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c3bd1-535d-4d57-84d5-af909cd4f077 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:13.693666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.sql.core [None req-926c3bd1-535d-4d57-84d5-af909cd4f077 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 11:51:13.693666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 11:51:13.693666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [parameters: {'user_id': '198d7e6b0dff4194b8fdcdc365f5e3fc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 11:51:13.693666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80142) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-926c3bd1-535d-4d57-84d5-af909cd4f077 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application conn.query(q) Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application result.read() Aug 01 11:51:13.701010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 11:51:13.701956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application next(self.gen) Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application yield resource Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application next(self.gen) Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise self.value Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application session.commit() Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 11:51:13.702925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self.session.flush() Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application compat.raise_( Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 11:51:13.704435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 11:51:13.705393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application conn.query(q) Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application result.read() Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 11:51:13.706380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [parameters: {'user_id': '198d7e6b0dff4194b8fdcdc365f5e3fc', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:13.707222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 01 11:51:13.708034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 01 11:51:13.708955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 01 11:51:13.708955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 01 11:51:13.708955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 11:51:13.708955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 11:51:13.708955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 11:51:13.708955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:13.708955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 488/980] 10.222.0.42 () {60 vars in 1131 bytes} [Mon Aug 1 11:51:13 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:13.717124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94560527-a419-46d2-a042-e2059fe9dedc None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:13.823060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94560527-a419-46d2-a042-e2059fe9dedc None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:13.863706 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b00df7-de55-49de-9fbb-a792701f128e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:13.864808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00df7-de55-49de-9fbb-a792701f128e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:13.865346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00df7-de55-49de-9fbb-a792701f128e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:13.865864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b00df7-de55-49de-9fbb-a792701f128e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:13.874056 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b00df7-de55-49de-9fbb-a792701f128e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:13.875569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b00df7-de55-49de-9fbb-a792701f128e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c9b00df7-de55-49de-9fbb-a792701f128e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:51:13.888519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:13.889518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:13.890463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:13.890463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:13.890463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:51:13.890463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:51:13.890463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:51:13.890463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:51:13.890463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:51:13.890463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:51:13.890463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 11:51:13.890463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:13.890463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 493/981] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:51:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:13.897512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c3bd1-535d-4d57-84d5-af909cd4f077 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:14.006702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c3bd1-535d-4d57-84d5-af909cd4f077 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:14.032152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:14.048112 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4809a23-99f7-48b4-aa35-6f707b526a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:14.048690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4809a23-99f7-48b4-aa35-6f707b526a3e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:14.049352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4809a23-99f7-48b4-aa35-6f707b526a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:14.049632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4809a23-99f7-48b4-aa35-6f707b526a3e None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:14.050399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4809a23-99f7-48b4-aa35-6f707b526a3e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:14.051067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4809a23-99f7-48b4-aa35-6f707b526a3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:14.053129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4809a23-99f7-48b4-aa35-6f707b526a3e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:14.092047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 489/982] 10.222.0.42 () {56 vars in 1101 bytes} [Mon Aug 1 11:51:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:15.150387 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78d12d-f15f-45a0-a73c-c7269486b706 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.150919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78d12d-f15f-45a0-a73c-c7269486b706 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.150919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d78d12d-f15f-45a0-a73c-c7269486b706 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.152298 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 494/983] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:15.157614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d9dab-b1e9-4dfb-a6a3-f89d75045b6d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.157993 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d9dab-b1e9-4dfb-a6a3-f89d75045b6d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.158160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d9dab-b1e9-4dfb-a6a3-f89d75045b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.176791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b62d9dab-b1e9-4dfb-a6a3-f89d75045b6d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:15.178331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b62d9dab-b1e9-4dfb-a6a3-f89d75045b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:15.247838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 490/984] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:15.270271 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78d12d-f15f-45a0-a73c-c7269486b706 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:15.304049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:15.347184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df3c51-c52b-442b-8e69-2ac44973fbef None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.347522 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df3c51-c52b-442b-8e69-2ac44973fbef None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.347774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df3c51-c52b-442b-8e69-2ac44973fbef None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.349170 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 491/985] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:51:15.354552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1042-5b20-49f6-a501-db9bbf8db14f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.354920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1042-5b20-49f6-a501-db9bbf8db14f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.355264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641b1042-5b20-49f6-a501-db9bbf8db14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.373413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-641b1042-5b20-49f6-a501-db9bbf8db14f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:15.374590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-641b1042-5b20-49f6-a501-db9bbf8db14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:15.378747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d78d12d-f15f-45a0-a73c-c7269486b706 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:15.412064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac635d-d18d-488e-b519-db2284f949c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:15.412618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac635d-d18d-488e-b519-db2284f949c5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.412898 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac635d-d18d-488e-b519-db2284f949c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.413170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeac635d-d18d-488e-b519-db2284f949c5 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.413824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac635d-d18d-488e-b519-db2284f949c5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:15.415190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeac635d-d18d-488e-b519-db2284f949c5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-eeac635d-d18d-488e-b519-db2284f949c5 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:15.424852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:15.425923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:15.426780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 495/986] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:51:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:15.431798 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac635d-d18d-488e-b519-db2284f949c5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:15.448204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 492/987] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:15.469918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b1042-5b20-49f6-a501-db9bbf8db14f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:15.510603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:15.533466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:15.540329 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeac635d-d18d-488e-b519-db2284f949c5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:15.575232 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff23c46-33bb-4154-a093-49c61c10f72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:15.575849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff23c46-33bb-4154-a093-49c61c10f72b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.576130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff23c46-33bb-4154-a093-49c61c10f72b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.576401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff23c46-33bb-4154-a093-49c61c10f72b None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.577074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff23c46-33bb-4154-a093-49c61c10f72b None admin] RBAC: Adding query filter params (name=compute) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:15.577398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff23c46-33bb-4154-a093-49c61c10f72b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:15.578694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641b1042-5b20-49f6-a501-db9bbf8db14f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:15.578800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff23c46-33bb-4154-a093-49c61c10f72b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:15.583834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 496/988] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:51:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:15.589731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff23c46-33bb-4154-a093-49c61c10f72b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:15.616404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a405fc-c748-4f5e-a382-39f13a94500f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:15.617133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a405fc-c748-4f5e-a382-39f13a94500f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.617445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a405fc-c748-4f5e-a382-39f13a94500f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.617718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a405fc-c748-4f5e-a382-39f13a94500f None admin] PATH_INFO: `/v3/services/image` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.618347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a405fc-c748-4f5e-a382-39f13a94500f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:15.619720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a405fc-c748-4f5e-a382-39f13a94500f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-41a405fc-c748-4f5e-a382-39f13a94500f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:15.628518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:15.629729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:15.630667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 493/989] 10.222.0.42 () {56 vars in 1105 bytes} [Mon Aug 1 11:51:15 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:15.631479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df275d8c-1e99-4633-ab89-a83951a4c253 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.631479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df275d8c-1e99-4633-ab89-a83951a4c253 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.631731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df275d8c-1e99-4633-ab89-a83951a4c253 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.633424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 494/990] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:15.635421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df275d8c-1e99-4633-ab89-a83951a4c253 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:15.692820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff23c46-33bb-4154-a093-49c61c10f72b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:15.725910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c52cdb-df6d-44b9-862e-f7c107badcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:15.726779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c52cdb-df6d-44b9-862e-f7c107badcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.727051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c52cdb-df6d-44b9-862e-f7c107badcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.727332 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c52cdb-df6d-44b9-862e-f7c107badcf1 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.728018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c52cdb-df6d-44b9-862e-f7c107badcf1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:15.728321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c52cdb-df6d-44b9-862e-f7c107badcf1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:15.729703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c52cdb-df6d-44b9-862e-f7c107badcf1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:15.734035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df275d8c-1e99-4633-ab89-a83951a4c253 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:15.734315 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 497/991] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:51:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:15.736108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abbde8-e504-4c22-873c-35fbb23ac0c6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.736238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:15.736405 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abbde8-e504-4c22-873c-35fbb23ac0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.737018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51abbde8-e504-4c22-873c-35fbb23ac0c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.754690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-51abbde8-e504-4c22-873c-35fbb23ac0c6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:15.755884 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-51abbde8-e504-4c22-873c-35fbb23ac0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:15.772277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:15.773501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007d0a-c46b-44cf-9e59-81ae2a5d1c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:15.774148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007d0a-c46b-44cf-9e59-81ae2a5d1c6a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.774536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007d0a-c46b-44cf-9e59-81ae2a5d1c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.774821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84007d0a-c46b-44cf-9e59-81ae2a5d1c6a None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.775492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84007d0a-c46b-44cf-9e59-81ae2a5d1c6a None admin] RBAC: Adding query filter params (name=image) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:15.775796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84007d0a-c46b-44cf-9e59-81ae2a5d1c6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:15.777161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84007d0a-c46b-44cf-9e59-81ae2a5d1c6a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:15.782730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 495/992] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:15.783411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007d0a-c46b-44cf-9e59-81ae2a5d1c6a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:15.826320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 498/993] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:15 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:15.827196 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abbde8-e504-4c22-873c-35fbb23ac0c6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:15.883359 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84007d0a-c46b-44cf-9e59-81ae2a5d1c6a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:15.919719 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcbd44-92f2-40bd-ac55-5adfea37fff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:15.920329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcbd44-92f2-40bd-ac55-5adfea37fff6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.920601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcbd44-92f2-40bd-ac55-5adfea37fff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.920866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcbd44-92f2-40bd-ac55-5adfea37fff6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.921637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcbd44-92f2-40bd-ac55-5adfea37fff6 None admin] RBAC: Adding query filter params (interface=public, service_id=28db0e6fed0643359a11c3bb13c8920d, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:15.921940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcbd44-92f2-40bd-ac55-5adfea37fff6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:15.923302 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcbd44-92f2-40bd-ac55-5adfea37fff6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:15.928270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 496/994] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Aug 1 11:51:15 2022] GET /identity/v3/endpoints?service_id=28db0e6fed0643359a11c3bb13c8920d&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:15.928873 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcbd44-92f2-40bd-ac55-5adfea37fff6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:15.935905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51abbde8-e504-4c22-873c-35fbb23ac0c6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:15.959190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:15.970596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d850da-0bd8-4f3a-9c61-66c0450d1c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:15.971203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d850da-0bd8-4f3a-9c61-66c0450d1c58 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:15.971479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d850da-0bd8-4f3a-9c61-66c0450d1c58 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:15.971747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d850da-0bd8-4f3a-9c61-66c0450d1c58 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:15.972411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d850da-0bd8-4f3a-9c61-66c0450d1c58 None admin] RBAC: Adding query filter params (type=image) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:15.972707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d850da-0bd8-4f3a-9c61-66c0450d1c58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:15.974158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d850da-0bd8-4f3a-9c61-66c0450d1c58 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:15.978712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 499/995] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:15.979466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d850da-0bd8-4f3a-9c61-66c0450d1c58 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:16.013057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:16.040308 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcbd44-92f2-40bd-ac55-5adfea37fff6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:16.078376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff24eef-d4d3-403a-bbda-a9091838ad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:16.079572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff24eef-d4d3-403a-bbda-a9091838ad8b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:16.079851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff24eef-d4d3-403a-bbda-a9091838ad8b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:16.080123 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff24eef-d4d3-403a-bbda-a9091838ad8b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:16.080760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff24eef-d4d3-403a-bbda-a9091838ad8b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:16.082177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff24eef-d4d3-403a-bbda-a9091838ad8b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-aff24eef-d4d3-403a-bbda-a9091838ad8b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:16.092258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:16.093381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:16.094830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 497/996] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Aug 1 11:51:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:16.100269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff24eef-d4d3-403a-bbda-a9091838ad8b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:16.117902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d850da-0bd8-4f3a-9c61-66c0450d1c58 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:16.164859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c006e58-a8ac-4c30-b6c8-c3015eba3485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:16.165614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c006e58-a8ac-4c30-b6c8-c3015eba3485 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:16.165902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c006e58-a8ac-4c30-b6c8-c3015eba3485 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:16.166173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c006e58-a8ac-4c30-b6c8-c3015eba3485 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:16.166819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c006e58-a8ac-4c30-b6c8-c3015eba3485 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:16.168200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c006e58-a8ac-4c30-b6c8-c3015eba3485 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:16.174896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 500/997] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Aug 1 11:51:15 2022] GET /identity/v3/services => generated 1727 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 11:51:16.206251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:16.214982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff24eef-d4d3-403a-bbda-a9091838ad8b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:16.253364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fec1dd-7298-4969-a9da-d62bdf5c9682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:16.254004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fec1dd-7298-4969-a9da-d62bdf5c9682 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:16.254282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fec1dd-7298-4969-a9da-d62bdf5c9682 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:16.254556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fec1dd-7298-4969-a9da-d62bdf5c9682 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:16.255250 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fec1dd-7298-4969-a9da-d62bdf5c9682 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:16.255553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fec1dd-7298-4969-a9da-d62bdf5c9682 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:16.256970 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fec1dd-7298-4969-a9da-d62bdf5c9682 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:16.268073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 498/998] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Aug 1 11:51:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:16.269084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c006e58-a8ac-4c30-b6c8-c3015eba3485 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:16.356925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:16.377227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c006e58-a8ac-4c30-b6c8-c3015eba3485 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:16.412180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47b011-205e-44d2-b2c1-c7eea3bf0c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:16.413107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47b011-205e-44d2-b2c1-c7eea3bf0c7f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:16.413609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47b011-205e-44d2-b2c1-c7eea3bf0c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:16.414082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a47b011-205e-44d2-b2c1-c7eea3bf0c7f None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:16.414926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47b011-205e-44d2-b2c1-c7eea3bf0c7f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:16.415393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47b011-205e-44d2-b2c1-c7eea3bf0c7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:16.416927 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a47b011-205e-44d2-b2c1-c7eea3bf0c7f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:16.422537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 501/999] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Aug 1 11:51:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:16.428549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fec1dd-7298-4969-a9da-d62bdf5c9682 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:16.531319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fec1dd-7298-4969-a9da-d62bdf5c9682 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:16.565163 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2e3b8-e39c-4dfc-802e-366aa0271180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:16.565809 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2e3b8-e39c-4dfc-802e-366aa0271180 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:16.566089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2e3b8-e39c-4dfc-802e-366aa0271180 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:16.566360 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2e3b8-e39c-4dfc-802e-366aa0271180 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:16.567110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2e3b8-e39c-4dfc-802e-366aa0271180 None admin] RBAC: Adding query filter params (interface=admin, service_id=e1c49b323dec428683ca97d7d315a341, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:16.567415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2e3b8-e39c-4dfc-802e-366aa0271180 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:16.568763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2e3b8-e39c-4dfc-802e-366aa0271180 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:16.573898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 499/1000] 10.222.0.42 () {56 vars in 1249 bytes} [Mon Aug 1 11:51:16 2022] GET /identity/v3/endpoints?service_id=e1c49b323dec428683ca97d7d315a341&interface=admin®ion_id=RegionOne => generated 193 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:16.579255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47b011-205e-44d2-b2c1-c7eea3bf0c7f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:16.682078 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a47b011-205e-44d2-b2c1-c7eea3bf0c7f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:16.717305 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651006d8-7426-45d2-81ca-b88816224aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:16.717943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651006d8-7426-45d2-81ca-b88816224aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:16.718217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651006d8-7426-45d2-81ca-b88816224aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:16.718487 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651006d8-7426-45d2-81ca-b88816224aa9 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:16.719169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651006d8-7426-45d2-81ca-b88816224aa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:16.720545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651006d8-7426-45d2-81ca-b88816224aa9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:16.731694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 502/1001] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Aug 1 11:51:16 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 11:51:18.008876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09758b-85b3-4266-8b32-25f9be14d45d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:18.009422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09758b-85b3-4266-8b32-25f9be14d45d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:18.009503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09758b-85b3-4266-8b32-25f9be14d45d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:18.010976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 500/1002] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:18.018002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249ea2-d4aa-47a2-946c-647159189787 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:18.018456 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249ea2-d4aa-47a2-946c-647159189787 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:18.018548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6249ea2-d4aa-47a2-946c-647159189787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:18.041994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c6249ea2-d4aa-47a2-946c-647159189787 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:18.044625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c6249ea2-d4aa-47a2-946c-647159189787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:18.049790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:18.118220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 503/1003] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:18.140011 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09758b-85b3-4266-8b32-25f9be14d45d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:18.165996 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:18.208054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f4bc4-670f-4a99-8d6c-619cf31e1c60 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:18.208364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f4bc4-670f-4a99-8d6c-619cf31e1c60 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:18.208613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820f4bc4-670f-4a99-8d6c-619cf31e1c60 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:18.210329 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 504/1004] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:51:18.215480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47108d-17e4-4c70-b9e0-6360bc9a7e70 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:18.215758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47108d-17e4-4c70-b9e0-6360bc9a7e70 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:18.216024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b47108d-17e4-4c70-b9e0-6360bc9a7e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:18.234481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3b47108d-17e4-4c70-b9e0-6360bc9a7e70 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:18.235902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3b47108d-17e4-4c70-b9e0-6360bc9a7e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:18.245766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09758b-85b3-4266-8b32-25f9be14d45d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:18.280562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1494f1-5607-4a61-9e31-d04740bed2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:18.281099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1494f1-5607-4a61-9e31-d04740bed2ef None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:18.281415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1494f1-5607-4a61-9e31-d04740bed2ef None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:18.282285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1494f1-5607-4a61-9e31-d04740bed2ef None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:18.282985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1494f1-5607-4a61-9e31-d04740bed2ef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:18.284351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1494f1-5607-4a61-9e31-d04740bed2ef None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:18.302739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 501/1005] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:51:18 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:51:18.331544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 505/1006] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:18 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:18.355534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1494f1-5607-4a61-9e31-d04740bed2ef None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:18.447095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:18.469124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1494f1-5607-4a61-9e31-d04740bed2ef None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:18.505074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33755090-b041-456b-8ade-6eb4ba01efe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:18.505760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33755090-b041-456b-8ade-6eb4ba01efe8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:18.506045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33755090-b041-456b-8ade-6eb4ba01efe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:18.506320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33755090-b041-456b-8ade-6eb4ba01efe8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:18.506949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33755090-b041-456b-8ade-6eb4ba01efe8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:18.508315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33755090-b041-456b-8ade-6eb4ba01efe8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-33755090-b041-456b-8ade-6eb4ba01efe8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:18.518045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:18.519067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:18.521274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 502/1007] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:51:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:18.527730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47108d-17e4-4c70-b9e0-6360bc9a7e70 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:18.590992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:18.630731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b47108d-17e4-4c70-b9e0-6360bc9a7e70 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:18.664931 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd8056a-d8e9-48c4-91dd-14237edd698a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:18.665577 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8056a-d8e9-48c4-91dd-14237edd698a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:18.665860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8056a-d8e9-48c4-91dd-14237edd698a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:18.666136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd8056a-d8e9-48c4-91dd-14237edd698a None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:18.666817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8056a-d8e9-48c4-91dd-14237edd698a None admin] RBAC: Adding query filter params (name=compute) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:18.667120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8056a-d8e9-48c4-91dd-14237edd698a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:18.668500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd8056a-d8e9-48c4-91dd-14237edd698a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:18.678179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 506/1008] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:51:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:18.679709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33755090-b041-456b-8ade-6eb4ba01efe8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:18.748526 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ae720-5f1b-4581-9358-ef718c2b3cd9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:18.748870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ae720-5f1b-4581-9358-ef718c2b3cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:18.749069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9ae720-5f1b-4581-9358-ef718c2b3cd9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:18.751261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 507/1009] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:18.756331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be48b5-7ee0-432d-b6d3-14ecc0a15602 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:18.756616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be48b5-7ee0-432d-b6d3-14ecc0a15602 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:18.756896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be48b5-7ee0-432d-b6d3-14ecc0a15602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:18.776215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f0be48b5-7ee0-432d-b6d3-14ecc0a15602 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:18.777434 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f0be48b5-7ee0-432d-b6d3-14ecc0a15602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:18.786805 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33755090-b041-456b-8ade-6eb4ba01efe8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:18.824978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca6b1d-7ddd-4fb6-bf10-1fe47b5e4631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:18.825633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca6b1d-7ddd-4fb6-bf10-1fe47b5e4631 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:18.826058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca6b1d-7ddd-4fb6-bf10-1fe47b5e4631 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:18.826336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca6b1d-7ddd-4fb6-bf10-1fe47b5e4631 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:18.827386 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca6b1d-7ddd-4fb6-bf10-1fe47b5e4631 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:18.827702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca6b1d-7ddd-4fb6-bf10-1fe47b5e4631 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:18.829102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adca6b1d-7ddd-4fb6-bf10-1fe47b5e4631 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:18.839010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 503/1010] 10.222.0.42 () {56 vars in 1112 bytes} [Mon Aug 1 11:51:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:18.839842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca6b1d-7ddd-4fb6-bf10-1fe47b5e4631 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:18.847793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 508/1011] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:18 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:18.852063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:18.871147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be48b5-7ee0-432d-b6d3-14ecc0a15602 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:18.931626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:18.942029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adca6b1d-7ddd-4fb6-bf10-1fe47b5e4631 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:18.984632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7da8e-dcaf-488d-af6d-e7874268a6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:18.985254 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7da8e-dcaf-488d-af6d-e7874268a6cb None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:18.985557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7da8e-dcaf-488d-af6d-e7874268a6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:18.985824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed7da8e-dcaf-488d-af6d-e7874268a6cb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:18.986516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7da8e-dcaf-488d-af6d-e7874268a6cb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:18.987774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be48b5-7ee0-432d-b6d3-14ecc0a15602 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:18.987920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed7da8e-dcaf-488d-af6d-e7874268a6cb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:19.009945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 504/1012] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 11:51:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:51:19.041213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d05992-5640-4979-a08c-8141029e30ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:19.041897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d05992-5640-4979-a08c-8141029e30ac None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:19.042171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d05992-5640-4979-a08c-8141029e30ac None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:19.042435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d05992-5640-4979-a08c-8141029e30ac None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:19.043071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d05992-5640-4979-a08c-8141029e30ac None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:19.044477 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d05992-5640-4979-a08c-8141029e30ac None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f2d05992-5640-4979-a08c-8141029e30ac None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:19.054459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:19.055552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:19.061837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 509/1013] 10.222.0.42 () {56 vars in 1126 bytes} [Mon Aug 1 11:51:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:19.064440 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7da8e-dcaf-488d-af6d-e7874268a6cb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:19.135369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:19.177352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed7da8e-dcaf-488d-af6d-e7874268a6cb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:19.212350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c97da-0b12-4f89-af3b-1fc29b670817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:19.212971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c97da-0b12-4f89-af3b-1fc29b670817 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:19.213250 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c97da-0b12-4f89-af3b-1fc29b670817 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:19.213565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13c97da-0b12-4f89-af3b-1fc29b670817 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:19.214244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c97da-0b12-4f89-af3b-1fc29b670817 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:19.214544 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c97da-0b12-4f89-af3b-1fc29b670817 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:19.215914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13c97da-0b12-4f89-af3b-1fc29b670817 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:19.220914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 505/1014] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Aug 1 11:51:19 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:19.226762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d05992-5640-4979-a08c-8141029e30ac None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:19.335535 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d05992-5640-4979-a08c-8141029e30ac None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:19.353851 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:19.371723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f04ae5-679f-4387-ba00-dd29f5e140fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:19.372341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f04ae5-679f-4387-ba00-dd29f5e140fb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:19.372620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f04ae5-679f-4387-ba00-dd29f5e140fb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:19.372890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f04ae5-679f-4387-ba00-dd29f5e140fb None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:19.373589 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f04ae5-679f-4387-ba00-dd29f5e140fb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:19.373894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f04ae5-679f-4387-ba00-dd29f5e140fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:19.375932 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f04ae5-679f-4387-ba00-dd29f5e140fb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:19.385459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 510/1015] 10.222.0.42 () {56 vars in 1122 bytes} [Mon Aug 1 11:51:19 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:19.387001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c97da-0b12-4f89-af3b-1fc29b670817 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:19.491470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13c97da-0b12-4f89-af3b-1fc29b670817 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:19.519909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:19.527143 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be1d03a-0fd6-4d0f-9369-1213ed4f29a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:19.527760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1d03a-0fd6-4d0f-9369-1213ed4f29a4 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:19.528041 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1d03a-0fd6-4d0f-9369-1213ed4f29a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:19.528315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be1d03a-0fd6-4d0f-9369-1213ed4f29a4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:19.529015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1d03a-0fd6-4d0f-9369-1213ed4f29a4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:19.530411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be1d03a-0fd6-4d0f-9369-1213ed4f29a4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:19.553337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 506/1016] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 11:51:19 2022] POST /identity/v3/endpoints => generated 325 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 11:51:20.337531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac00618-3e2f-4d99-90bb-0b64190f30f1 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:20.338067 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac00618-3e2f-4d99-90bb-0b64190f30f1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:20.338067 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac00618-3e2f-4d99-90bb-0b64190f30f1 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:20.339586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 511/1017] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:20.344537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2119e-45af-4a34-88b7-4bdb0b8fdb64 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:20.344983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2119e-45af-4a34-88b7-4bdb0b8fdb64 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:20.345076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b2119e-45af-4a34-88b7-4bdb0b8fdb64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:20.363614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b6b2119e-45af-4a34-88b7-4bdb0b8fdb64 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:20.364796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b6b2119e-45af-4a34-88b7-4bdb0b8fdb64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:20.438702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 507/1018] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:20 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:20.461591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac00618-3e2f-4d99-90bb-0b64190f30f1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:20.565970 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac00618-3e2f-4d99-90bb-0b64190f30f1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:20.600820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139394d-c08c-4436-853c-ff6e5904002e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:20.601731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139394d-c08c-4436-853c-ff6e5904002e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:20.602007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139394d-c08c-4436-853c-ff6e5904002e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:20.602276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e139394d-c08c-4436-853c-ff6e5904002e None admin] PATH_INFO: `/v3/services/image` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:20.602892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139394d-c08c-4436-853c-ff6e5904002e None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:20.604266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e139394d-c08c-4436-853c-ff6e5904002e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e139394d-c08c-4436-853c-ff6e5904002e None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:20.614012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:20.615042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 11:51:20.615913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:20.617561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 512/1019] 10.222.0.42 () {56 vars in 1105 bytes} [Mon Aug 1 11:51:20 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:20.621275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2119e-45af-4a34-88b7-4bdb0b8fdb64 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:20.723309 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b2119e-45af-4a34-88b7-4bdb0b8fdb64 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:20.740507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:20.761015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad277c-e77e-4921-9ba6-667f1f39cfbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:20.761723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad277c-e77e-4921-9ba6-667f1f39cfbd None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:20.761996 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad277c-e77e-4921-9ba6-667f1f39cfbd None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:20.762269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bad277c-e77e-4921-9ba6-667f1f39cfbd None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:20.762944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad277c-e77e-4921-9ba6-667f1f39cfbd None admin] RBAC: Adding query filter params (name=image) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:20.763244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad277c-e77e-4921-9ba6-667f1f39cfbd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:20.764617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bad277c-e77e-4921-9ba6-667f1f39cfbd None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:20.774975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 508/1020] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:20.776498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139394d-c08c-4436-853c-ff6e5904002e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:20.825644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:20.884947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e139394d-c08c-4436-853c-ff6e5904002e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:20.922240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d43083-9a4a-405a-a8eb-a0f9746781d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:20.922917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d43083-9a4a-405a-a8eb-a0f9746781d6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:20.923201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d43083-9a4a-405a-a8eb-a0f9746781d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:20.923473 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d43083-9a4a-405a-a8eb-a0f9746781d6 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:20.924141 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d43083-9a4a-405a-a8eb-a0f9746781d6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:20.924442 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d43083-9a4a-405a-a8eb-a0f9746781d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:20.925857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d43083-9a4a-405a-a8eb-a0f9746781d6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:20.935396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 513/1021] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:20.936903 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad277c-e77e-4921-9ba6-667f1f39cfbd None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:21.046886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bad277c-e77e-4921-9ba6-667f1f39cfbd None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:21.082544 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a11ebd-5c42-430f-9a57-9d5b84f7c7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:21.083089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a11ebd-5c42-430f-9a57-9d5b84f7c7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:21.083366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a11ebd-5c42-430f-9a57-9d5b84f7c7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:21.083633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a11ebd-5c42-430f-9a57-9d5b84f7c7f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:21.084448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a11ebd-5c42-430f-9a57-9d5b84f7c7f3 None admin] RBAC: Adding query filter params (interface=public, service_id=0aacd43d88bc4b9fb6f286572b19831a, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:21.084758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a11ebd-5c42-430f-9a57-9d5b84f7c7f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:21.086151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a11ebd-5c42-430f-9a57-9d5b84f7c7f3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:21.095938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 509/1022] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Aug 1 11:51:20 2022] GET /identity/v3/endpoints?service_id=0aacd43d88bc4b9fb6f286572b19831a&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:21.097571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d43083-9a4a-405a-a8eb-a0f9746781d6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:21.149900 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e354dd-327b-463c-b2d6-7d4da5fb0aca None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:21.150180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e354dd-327b-463c-b2d6-7d4da5fb0aca None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:21.150449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e354dd-327b-463c-b2d6-7d4da5fb0aca None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:21.151796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 510/1023] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:51:21.156835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1379fce-6bc4-4e08-99bb-e03360ad599b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:21.157120 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1379fce-6bc4-4e08-99bb-e03360ad599b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:21.157447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1379fce-6bc4-4e08-99bb-e03360ad599b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:21.175494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f1379fce-6bc4-4e08-99bb-e03360ad599b None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:21.176680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f1379fce-6bc4-4e08-99bb-e03360ad599b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:21.207489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d43083-9a4a-405a-a8eb-a0f9746781d6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:21.218914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:21.219681 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:21.246506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c70fd5-d703-4945-9077-ec771f42cb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:21.247120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c70fd5-d703-4945-9077-ec771f42cb9f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:21.247392 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c70fd5-d703-4945-9077-ec771f42cb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:21.247660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c70fd5-d703-4945-9077-ec771f42cb9f None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:21.248305 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c70fd5-d703-4945-9077-ec771f42cb9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:21.249726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c70fd5-d703-4945-9077-ec771f42cb9f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:21.256987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 514/1024] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Aug 1 11:51:21 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 11:51:21.257565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 511/1025] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:21.273589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1379fce-6bc4-4e08-99bb-e03360ad599b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:21.395065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1379fce-6bc4-4e08-99bb-e03360ad599b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:21.433247 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d430b3-dde7-4064-90ae-0d77c91d0fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:21.433968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d430b3-dde7-4064-90ae-0d77c91d0fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:21.434251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d430b3-dde7-4064-90ae-0d77c91d0fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:21.434521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d430b3-dde7-4064-90ae-0d77c91d0fb5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:21.444824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d430b3-dde7-4064-90ae-0d77c91d0fb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-a4d430b3-dde7-4064-90ae-0d77c91d0fb5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:51:21.449715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:21.450691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:21.451573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 512/1026] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Aug 1 11:51:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:21.458523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c70fd5-d703-4945-9077-ec771f42cb9f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:21.560673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c70fd5-d703-4945-9077-ec771f42cb9f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:21.582715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a99bd6-7047-4ca5-bae6-a18195104884 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:21.583048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a99bd6-7047-4ca5-bae6-a18195104884 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:21.583294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a99bd6-7047-4ca5-bae6-a18195104884 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:21.588418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 513/1027] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:21.589708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa467b18-5568-4f8f-a9a4-62a89eed7ac2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:21.589988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa467b18-5568-4f8f-a9a4-62a89eed7ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:21.590264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa467b18-5568-4f8f-a9a4-62a89eed7ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:21.596192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b0b09-1ff7-4e0d-afaf-793f5618a4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:21.596811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b0b09-1ff7-4e0d-afaf-793f5618a4ab None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:21.597090 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b0b09-1ff7-4e0d-afaf-793f5618a4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:21.597394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237b0b09-1ff7-4e0d-afaf-793f5618a4ab None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:21.598110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b0b09-1ff7-4e0d-afaf-793f5618a4ab None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:21.598419 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b0b09-1ff7-4e0d-afaf-793f5618a4ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:21.599795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-237b0b09-1ff7-4e0d-afaf-793f5618a4ab None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:21.612587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 515/1028] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Aug 1 11:51:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:21.612773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fa467b18-5568-4f8f-a9a4-62a89eed7ac2 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:21.612773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fa467b18-5568-4f8f-a9a4-62a89eed7ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:21.615975 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b0b09-1ff7-4e0d-afaf-793f5618a4ab None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:21.638736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:21.655196 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:21.681631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 514/1029] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:21.704536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa467b18-5568-4f8f-a9a4-62a89eed7ac2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:21.725668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237b0b09-1ff7-4e0d-afaf-793f5618a4ab None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:21.761330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ca926-b713-4a1f-84cf-40e4140180fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:21.761962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ca926-b713-4a1f-84cf-40e4140180fb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:21.762239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ca926-b713-4a1f-84cf-40e4140180fb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:21.762510 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ca926-b713-4a1f-84cf-40e4140180fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:21.773686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ca926-b713-4a1f-84cf-40e4140180fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:21.775128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ca926-b713-4a1f-84cf-40e4140180fb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-5f8ca926-b713-4a1f-84cf-40e4140180fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:21.790414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:21.791358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:21.792263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:21.792263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:21.792263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:21.792263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:21.792263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 516/1030] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:21.797155 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ca926-b713-4a1f-84cf-40e4140180fb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:21.815379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa467b18-5568-4f8f-a9a4-62a89eed7ac2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:21.856966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b2eac-fa80-4855-b02b-fa8bdfc3c661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:21.857891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b2eac-fa80-4855-b02b-fa8bdfc3c661 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:21.858175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b2eac-fa80-4855-b02b-fa8bdfc3c661 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:21.858442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75b2eac-fa80-4855-b02b-fa8bdfc3c661 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:21.860722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b2eac-fa80-4855-b02b-fa8bdfc3c661 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:21.862466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75b2eac-fa80-4855-b02b-fa8bdfc3c661 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:21.865609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 515/1031] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:21.869915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b2eac-fa80-4855-b02b-fa8bdfc3c661 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:21.888103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:21.901721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ca926-b713-4a1f-84cf-40e4140180fb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:21.904828 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:21.938874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3c4a4-b708-4d02-8ee1-566cffcdc9b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:21.939737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3c4a4-b708-4d02-8ee1-566cffcdc9b0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:21.940019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3c4a4-b708-4d02-8ee1-566cffcdc9b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:21.940291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3c4a4-b708-4d02-8ee1-566cffcdc9b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:21.940973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3c4a4-b708-4d02-8ee1-566cffcdc9b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:21.941275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3c4a4-b708-4d02-8ee1-566cffcdc9b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:21.942694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3c4a4-b708-4d02-8ee1-566cffcdc9b0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:21.955059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 517/1032] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:21.960670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3c4a4-b708-4d02-8ee1-566cffcdc9b0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:21.986600 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75b2eac-fa80-4855-b02b-fa8bdfc3c661 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:22.024343 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04508eff-5d6b-44d6-b236-8922b152f0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:22.025283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04508eff-5d6b-44d6-b236-8922b152f0dd None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:22.025745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04508eff-5d6b-44d6-b236-8922b152f0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:22.026169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04508eff-5d6b-44d6-b236-8922b152f0dd None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:22.027133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04508eff-5d6b-44d6-b236-8922b152f0dd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:22.028903 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04508eff-5d6b-44d6-b236-8922b152f0dd None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:22.061964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 516/1033] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:51:21 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 11:51:22.069272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3c4a4-b708-4d02-8ee1-566cffcdc9b0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:22.108092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4e97d-75c1-4e2f-86ab-818948cd4167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:22.108745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e97d-75c1-4e2f-86ab-818948cd4167 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:22.109023 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e97d-75c1-4e2f-86ab-818948cd4167 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:22.109383 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e4e97d-75c1-4e2f-86ab-818948cd4167 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:22.118203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4e97d-75c1-4e2f-86ab-818948cd4167 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:22.119802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e4e97d-75c1-4e2f-86ab-818948cd4167 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-34e4e97d-75c1-4e2f-86ab-818948cd4167 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:51:22.133121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:22.134256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:22.140001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:22.140001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:22.140001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:51:22.140001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:51:22.140001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:51:22.140001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:51:22.140001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:51:22.140001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:51:22.140001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:51:22.140001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:22.140001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 518/1034] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Aug 1 11:51:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:22.142707 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04508eff-5d6b-44d6-b236-8922b152f0dd None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:22.236992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:22.255903 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04508eff-5d6b-44d6-b236-8922b152f0dd None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:22.292946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74c93b-1905-4d3d-8f50-665798072e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:22.293748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74c93b-1905-4d3d-8f50-665798072e8d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:22.294098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74c93b-1905-4d3d-8f50-665798072e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:22.294438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d74c93b-1905-4d3d-8f50-665798072e8d None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:22.295307 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74c93b-1905-4d3d-8f50-665798072e8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:22.295685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74c93b-1905-4d3d-8f50-665798072e8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:22.297807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d74c93b-1905-4d3d-8f50-665798072e8d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:22.316384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 517/1035] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Aug 1 11:51:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:22.321818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4e97d-75c1-4e2f-86ab-818948cd4167 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:22.333955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:22.434395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e4e97d-75c1-4e2f-86ab-818948cd4167 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:22.468720 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f11e9-05fa-4116-89f7-a841db3c7a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:22.470060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f11e9-05fa-4116-89f7-a841db3c7a2d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:22.470323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f11e9-05fa-4116-89f7-a841db3c7a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:22.470597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7f11e9-05fa-4116-89f7-a841db3c7a2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:22.540778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f11e9-05fa-4116-89f7-a841db3c7a2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:22.542361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7f11e9-05fa-4116-89f7-a841db3c7a2d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:22.552720 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:22.643165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 519/1036] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:51:22 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:51:22.649069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74c93b-1905-4d3d-8f50-665798072e8d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:22.751406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d74c93b-1905-4d3d-8f50-665798072e8d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:22.789567 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110266c-dff4-4678-8007-04b9ed3b793e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:22.790548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110266c-dff4-4678-8007-04b9ed3b793e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:22.791098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110266c-dff4-4678-8007-04b9ed3b793e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:22.791565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110266c-dff4-4678-8007-04b9ed3b793e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:22.802130 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110266c-dff4-4678-8007-04b9ed3b793e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:22.803779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8110266c-dff4-4678-8007-04b9ed3b793e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:22.805785 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-8110266c-dff4-4678-8007-04b9ed3b793e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:22.820185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:22.821196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:22.826912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:22.826912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:22.826912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:22.826912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:22.826912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 518/1037] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:22.827213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f11e9-05fa-4116-89f7-a841db3c7a2d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:22.927359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7f11e9-05fa-4116-89f7-a841db3c7a2d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:22.936607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:22.963539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fadd2-abd0-4842-a1ce-0aeb8521ec0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:22.964278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fadd2-abd0-4842-a1ce-0aeb8521ec0a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:22.964580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fadd2-abd0-4842-a1ce-0aeb8521ec0a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:22.964850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86fadd2-abd0-4842-a1ce-0aeb8521ec0a None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:22.965554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fadd2-abd0-4842-a1ce-0aeb8521ec0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:22.965855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fadd2-abd0-4842-a1ce-0aeb8521ec0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:22.967271 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86fadd2-abd0-4842-a1ce-0aeb8521ec0a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:22.983518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 520/1038] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:22.984752 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110266c-dff4-4678-8007-04b9ed3b793e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:23.092977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110266c-dff4-4678-8007-04b9ed3b793e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:23.132229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34e98eb-b81c-473d-bd37-e1fdc5863e24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:23.132870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e98eb-b81c-473d-bd37-e1fdc5863e24 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:23.133149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e98eb-b81c-473d-bd37-e1fdc5863e24 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:23.133451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34e98eb-b81c-473d-bd37-e1fdc5863e24 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:23.140158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e98eb-b81c-473d-bd37-e1fdc5863e24 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:23.142172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34e98eb-b81c-473d-bd37-e1fdc5863e24 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-e34e98eb-b81c-473d-bd37-e1fdc5863e24 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:51:23.153184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:23.154148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:23.155039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:51:23.155039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:51:23.155039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:51:23.155039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:51:23.155039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:51:23.155039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:51:23.155039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:23.155039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:23.157601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 519/1039] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:51:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:23.160124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fadd2-abd0-4842-a1ce-0aeb8521ec0a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:23.263857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86fadd2-abd0-4842-a1ce-0aeb8521ec0a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:23.305411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c8b00-f0fe-4832-995b-cc383b4049b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:23.306042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c8b00-f0fe-4832-995b-cc383b4049b6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:23.306321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c8b00-f0fe-4832-995b-cc383b4049b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:23.306592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c8b00-f0fe-4832-995b-cc383b4049b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:23.307346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c8b00-f0fe-4832-995b-cc383b4049b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:23.307652 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c8b00-f0fe-4832-995b-cc383b4049b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:23.309084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c8b00-f0fe-4832-995b-cc383b4049b6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:23.319078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d90c-e2d9-47d0-b75c-b19dd74b1312 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:23.319362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d90c-e2d9-47d0-b75c-b19dd74b1312 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:23.319638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a3d90c-e2d9-47d0-b75c-b19dd74b1312 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:23.321107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 520/1040] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:51:23.322381 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 521/1041] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:51:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:23.326099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc18a9-0ef2-4b71-b82d-c1de0269eca8 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:23.326384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc18a9-0ef2-4b71-b82d-c1de0269eca8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:23.326654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc18a9-0ef2-4b71-b82d-c1de0269eca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:23.328005 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c8b00-f0fe-4832-995b-cc383b4049b6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:23.345753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-07dc18a9-0ef2-4b71-b82d-c1de0269eca8 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:23.346973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-07dc18a9-0ef2-4b71-b82d-c1de0269eca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:23.355987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:23.405818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:23.428333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 521/1042] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:23 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:23.436723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c8b00-f0fe-4832-995b-cc383b4049b6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:23.453888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc18a9-0ef2-4b71-b82d-c1de0269eca8 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:23.473502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff96ac-c79c-4b05-8668-2218cf09d3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:23.474789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff96ac-c79c-4b05-8668-2218cf09d3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:23.475280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff96ac-c79c-4b05-8668-2218cf09d3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:23.475666 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff96ac-c79c-4b05-8668-2218cf09d3d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:23.476702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff96ac-c79c-4b05-8668-2218cf09d3d9 None admin] RBAC: Adding query filter params (role.id=56fa13e514a34e459d15f9e505fc072d, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=f85279b6b3474c77be0d8d569feea5f2) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:23.477018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff96ac-c79c-4b05-8668-2218cf09d3d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:23.478450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ff96ac-c79c-4b05-8668-2218cf09d3d9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:23.484341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 522/1043] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:51:23 2022] GET /identity/v3/role_assignments?user.id=f85279b6b3474c77be0d8d569feea5f2&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=56fa13e514a34e459d15f9e505fc072d => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:23.561971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc18a9-0ef2-4b71-b82d-c1de0269eca8 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:23.600224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493653-9b02-4ada-a3b2-a7acdbc29d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:23.601417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493653-9b02-4ada-a3b2-a7acdbc29d9d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:23.601844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493653-9b02-4ada-a3b2-a7acdbc29d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:23.602258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd493653-9b02-4ada-a3b2-a7acdbc29d9d None admin] PATH_INFO: `/v3/services/image` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:23.603037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd493653-9b02-4ada-a3b2-a7acdbc29d9d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:23.604556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd493653-9b02-4ada-a3b2-a7acdbc29d9d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-dd493653-9b02-4ada-a3b2-a7acdbc29d9d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:23.615155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:23.616453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 11:51:23.617550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:23.619825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 522/1044] 10.222.0.42 () {56 vars in 1105 bytes} [Mon Aug 1 11:51:23 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:23.626013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff96ac-c79c-4b05-8668-2218cf09d3d9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:23.721207 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:23.731772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff96ac-c79c-4b05-8668-2218cf09d3d9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:23.766242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d0a23-e374-4157-99a6-4849b8768a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:23.766859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d0a23-e374-4157-99a6-4849b8768a58 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:23.767136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d0a23-e374-4157-99a6-4849b8768a58 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:23.767403 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d0a23-e374-4157-99a6-4849b8768a58 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:23.768073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d0a23-e374-4157-99a6-4849b8768a58 None admin] RBAC: Adding query filter params (name=image) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:23.768371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d0a23-e374-4157-99a6-4849b8768a58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:23.769787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d0a23-e374-4157-99a6-4849b8768a58 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:23.779720 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 523/1045] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:23.782041 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493653-9b02-4ada-a3b2-a7acdbc29d9d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:23.834878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:23.887496 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd493653-9b02-4ada-a3b2-a7acdbc29d9d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:23.921048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f42b5d-c376-439e-9696-ad581a8a3893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:23.921710 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f42b5d-c376-439e-9696-ad581a8a3893 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:23.922593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f42b5d-c376-439e-9696-ad581a8a3893 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:23.922870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f42b5d-c376-439e-9696-ad581a8a3893 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:23.923539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f42b5d-c376-439e-9696-ad581a8a3893 None admin] RBAC: Adding query filter params (type=image) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:23.923834 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f42b5d-c376-439e-9696-ad581a8a3893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:23.925186 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f42b5d-c376-439e-9696-ad581a8a3893 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:23.934574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 523/1046] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:23.936247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d0a23-e374-4157-99a6-4849b8768a58 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:24.041011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d0a23-e374-4157-99a6-4849b8768a58 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:24.073972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380dbe1-7a36-42a6-b95e-80f56f3852cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:24.074659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380dbe1-7a36-42a6-b95e-80f56f3852cc None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:24.075003 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380dbe1-7a36-42a6-b95e-80f56f3852cc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:24.075333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380dbe1-7a36-42a6-b95e-80f56f3852cc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:24.076094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380dbe1-7a36-42a6-b95e-80f56f3852cc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:24.077561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380dbe1-7a36-42a6-b95e-80f56f3852cc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:24.108338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 524/1047] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 11:51:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 11:51:24.207366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21a0c-d88d-4cae-986f-a0dcbd2f5f5f None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:24.207551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21a0c-d88d-4cae-986f-a0dcbd2f5f5f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:24.207821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd21a0c-d88d-4cae-986f-a0dcbd2f5f5f None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:24.209181 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 524/1048] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:24.214707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25669d7-b551-4285-8a59-ad2c206ed270 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:24.214991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25669d7-b551-4285-8a59-ad2c206ed270 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:24.215263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25669d7-b551-4285-8a59-ad2c206ed270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:24.235379 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d25669d7-b551-4285-8a59-ad2c206ed270 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:24.236593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d25669d7-b551-4285-8a59-ad2c206ed270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:24.244940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:24.319501 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 525/1049] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:24.343767 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21a0c-d88d-4cae-986f-a0dcbd2f5f5f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:24.449761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd21a0c-d88d-4cae-986f-a0dcbd2f5f5f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:24.463198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:24.486916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9786af-76fa-413a-abbb-ce951acd2782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:24.487550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9786af-76fa-413a-abbb-ce951acd2782 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:24.487822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9786af-76fa-413a-abbb-ce951acd2782 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:24.488089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9786af-76fa-413a-abbb-ce951acd2782 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:24.489214 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9786af-76fa-413a-abbb-ce951acd2782 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:24.490667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9786af-76fa-413a-abbb-ce951acd2782 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:24.492423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 525/1050] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:24.498350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25669d7-b551-4285-8a59-ad2c206ed270 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:24.598103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25669d7-b551-4285-8a59-ad2c206ed270 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:24.635445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1653e-d85f-43a1-a52e-fcb6b911c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:24.636062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1653e-d85f-43a1-a52e-fcb6b911c743 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:24.636340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1653e-d85f-43a1-a52e-fcb6b911c743 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:24.636610 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1653e-d85f-43a1-a52e-fcb6b911c743 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:24.637285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1653e-d85f-43a1-a52e-fcb6b911c743 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:24.638743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1653e-d85f-43a1-a52e-fcb6b911c743 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:24.649330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:24.669332 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 526/1051] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:51:24 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 11:51:25.518074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4eae5-91ac-464f-b819-ba22cabaf226 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:25.518591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4eae5-91ac-464f-b819-ba22cabaf226 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:25.518591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c4eae5-91ac-464f-b819-ba22cabaf226 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:25.520149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 526/1052] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:25.525062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb05378-2c5f-45d4-97f9-aeb976c3e870 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:25.525484 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb05378-2c5f-45d4-97f9-aeb976c3e870 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:25.525642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb05378-2c5f-45d4-97f9-aeb976c3e870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:25.543362 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-edb05378-2c5f-45d4-97f9-aeb976c3e870 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:25.544537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-edb05378-2c5f-45d4-97f9-aeb976c3e870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:25.609956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 527/1053] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:25.632294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4eae5-91ac-464f-b819-ba22cabaf226 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:25.732516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c4eae5-91ac-464f-b819-ba22cabaf226 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:25.766709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98525b-f403-4d50-b10d-eb6fd82d3da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:25.767350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98525b-f403-4d50-b10d-eb6fd82d3da2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:25.767633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98525b-f403-4d50-b10d-eb6fd82d3da2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:25.767907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98525b-f403-4d50-b10d-eb6fd82d3da2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:25.778029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98525b-f403-4d50-b10d-eb6fd82d3da2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-0b98525b-f403-4d50-b10d-eb6fd82d3da2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:51:25.783579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:25.784800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:25.786075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 527/1054] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Aug 1 11:51:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:25.790716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb05378-2c5f-45d4-97f9-aeb976c3e870 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:25.899145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb05378-2c5f-45d4-97f9-aeb976c3e870 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:25.922460 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:25.934663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5948d-9269-4838-8449-ffe23f8a0cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:25.935285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5948d-9269-4838-8449-ffe23f8a0cbf None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:25.935566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5948d-9269-4838-8449-ffe23f8a0cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:25.935839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc5948d-9269-4838-8449-ffe23f8a0cbf None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:25.936557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5948d-9269-4838-8449-ffe23f8a0cbf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:25.936859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5948d-9269-4838-8449-ffe23f8a0cbf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:25.938797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc5948d-9269-4838-8449-ffe23f8a0cbf None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:25.951350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 528/1055] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Aug 1 11:51:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:25.952558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98525b-f403-4d50-b10d-eb6fd82d3da2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:25.995099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:26.055860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98525b-f403-4d50-b10d-eb6fd82d3da2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:26.090924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d835a642-e9bb-4414-b871-edba36df8003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:26.091557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835a642-e9bb-4414-b871-edba36df8003 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:26.091839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835a642-e9bb-4414-b871-edba36df8003 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:26.092114 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d835a642-e9bb-4414-b871-edba36df8003 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:26.104914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835a642-e9bb-4414-b871-edba36df8003 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:26.106398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d835a642-e9bb-4414-b871-edba36df8003 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d835a642-e9bb-4414-b871-edba36df8003 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:26.122868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:26.123769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:26.124669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:26.124669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:26.124669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:26.124669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:26.124669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 528/1056] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:26.131647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5948d-9269-4838-8449-ffe23f8a0cbf None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:26.156660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35704b-f3fe-479e-9bed-fd6dcad92473 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:26.156910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35704b-f3fe-479e-9bed-fd6dcad92473 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:26.157133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35704b-f3fe-479e-9bed-fd6dcad92473 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:26.158503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 529/1057] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:51:26.163431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2df42e-0c11-4586-bc6d-43ecd4ae3361 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:26.163716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2df42e-0c11-4586-bc6d-43ecd4ae3361 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:26.163990 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2df42e-0c11-4586-bc6d-43ecd4ae3361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:26.182856 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-bc2df42e-0c11-4586-bc6d-43ecd4ae3361 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:26.184031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bc2df42e-0c11-4586-bc6d-43ecd4ae3361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:26.240658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc5948d-9269-4838-8449-ffe23f8a0cbf None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:26.254974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 530/1058] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:26.276562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2df42e-0c11-4586-bc6d-43ecd4ae3361 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:26.278004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c392b75-9e2e-4385-a5f3-a30eb7646647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:26.279016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c392b75-9e2e-4385-a5f3-a30eb7646647 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:26.280262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c392b75-9e2e-4385-a5f3-a30eb7646647 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:26.280864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c392b75-9e2e-4385-a5f3-a30eb7646647 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:26.282370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c392b75-9e2e-4385-a5f3-a30eb7646647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:26.282822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c392b75-9e2e-4385-a5f3-a30eb7646647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:26.284372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c392b75-9e2e-4385-a5f3-a30eb7646647 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:26.300061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 529/1059] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:26.305367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c392b75-9e2e-4385-a5f3-a30eb7646647 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:26.306672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:26.361461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:26.389274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2df42e-0c11-4586-bc6d-43ecd4ae3361 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:26.419247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c392b75-9e2e-4385-a5f3-a30eb7646647 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:26.427419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ac494-4e35-4265-8506-c73a0544477d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:26.428041 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ac494-4e35-4265-8506-c73a0544477d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:26.428319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ac494-4e35-4265-8506-c73a0544477d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:26.428590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587ac494-4e35-4265-8506-c73a0544477d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:26.458960 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13372e6d-ae64-4ac7-b18e-609b833ac6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:26.459902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13372e6d-ae64-4ac7-b18e-609b833ac6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:26.460180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13372e6d-ae64-4ac7-b18e-609b833ac6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:26.460447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13372e6d-ae64-4ac7-b18e-609b833ac6d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:26.467868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13372e6d-ae64-4ac7-b18e-609b833ac6d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:26.469913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13372e6d-ae64-4ac7-b18e-609b833ac6d9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-13372e6d-ae64-4ac7-b18e-609b833ac6d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:51:26.482060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:26.482996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:26.483986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:26.483986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:26.483986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:51:26.483986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:51:26.483986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:51:26.483986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:51:26.483986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:51:26.483986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:51:26.483986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:51:26.483986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:26.483986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 530/1060] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Aug 1 11:51:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:26.488833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13372e6d-ae64-4ac7-b18e-609b833ac6d9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:26.503190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ac494-4e35-4265-8506-c73a0544477d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:26.504637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587ac494-4e35-4265-8506-c73a0544477d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:26.532401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:26.596693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13372e6d-ae64-4ac7-b18e-609b833ac6d9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:26.603793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:26.621463 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 531/1061] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:51:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 11:51:26.626564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ac494-4e35-4265-8506-c73a0544477d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:26.633772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac27b20-67a6-441e-9482-5d9dd5215854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:26.634385 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac27b20-67a6-441e-9482-5d9dd5215854 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:26.634661 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac27b20-67a6-441e-9482-5d9dd5215854 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:26.634927 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac27b20-67a6-441e-9482-5d9dd5215854 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:26.635716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac27b20-67a6-441e-9482-5d9dd5215854 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:26.636078 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac27b20-67a6-441e-9482-5d9dd5215854 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:26.637548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac27b20-67a6-441e-9482-5d9dd5215854 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:26.660238 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 531/1062] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Aug 1 11:51:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:26.661281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac27b20-67a6-441e-9482-5d9dd5215854 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:26.737102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587ac494-4e35-4265-8506-c73a0544477d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:26.763202 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:26.768578 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac27b20-67a6-441e-9482-5d9dd5215854 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:26.775777 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b75dae7-218e-4b67-9a7e-ce8c9d46e6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:26.776421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75dae7-218e-4b67-9a7e-ce8c9d46e6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:26.776698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75dae7-218e-4b67-9a7e-ce8c9d46e6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:26.776969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b75dae7-218e-4b67-9a7e-ce8c9d46e6e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:26.786958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75dae7-218e-4b67-9a7e-ce8c9d46e6e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:26.788400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b75dae7-218e-4b67-9a7e-ce8c9d46e6e9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:26.802707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa2bec-9e24-4ddb-845b-b311c8385a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-5b75dae7-218e-4b67-9a7e-ce8c9d46e6e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:26.803081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:26.804164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:26.805204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:26.805204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:26.805204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:26.805204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:26.805481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa2bec-9e24-4ddb-845b-b311c8385a36 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:26.805481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa2bec-9e24-4ddb-845b-b311c8385a36 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:26.805481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa2bec-9e24-4ddb-845b-b311c8385a36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:26.809372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 532/1063] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:26.810620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dd4cd-524b-4655-9ce4-122919c43657 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:26.810908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dd4cd-524b-4655-9ce4-122919c43657 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:26.811187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2dd4cd-524b-4655-9ce4-122919c43657 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:26.812967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 533/1064] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:26.813718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dd4cd-524b-4655-9ce4-122919c43657 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:26.815110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa2bec-9e24-4ddb-845b-b311c8385a36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:26.816583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa2bec-9e24-4ddb-845b-b311c8385a36 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-50fa2bec-9e24-4ddb-845b-b311c8385a36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:26.832266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:26.833209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:26.834219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:26.834219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:26.834219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:26.834219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:26.834219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 532/1065] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:26.834757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5f47c-2f42-48bb-8d43-84e16896a2fd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:26.835102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5f47c-2f42-48bb-8d43-84e16896a2fd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:26.836619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5f47c-2f42-48bb-8d43-84e16896a2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:26.859574 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e9c5f47c-2f42-48bb-8d43-84e16896a2fd None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:26.860774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e9c5f47c-2f42-48bb-8d43-84e16896a2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:26.871208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:26.915890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2dd4cd-524b-4655-9ce4-122919c43657 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:26.928435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 533/1066] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:26.929265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5f47c-2f42-48bb-8d43-84e16896a2fd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:26.960339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938e944-a048-411f-a96e-4500c4925bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:26.960960 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938e944-a048-411f-a96e-4500c4925bad None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:26.961235 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938e944-a048-411f-a96e-4500c4925bad None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:26.961527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6938e944-a048-411f-a96e-4500c4925bad None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:26.962218 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938e944-a048-411f-a96e-4500c4925bad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:26.962517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938e944-a048-411f-a96e-4500c4925bad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:26.963881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6938e944-a048-411f-a96e-4500c4925bad None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:26.983071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 534/1067] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:26.983071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938e944-a048-411f-a96e-4500c4925bad None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:27.022336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:27.044483 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5f47c-2f42-48bb-8d43-84e16896a2fd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:27.082856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0c58f-99cc-4b7b-811f-6aa6349da888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:27.083902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0c58f-99cc-4b7b-811f-6aa6349da888 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:27.084183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0c58f-99cc-4b7b-811f-6aa6349da888 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:27.084454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d0c58f-99cc-4b7b-811f-6aa6349da888 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:27.085153 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0c58f-99cc-4b7b-811f-6aa6349da888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:27.085490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0c58f-99cc-4b7b-811f-6aa6349da888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:27.086909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d0c58f-99cc-4b7b-811f-6aa6349da888 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:27.104826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 534/1068] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:27.105033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6938e944-a048-411f-a96e-4500c4925bad None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:27.106081 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0c58f-99cc-4b7b-811f-6aa6349da888 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:27.115926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:27.148416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283efdc-d55a-427b-a4d0-d3bd3b32b48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:27.149068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283efdc-d55a-427b-a4d0-d3bd3b32b48c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:27.149456 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283efdc-d55a-427b-a4d0-d3bd3b32b48c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:27.150160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283efdc-d55a-427b-a4d0-d3bd3b32b48c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:27.162288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283efdc-d55a-427b-a4d0-d3bd3b32b48c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-8283efdc-d55a-427b-a4d0-d3bd3b32b48c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:51:27.169286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:27.170277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:27.171270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 535/1069] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:51:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:27.177043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283efdc-d55a-427b-a4d0-d3bd3b32b48c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:27.221812 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d0c58f-99cc-4b7b-811f-6aa6349da888 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:27.257894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f56ce2-7da6-4ce8-9f87-9fceff6c9b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:27.258839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f56ce2-7da6-4ce8-9f87-9fceff6c9b79 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:27.259288 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f56ce2-7da6-4ce8-9f87-9fceff6c9b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:27.259568 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f56ce2-7da6-4ce8-9f87-9fceff6c9b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:27.266978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f56ce2-7da6-4ce8-9f87-9fceff6c9b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:27.268445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f56ce2-7da6-4ce8-9f87-9fceff6c9b79 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c1f56ce2-7da6-4ce8-9f87-9fceff6c9b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:51:27.279915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:27.280844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:27.282333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:51:27.282333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:51:27.282333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:51:27.282333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:51:27.282333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:51:27.282333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:51:27.282333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:27.282333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:27.282333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 535/1070] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:51:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:27.287310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f56ce2-7da6-4ce8-9f87-9fceff6c9b79 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:27.288559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:27.297142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283efdc-d55a-427b-a4d0-d3bd3b32b48c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:27.330973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7d033-dfc0-4e81-871c-79c713ae2b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:27.331584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7d033-dfc0-4e81-871c-79c713ae2b14 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:27.331866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7d033-dfc0-4e81-871c-79c713ae2b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:27.332140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c7d033-dfc0-4e81-871c-79c713ae2b14 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:27.332859 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7d033-dfc0-4e81-871c-79c713ae2b14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:27.333162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7d033-dfc0-4e81-871c-79c713ae2b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:27.334564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c7d033-dfc0-4e81-871c-79c713ae2b14 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:27.342961 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 536/1071] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:51:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:27.349162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7d033-dfc0-4e81-871c-79c713ae2b14 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:27.352418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:27.388105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f56ce2-7da6-4ce8-9f87-9fceff6c9b79 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:27.421525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca9575-eae5-41db-a13c-3395daf8501f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:27.422162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca9575-eae5-41db-a13c-3395daf8501f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:27.422451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca9575-eae5-41db-a13c-3395daf8501f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:27.422729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca9575-eae5-41db-a13c-3395daf8501f None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:27.423480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca9575-eae5-41db-a13c-3395daf8501f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:27.423791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca9575-eae5-41db-a13c-3395daf8501f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:27.425230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca9575-eae5-41db-a13c-3395daf8501f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:27.436882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 536/1072] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:51:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:27.443276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca9575-eae5-41db-a13c-3395daf8501f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:27.444176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c7d033-dfc0-4e81-871c-79c713ae2b14 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:27.478116 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4908f-0ab6-4023-9acc-502ba0a4b789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:27.478796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4908f-0ab6-4023-9acc-502ba0a4b789 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:27.479076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4908f-0ab6-4023-9acc-502ba0a4b789 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:27.479344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e4908f-0ab6-4023-9acc-502ba0a4b789 None admin] PATH_INFO: `/v3/users/d3a60d5abf224f1788d501dd09af03cf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:27.492068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4908f-0ab6-4023-9acc-502ba0a4b789 None admin] RBAC: Authorizing `identity:get_user(user_id=d3a60d5abf224f1788d501dd09af03cf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:27.493530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e4908f-0ab6-4023-9acc-502ba0a4b789 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:27.495146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 537/1073] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:51:27 2022] GET /identity/v3/users/d3a60d5abf224f1788d501dd09af03cf => generated 285 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:27.501253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4908f-0ab6-4023-9acc-502ba0a4b789 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:27.515520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:27.543977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca9575-eae5-41db-a13c-3395daf8501f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:27.569116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:27.578788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81373846-870f-4c33-93f1-fa2409831d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:27.579450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81373846-870f-4c33-93f1-fa2409831d79 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:27.579729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81373846-870f-4c33-93f1-fa2409831d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:27.580000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81373846-870f-4c33-93f1-fa2409831d79 None admin] PATH_INFO: `/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/f85279b6b3474c77be0d8d569feea5f2/roles/56fa13e514a34e459d15f9e505fc072d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:27.582596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81373846-870f-4c33-93f1-fa2409831d79 None admin] RBAC: Authorizing `identity:create_grant(project_id=99857fcf20fd4cb8b7def2bc2de521bc, user_id=f85279b6b3474c77be0d8d569feea5f2, role_id=56fa13e514a34e459d15f9e505fc072d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:27.584044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81373846-870f-4c33-93f1-fa2409831d79 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:27.596482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 537/1074] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:51:27 2022] PUT /identity/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/f85279b6b3474c77be0d8d569feea5f2/roles/56fa13e514a34e459d15f9e505fc072d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 11:51:27.599319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e4908f-0ab6-4023-9acc-502ba0a4b789 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:27.637344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acecc4-92b1-4093-aeb9-041f58fa5cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:27.637963 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acecc4-92b1-4093-aeb9-041f58fa5cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:27.638255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acecc4-92b1-4093-aeb9-041f58fa5cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:27.638505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28acecc4-92b1-4093-aeb9-041f58fa5cd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:27.711665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acecc4-92b1-4093-aeb9-041f58fa5cd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:27.713121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28acecc4-92b1-4093-aeb9-041f58fa5cd0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:27.728574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:27.817121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 538/1075] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:51:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 11:51:27.823108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81373846-870f-4c33-93f1-fa2409831d79 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:27.921520 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81373846-870f-4c33-93f1-fa2409831d79 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:27.955206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c10702c-b0bf-417c-add2-55b326ad8a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:27.955832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10702c-b0bf-417c-add2-55b326ad8a51 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:27.956105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10702c-b0bf-417c-add2-55b326ad8a51 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:27.956372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c10702c-b0bf-417c-add2-55b326ad8a51 None admin] PATH_INFO: `/v3/projects/a72dc770239240df858e7955129b5330` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:27.957534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10702c-b0bf-417c-add2-55b326ad8a51 None admin] RBAC: Authorizing `identity:get_project(project_id=a72dc770239240df858e7955129b5330)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:27.958971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c10702c-b0bf-417c-add2-55b326ad8a51 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:27.960710 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 538/1076] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:51:27 2022] GET /identity/v3/projects/a72dc770239240df858e7955129b5330 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:27.967343 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acecc4-92b1-4093-aeb9-041f58fa5cd0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:28.064650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28acecc4-92b1-4093-aeb9-041f58fa5cd0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:28.078429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:28.098793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ffdd9-28fb-4a34-91e3-ab01df1386d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:28.099460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ffdd9-28fb-4a34-91e3-ab01df1386d8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:28.099767 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ffdd9-28fb-4a34-91e3-ab01df1386d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:28.100076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ffdd9-28fb-4a34-91e3-ab01df1386d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:28.100882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ffdd9-28fb-4a34-91e3-ab01df1386d8 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=a72dc770239240df858e7955129b5330, user.id=d3a60d5abf224f1788d501dd09af03cf) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:28.101478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ffdd9-28fb-4a34-91e3-ab01df1386d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:28.102897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ffdd9-28fb-4a34-91e3-ab01df1386d8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:28.108228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 539/1077] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:51:27 2022] GET /identity/v3/role_assignments?user.id=d3a60d5abf224f1788d501dd09af03cf&scope.project.id=a72dc770239240df858e7955129b5330&role.id=0195bf688a7e464e8ff594afe80b050e => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:29.564638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a3408-c624-4d86-acf9-a8134b504888 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:29.565180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a3408-c624-4d86-acf9-a8134b504888 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:29.565180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248a3408-c624-4d86-acf9-a8134b504888 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:29.566456 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 539/1078] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:29.571529 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c3d6a-32d1-46f8-9666-52251066ba70 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:29.571929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c3d6a-32d1-46f8-9666-52251066ba70 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:29.572138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51c3d6a-32d1-46f8-9666-52251066ba70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:29.590574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d51c3d6a-32d1-46f8-9666-52251066ba70 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:29.591762 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d51c3d6a-32d1-46f8-9666-52251066ba70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:29.657282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 540/1079] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:29.680003 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a3408-c624-4d86-acf9-a8134b504888 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:29.740665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:29.789888 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248a3408-c624-4d86-acf9-a8134b504888 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:29.823264 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904733c4-e05f-42d3-9149-6296aa1733f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:29.823824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904733c4-e05f-42d3-9149-6296aa1733f5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:29.824101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904733c4-e05f-42d3-9149-6296aa1733f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:29.824369 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904733c4-e05f-42d3-9149-6296aa1733f5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:29.834175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904733c4-e05f-42d3-9149-6296aa1733f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-904733c4-e05f-42d3-9149-6296aa1733f5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:51:29.839036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:29.840024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:29.840919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 540/1080] 10.222.0.42 () {56 vars in 1120 bytes} [Mon Aug 1 11:51:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:29.846752 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c3d6a-32d1-46f8-9666-52251066ba70 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:29.944423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51c3d6a-32d1-46f8-9666-52251066ba70 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:29.953468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:29.979243 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9631795-7192-4fcd-9483-dc4e65d26c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:29.979861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9631795-7192-4fcd-9483-dc4e65d26c63 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:29.980140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9631795-7192-4fcd-9483-dc4e65d26c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:29.980412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9631795-7192-4fcd-9483-dc4e65d26c63 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:29.981118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9631795-7192-4fcd-9483-dc4e65d26c63 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:29.981455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9631795-7192-4fcd-9483-dc4e65d26c63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:29.982825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9631795-7192-4fcd-9483-dc4e65d26c63 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:29.991217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 541/1081] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Aug 1 11:51:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:29.997020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904733c4-e05f-42d3-9149-6296aa1733f5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:30.098672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904733c4-e05f-42d3-9149-6296aa1733f5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:30.102389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e93a8-a70a-4501-aa4a-22b3503d8650 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:30.102675 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e93a8-a70a-4501-aa4a-22b3503d8650 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:30.102954 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e93a8-a70a-4501-aa4a-22b3503d8650 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:30.104316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 542/1082] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:51:30.109425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700730-843a-4655-8455-ea429d58b345 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:30.109775 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700730-843a-4655-8455-ea429d58b345 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:30.110111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce700730-843a-4655-8455-ea429d58b345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:30.115219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:30.128414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ce700730-843a-4655-8455-ea429d58b345 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:30.129648 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ce700730-843a-4655-8455-ea429d58b345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:30.135504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d2a1e-f713-431a-81d0-9544076056aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:30.136142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d2a1e-f713-431a-81d0-9544076056aa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:30.136418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d2a1e-f713-431a-81d0-9544076056aa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:30.136690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d2a1e-f713-431a-81d0-9544076056aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:30.148329 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d2a1e-f713-431a-81d0-9544076056aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:30.149822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d2a1e-f713-431a-81d0-9544076056aa None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-137d2a1e-f713-431a-81d0-9544076056aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:30.165224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:30.166219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:30.167198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:30.167198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:30.167198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:30.167198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:30.167198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 541/1083] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:30.172027 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d2a1e-f713-431a-81d0-9544076056aa None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:30.203481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 543/1084] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 11:51:30.226508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700730-843a-4655-8455-ea429d58b345 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:30.272676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d2a1e-f713-431a-81d0-9544076056aa None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:30.306274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e30e6-170c-4ad3-ae75-5426b3e3c0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:30.306946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e30e6-170c-4ad3-ae75-5426b3e3c0de None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:30.307233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e30e6-170c-4ad3-ae75-5426b3e3c0de None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:30.307513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5e30e6-170c-4ad3-ae75-5426b3e3c0de None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:30.308211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e30e6-170c-4ad3-ae75-5426b3e3c0de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:30.308541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e30e6-170c-4ad3-ae75-5426b3e3c0de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:30.309956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5e30e6-170c-4ad3-ae75-5426b3e3c0de None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:30.321597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 542/1085] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:30.327176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e30e6-170c-4ad3-ae75-5426b3e3c0de None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:30.329468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:30.332397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce700730-843a-4655-8455-ea429d58b345 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:30.355935 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:30.368049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f651e3-12c7-439b-a2d5-988f2d3c965c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:30.368687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f651e3-12c7-439b-a2d5-988f2d3c965c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:30.368970 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f651e3-12c7-439b-a2d5-988f2d3c965c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:30.369250 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f651e3-12c7-439b-a2d5-988f2d3c965c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:30.379720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f651e3-12c7-439b-a2d5-988f2d3c965c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-a2f651e3-12c7-439b-a2d5-988f2d3c965c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:51:30.384624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:30.385629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:30.386499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 544/1086] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:51:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:30.392438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f651e3-12c7-439b-a2d5-988f2d3c965c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:30.440257 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5e30e6-170c-4ad3-ae75-5426b3e3c0de None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:30.474518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2d1bf-5733-4c3a-b915-fadbeb2fd738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:30.475187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2d1bf-5733-4c3a-b915-fadbeb2fd738 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:30.475464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2d1bf-5733-4c3a-b915-fadbeb2fd738 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:30.475737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a2d1bf-5733-4c3a-b915-fadbeb2fd738 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:30.482896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2d1bf-5733-4c3a-b915-fadbeb2fd738 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:30.484384 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a2d1bf-5733-4c3a-b915-fadbeb2fd738 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-27a2d1bf-5733-4c3a-b915-fadbeb2fd738 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:51:30.495811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:30.496945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:30.497957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:30.497957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:30.497957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:51:30.497957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:51:30.497957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:51:30.497957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:51:30.497957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:51:30.497957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:51:30.497957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 11:51:30.497957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:30.497957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 543/1087] 10.222.0.42 () {56 vars in 1093 bytes} [Mon Aug 1 11:51:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:30.498566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f651e3-12c7-439b-a2d5-988f2d3c965c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:30.503111 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2d1bf-5733-4c3a-b915-fadbeb2fd738 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:30.532696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b37fd-6983-497b-8918-b71d4b4eeaa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:30.533314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b37fd-6983-497b-8918-b71d4b4eeaa8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:30.533614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b37fd-6983-497b-8918-b71d4b4eeaa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:30.533885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b37fd-6983-497b-8918-b71d4b4eeaa8 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:30.534593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b37fd-6983-497b-8918-b71d4b4eeaa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:30.534888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b37fd-6983-497b-8918-b71d4b4eeaa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:30.536260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618b37fd-6983-497b-8918-b71d4b4eeaa8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:30.544717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 545/1088] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:51:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:30.551226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b37fd-6983-497b-8918-b71d4b4eeaa8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:30.574679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:30.587183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:30.602524 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a2d1bf-5733-4c3a-b915-fadbeb2fd738 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:30.636922 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7b0dc-06ec-4523-af11-bbe7dd242577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:30.637504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b0dc-06ec-4523-af11-bbe7dd242577 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:30.637790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b0dc-06ec-4523-af11-bbe7dd242577 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:30.638070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b0dc-06ec-4523-af11-bbe7dd242577 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:30.638858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7b0dc-06ec-4523-af11-bbe7dd242577 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:30.639168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7b0dc-06ec-4523-af11-bbe7dd242577 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:30.641140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7b0dc-06ec-4523-af11-bbe7dd242577 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:30.650730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b37fd-6983-497b-8918-b71d4b4eeaa8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:30.657825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 544/1089] 10.222.0.42 () {56 vars in 1133 bytes} [Mon Aug 1 11:51:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:30.663457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7b0dc-06ec-4523-af11-bbe7dd242577 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:30.683928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86441c-d730-4c41-88eb-de702d187a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:30.684555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86441c-d730-4c41-88eb-de702d187a49 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:30.684832 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86441c-d730-4c41-88eb-de702d187a49 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:30.685098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86441c-d730-4c41-88eb-de702d187a49 None admin] PATH_INFO: `/v3/users/d3a60d5abf224f1788d501dd09af03cf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:30.686274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86441c-d730-4c41-88eb-de702d187a49 None admin] RBAC: Authorizing `identity:get_user(user_id=d3a60d5abf224f1788d501dd09af03cf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:30.688211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac86441c-d730-4c41-88eb-de702d187a49 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:30.689824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 546/1090] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:51:30 2022] GET /identity/v3/users/d3a60d5abf224f1788d501dd09af03cf => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:30.695407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86441c-d730-4c41-88eb-de702d187a49 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:30.761870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7b0dc-06ec-4523-af11-bbe7dd242577 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:30.782917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:30.792625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac86441c-d730-4c41-88eb-de702d187a49 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:30.794812 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad22d8-06db-4650-a452-e397a8e2865f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:30.795421 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad22d8-06db-4650-a452-e397a8e2865f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:30.795695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad22d8-06db-4650-a452-e397a8e2865f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:30.795961 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad22d8-06db-4650-a452-e397a8e2865f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:30.810370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:30.828554 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a988090-77b0-487c-baa0-5ab344262983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:30.829308 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988090-77b0-487c-baa0-5ab344262983 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:30.829686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988090-77b0-487c-baa0-5ab344262983 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:30.830029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a988090-77b0-487c-baa0-5ab344262983 None admin] PATH_INFO: `/v3/projects/a72dc770239240df858e7955129b5330` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:30.831201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a988090-77b0-487c-baa0-5ab344262983 None admin] RBAC: Authorizing `identity:get_project(project_id=a72dc770239240df858e7955129b5330)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:30.832628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a988090-77b0-487c-baa0-5ab344262983 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:30.834340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 547/1091] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:51:30 2022] GET /identity/v3/projects/a72dc770239240df858e7955129b5330 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:51:30.840300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a988090-77b0-487c-baa0-5ab344262983 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:30.864258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad22d8-06db-4650-a452-e397a8e2865f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:30.865763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ad22d8-06db-4650-a452-e397a8e2865f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:30.937059 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a988090-77b0-487c-baa0-5ab344262983 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:30.966119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 545/1092] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:51:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 11:51:30.967400 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad22d8-06db-4650-a452-e397a8e2865f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:30.970631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d7b19-b71c-4036-82d7-f4d857067981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:30.971292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d7b19-b71c-4036-82d7-f4d857067981 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:30.971566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d7b19-b71c-4036-82d7-f4d857067981 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:30.971833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822d7b19-b71c-4036-82d7-f4d857067981 None admin] PATH_INFO: `/v3/projects/a72dc770239240df858e7955129b5330/users/d3a60d5abf224f1788d501dd09af03cf/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:30.973783 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d7b19-b71c-4036-82d7-f4d857067981 None admin] RBAC: Authorizing `identity:create_grant(project_id=a72dc770239240df858e7955129b5330, user_id=d3a60d5abf224f1788d501dd09af03cf, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:30.975226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822d7b19-b71c-4036-82d7-f4d857067981 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:30.989490 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 548/1093] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:51:30 2022] PUT /identity/v3/projects/a72dc770239240df858e7955129b5330/users/d3a60d5abf224f1788d501dd09af03cf/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 11:51:31.022873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:31.080611 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ad22d8-06db-4650-a452-e397a8e2865f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:31.117019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0bcc5-649e-4d97-83b1-2939c9fca3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:31.117699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0bcc5-649e-4d97-83b1-2939c9fca3ba None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:31.117977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0bcc5-649e-4d97-83b1-2939c9fca3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:31.118246 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df0bcc5-649e-4d97-83b1-2939c9fca3ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:31.129368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0bcc5-649e-4d97-83b1-2939c9fca3ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:31.130944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df0bcc5-649e-4d97-83b1-2939c9fca3ba None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0df0bcc5-649e-4d97-83b1-2939c9fca3ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:51:31.148918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:31.149988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:31.151230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:51:31.151230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:51:31.151230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:51:31.151230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:31.151230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 546/1094] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:51:31.156631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d7b19-b71c-4036-82d7-f4d857067981 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:31.176279 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:31.255970 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822d7b19-b71c-4036-82d7-f4d857067981 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:31.292120 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5751228-62bc-4f44-9126-55bfa885a3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:31.292825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751228-62bc-4f44-9126-55bfa885a3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:31.293112 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751228-62bc-4f44-9126-55bfa885a3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:31.293480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751228-62bc-4f44-9126-55bfa885a3f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:31.294178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5751228-62bc-4f44-9126-55bfa885a3f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:31.294482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5751228-62bc-4f44-9126-55bfa885a3f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:31.295853 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5751228-62bc-4f44-9126-55bfa885a3f8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:31.308022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 549/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:51:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:31.313637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0bcc5-649e-4d97-83b1-2939c9fca3ba None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:31.404695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:31.411382 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df0bcc5-649e-4d97-83b1-2939c9fca3ba None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:31.445517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b01a8-e6bd-4083-959b-1ccd7c122be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:31.446171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b01a8-e6bd-4083-959b-1ccd7c122be7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:31.446433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b01a8-e6bd-4083-959b-1ccd7c122be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:31.446703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1b01a8-e6bd-4083-959b-1ccd7c122be7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:31.453197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b01a8-e6bd-4083-959b-1ccd7c122be7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:31.454666 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1b01a8-e6bd-4083-959b-1ccd7c122be7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-5c1b01a8-e6bd-4083-959b-1ccd7c122be7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:51:31.465777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:31.466834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:31.468151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:51:31.468151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:51:31.468151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:51:31.468151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:51:31.468151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:51:31.468151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:51:31.468151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:51:31.468151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:31.468151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 547/1096] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:51:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:31.473188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5751228-62bc-4f44-9126-55bfa885a3f8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:31.551157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:31.572446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5751228-62bc-4f44-9126-55bfa885a3f8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:31.605566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88ca6e-435b-4210-8096-d05ab5060cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:31.606190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88ca6e-435b-4210-8096-d05ab5060cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:31.606440 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88ca6e-435b-4210-8096-d05ab5060cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:31.606710 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88ca6e-435b-4210-8096-d05ab5060cc1 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:31.607451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88ca6e-435b-4210-8096-d05ab5060cc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:31.607814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88ca6e-435b-4210-8096-d05ab5060cc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:31.609280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88ca6e-435b-4210-8096-d05ab5060cc1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:31.620843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 550/1097] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:51:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:31.627270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b01a8-e6bd-4083-959b-1ccd7c122be7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:31.724728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1b01a8-e6bd-4083-959b-1ccd7c122be7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:31.756857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a940d3dd-4b4a-4457-8f8b-30aa33b7a53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:31.757486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940d3dd-4b4a-4457-8f8b-30aa33b7a53c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:31.757768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940d3dd-4b4a-4457-8f8b-30aa33b7a53c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:31.758044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a940d3dd-4b4a-4457-8f8b-30aa33b7a53c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:31.758819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940d3dd-4b4a-4457-8f8b-30aa33b7a53c None admin] RBAC: Adding query filter params (role.id=56fa13e514a34e459d15f9e505fc072d, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=f85279b6b3474c77be0d8d569feea5f2) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:31.759125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940d3dd-4b4a-4457-8f8b-30aa33b7a53c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:31.760543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a940d3dd-4b4a-4457-8f8b-30aa33b7a53c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:31.766681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 548/1098] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:51:31 2022] GET /identity/v3/role_assignments?user.id=f85279b6b3474c77be0d8d569feea5f2&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=56fa13e514a34e459d15f9e505fc072d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:32.974937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772e3d-fca5-490d-a304-1feee23e4a90 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:32.975466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772e3d-fca5-490d-a304-1feee23e4a90 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:32.975466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b772e3d-fca5-490d-a304-1feee23e4a90 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:32.977062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 551/1099] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:32.982180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154b93-fb00-477b-8f16-bd2bf04bf256 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:32.982613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154b93-fb00-477b-8f16-bd2bf04bf256 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:32.982741 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09154b93-fb00-477b-8f16-bd2bf04bf256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:33.001578 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-09154b93-fb00-477b-8f16-bd2bf04bf256 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:33.002756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-09154b93-fb00-477b-8f16-bd2bf04bf256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:33.016333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:33.068412 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 549/1100] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:33.090322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b772e3d-fca5-490d-a304-1feee23e4a90 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:33.188989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b772e3d-fca5-490d-a304-1feee23e4a90 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:33.221494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f34d66-f793-4a2a-9d88-5456ea852fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:33.222126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f34d66-f793-4a2a-9d88-5456ea852fd1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:33.222407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f34d66-f793-4a2a-9d88-5456ea852fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:33.222678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f34d66-f793-4a2a-9d88-5456ea852fd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:33.229568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:33.233543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f34d66-f793-4a2a-9d88-5456ea852fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-98f34d66-f793-4a2a-9d88-5456ea852fd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:51:33.239124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:33.240237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:33.246107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 552/1101] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:51:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:33.246994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154b93-fb00-477b-8f16-bd2bf04bf256 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:33.344397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09154b93-fb00-477b-8f16-bd2bf04bf256 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:33.377618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d5985-057a-4894-a28e-0363ee3a7d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:33.378227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d5985-057a-4894-a28e-0363ee3a7d09 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:33.378508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d5985-057a-4894-a28e-0363ee3a7d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:33.378779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d5985-057a-4894-a28e-0363ee3a7d09 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:33.379489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d5985-057a-4894-a28e-0363ee3a7d09 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:33.379790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d5985-057a-4894-a28e-0363ee3a7d09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:33.381158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d5985-057a-4894-a28e-0363ee3a7d09 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:33.388953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 550/1102] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:51:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:33.394742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f34d66-f793-4a2a-9d88-5456ea852fd1 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:33.496450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f34d66-f793-4a2a-9d88-5456ea852fd1 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:33.529125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba72bdc-551a-4d1b-b37f-f955c18d5998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:33.529781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba72bdc-551a-4d1b-b37f-f955c18d5998 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:33.530064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba72bdc-551a-4d1b-b37f-f955c18d5998 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:33.530341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba72bdc-551a-4d1b-b37f-f955c18d5998 None admin] PATH_INFO: `/v3/users/d3a60d5abf224f1788d501dd09af03cf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:33.532063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba72bdc-551a-4d1b-b37f-f955c18d5998 None admin] RBAC: Authorizing `identity:get_user(user_id=d3a60d5abf224f1788d501dd09af03cf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:33.533523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba72bdc-551a-4d1b-b37f-f955c18d5998 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:33.535111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 553/1103] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:51:33 2022] GET /identity/v3/users/d3a60d5abf224f1788d501dd09af03cf => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:33.540826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d5985-057a-4894-a28e-0363ee3a7d09 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:33.556235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:33.637959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d5985-057a-4894-a28e-0363ee3a7d09 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:33.670173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5bf3b-74e7-41d3-9402-6a53ffb4214e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:33.670771 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5bf3b-74e7-41d3-9402-6a53ffb4214e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:33.671046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5bf3b-74e7-41d3-9402-6a53ffb4214e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:33.671311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5bf3b-74e7-41d3-9402-6a53ffb4214e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:33.736688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5bf3b-74e7-41d3-9402-6a53ffb4214e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:33.738154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f5bf3b-74e7-41d3-9402-6a53ffb4214e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:33.750773 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:33.831579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 551/1104] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:51:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:51:33.837310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba72bdc-551a-4d1b-b37f-f955c18d5998 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:33.900170 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:33.933851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba72bdc-551a-4d1b-b37f-f955c18d5998 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:33.966649 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f64392-d8b5-4f18-b8a5-6e51e565dcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:33.967271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f64392-d8b5-4f18-b8a5-6e51e565dcb1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:33.967550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f64392-d8b5-4f18-b8a5-6e51e565dcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:33.967822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f64392-d8b5-4f18-b8a5-6e51e565dcb1 None admin] PATH_INFO: `/v3/projects/a72dc770239240df858e7955129b5330` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:33.969590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f64392-d8b5-4f18-b8a5-6e51e565dcb1 None admin] RBAC: Authorizing `identity:get_project(project_id=a72dc770239240df858e7955129b5330)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:33.971007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f64392-d8b5-4f18-b8a5-6e51e565dcb1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:33.972656 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 554/1105] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:51:33 2022] GET /identity/v3/projects/a72dc770239240df858e7955129b5330 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:33.978838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5bf3b-74e7-41d3-9402-6a53ffb4214e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:34.072358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5bf3b-74e7-41d3-9402-6a53ffb4214e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:34.085254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:34.106588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1987edb-7dd2-475b-9cdf-7b76947153c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:34.107178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1987edb-7dd2-475b-9cdf-7b76947153c2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:34.107452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1987edb-7dd2-475b-9cdf-7b76947153c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:34.107718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1987edb-7dd2-475b-9cdf-7b76947153c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:34.108480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1987edb-7dd2-475b-9cdf-7b76947153c2 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=a72dc770239240df858e7955129b5330, user.id=d3a60d5abf224f1788d501dd09af03cf) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:34.108779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1987edb-7dd2-475b-9cdf-7b76947153c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:34.110310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1987edb-7dd2-475b-9cdf-7b76947153c2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:34.115839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 552/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:51:33 2022] GET /identity/v3/role_assignments?user.id=d3a60d5abf224f1788d501dd09af03cf&scope.project.id=a72dc770239240df858e7955129b5330&role.id=0195bf688a7e464e8ff594afe80b050e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:36.128844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff05b1-4fd3-4b39-bf29-4ec788752192 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:36.129396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff05b1-4fd3-4b39-bf29-4ec788752192 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:36.129396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff05b1-4fd3-4b39-bf29-4ec788752192 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:36.130918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 555/1107] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:36.136071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1b364-9769-41d9-95a5-3434d5d6bce5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:36.136497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1b364-9769-41d9-95a5-3434d5d6bce5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:36.136625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b1b364-9769-41d9-95a5-3434d5d6bce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:36.154908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-73b1b364-9769-41d9-95a5-3434d5d6bce5 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:36.156716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-73b1b364-9769-41d9-95a5-3434d5d6bce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:36.225649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 553/1108] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:36.249818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff05b1-4fd3-4b39-bf29-4ec788752192 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:36.350430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff05b1-4fd3-4b39-bf29-4ec788752192 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:36.382926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223a0232-0eff-48e2-b58e-ddc6cebefa70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:36.383491 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0232-0eff-48e2-b58e-ddc6cebefa70 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:36.383765 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0232-0eff-48e2-b58e-ddc6cebefa70 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:36.384032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223a0232-0eff-48e2-b58e-ddc6cebefa70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:36.385164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a0232-0eff-48e2-b58e-ddc6cebefa70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:36.386636 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223a0232-0eff-48e2-b58e-ddc6cebefa70 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:36.388208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 556/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:36.394468 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1b364-9769-41d9-95a5-3434d5d6bce5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:36.494858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b1b364-9769-41d9-95a5-3434d5d6bce5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:36.502454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:36.529286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d7b6c9-203c-4215-960c-f480085761db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:36.529917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7b6c9-203c-4215-960c-f480085761db None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:36.530198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7b6c9-203c-4215-960c-f480085761db None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:36.530473 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d7b6c9-203c-4215-960c-f480085761db None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:36.531195 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7b6c9-203c-4215-960c-f480085761db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:36.532633 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d7b6c9-203c-4215-960c-f480085761db None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:36.554606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 554/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:51:36 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:51:38.577073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4495d29-aa1f-4ffd-ba64-0764ad461ed5 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:38.578187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4495d29-aa1f-4ffd-ba64-0764ad461ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:38.578187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4495d29-aa1f-4ffd-ba64-0764ad461ed5 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:38.579403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 557/1111] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:38.584794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8e818-7ea6-496a-8ba8-0f224a7617b0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:38.585236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8e818-7ea6-496a-8ba8-0f224a7617b0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:38.585373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8e818-7ea6-496a-8ba8-0f224a7617b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:38.607758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ceb8e818-7ea6-496a-8ba8-0f224a7617b0 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:38.609543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ceb8e818-7ea6-496a-8ba8-0f224a7617b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:38.680157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 555/1112] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:38.703842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4495d29-aa1f-4ffd-ba64-0764ad461ed5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:38.706836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:38.802803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4495d29-aa1f-4ffd-ba64-0764ad461ed5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:38.835851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403a818-1673-47ec-b48c-4de2ccad778b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:38.836416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403a818-1673-47ec-b48c-4de2ccad778b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:38.836694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403a818-1673-47ec-b48c-4de2ccad778b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:38.836965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403a818-1673-47ec-b48c-4de2ccad778b None admin] PATH_INFO: `/v3/roles/d0262ce715f7448babe9cef93dc25e9d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:38.838434 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403a818-1673-47ec-b48c-4de2ccad778b None admin] RBAC: Authorizing `identity:get_role(role_id=d0262ce715f7448babe9cef93dc25e9d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:38.839797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403a818-1673-47ec-b48c-4de2ccad778b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:38.841101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 558/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:51:38 2022] GET /identity/v3/roles/d0262ce715f7448babe9cef93dc25e9d => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:38.846839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8e818-7ea6-496a-8ba8-0f224a7617b0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:38.947630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:38.957820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8e818-7ea6-496a-8ba8-0f224a7617b0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:38.994452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ba9fe-2ddf-49f1-86ad-0b80db32a942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:38.995087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ba9fe-2ddf-49f1-86ad-0b80db32a942 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:38.995361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ba9fe-2ddf-49f1-86ad-0b80db32a942 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:38.995629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6ba9fe-2ddf-49f1-86ad-0b80db32a942 None admin] PATH_INFO: `/v3/users/11dd8e5ff4964167bf21a3db3e4fe8d7` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:39.008693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ba9fe-2ddf-49f1-86ad-0b80db32a942 None admin] RBAC: Authorizing `identity:get_user(user_id=11dd8e5ff4964167bf21a3db3e4fe8d7)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:39.010161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6ba9fe-2ddf-49f1-86ad-0b80db32a942 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:39.011741 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 556/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:51:38 2022] GET /identity/v3/users/11dd8e5ff4964167bf21a3db3e4fe8d7 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:39.017716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403a818-1673-47ec-b48c-4de2ccad778b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:39.084818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:39.115976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403a818-1673-47ec-b48c-4de2ccad778b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:39.148464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe069bbe-65cf-47c4-b6b4-f9ae5567b64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:39.149064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe069bbe-65cf-47c4-b6b4-f9ae5567b64e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:39.149374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe069bbe-65cf-47c4-b6b4-f9ae5567b64e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:39.149648 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe069bbe-65cf-47c4-b6b4-f9ae5567b64e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:39.213508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe069bbe-65cf-47c4-b6b4-f9ae5567b64e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:39.214938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe069bbe-65cf-47c4-b6b4-f9ae5567b64e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:39.284912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:39.317860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 559/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:51:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:51:39.323647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ba9fe-2ddf-49f1-86ad-0b80db32a942 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:39.418663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6ba9fe-2ddf-49f1-86ad-0b80db32a942 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:39.451330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829bea00-cec1-4b6b-8c45-74199dafcf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:39.451955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bea00-cec1-4b6b-8c45-74199dafcf00 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:39.452235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bea00-cec1-4b6b-8c45-74199dafcf00 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:39.452507 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829bea00-cec1-4b6b-8c45-74199dafcf00 None admin] PATH_INFO: `/v3/projects/a72dc770239240df858e7955129b5330` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:39.453696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bea00-cec1-4b6b-8c45-74199dafcf00 None admin] RBAC: Authorizing `identity:get_project(project_id=a72dc770239240df858e7955129b5330)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:39.455137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829bea00-cec1-4b6b-8c45-74199dafcf00 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:39.456762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 557/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:51:39 2022] GET /identity/v3/projects/a72dc770239240df858e7955129b5330 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:39.462657 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe069bbe-65cf-47c4-b6b4-f9ae5567b64e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:39.558436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe069bbe-65cf-47c4-b6b4-f9ae5567b64e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:39.602203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51ddc45-cbed-4c99-b727-7c7036b77136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:39.603032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ddc45-cbed-4c99-b727-7c7036b77136 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:39.603274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ddc45-cbed-4c99-b727-7c7036b77136 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:39.603616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51ddc45-cbed-4c99-b727-7c7036b77136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:39.604431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ddc45-cbed-4c99-b727-7c7036b77136 None admin] RBAC: Adding query filter params (role.id=d0262ce715f7448babe9cef93dc25e9d, scope.project.id=a72dc770239240df858e7955129b5330, user.id=11dd8e5ff4964167bf21a3db3e4fe8d7) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:39.604737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ddc45-cbed-4c99-b727-7c7036b77136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:39.606758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51ddc45-cbed-4c99-b727-7c7036b77136 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:39.613216 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 560/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:51:39 2022] GET /identity/v3/role_assignments?user.id=11dd8e5ff4964167bf21a3db3e4fe8d7&scope.project.id=a72dc770239240df858e7955129b5330&role.id=d0262ce715f7448babe9cef93dc25e9d => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:41.584732 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15763f6d-9eeb-47d3-b24d-f7d8419d5c0f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:41.585353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15763f6d-9eeb-47d3-b24d-f7d8419d5c0f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:41.585353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15763f6d-9eeb-47d3-b24d-f7d8419d5c0f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:41.586580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 558/1118] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:41.591709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3d060-8978-462b-bffd-5b1ab71049bc None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:41.592105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3d060-8978-462b-bffd-5b1ab71049bc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:41.592259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae3d060-8978-462b-bffd-5b1ab71049bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:41.610772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-aae3d060-8978-462b-bffd-5b1ab71049bc None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:41.611961 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-aae3d060-8978-462b-bffd-5b1ab71049bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:41.637739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:41.677319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 561/1119] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:41.700413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15763f6d-9eeb-47d3-b24d-f7d8419d5c0f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:41.719145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:41.798946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15763f6d-9eeb-47d3-b24d-f7d8419d5c0f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:41.832180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64b8d9-f56f-4d86-8aba-2a965026f075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:41.832789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64b8d9-f56f-4d86-8aba-2a965026f075 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:41.833062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64b8d9-f56f-4d86-8aba-2a965026f075 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:41.833352 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e64b8d9-f56f-4d86-8aba-2a965026f075 None admin] PATH_INFO: `/v3/roles/d0262ce715f7448babe9cef93dc25e9d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:41.834812 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64b8d9-f56f-4d86-8aba-2a965026f075 None admin] RBAC: Authorizing `identity:get_role(role_id=d0262ce715f7448babe9cef93dc25e9d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:41.836121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e64b8d9-f56f-4d86-8aba-2a965026f075 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:41.837464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 559/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:51:41 2022] GET /identity/v3/roles/d0262ce715f7448babe9cef93dc25e9d => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:41.843433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3d060-8978-462b-bffd-5b1ab71049bc None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:41.935578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae3d060-8978-462b-bffd-5b1ab71049bc None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:41.969168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535964ec-418d-46a0-ad25-27b2d5612a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:41.969855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535964ec-418d-46a0-ad25-27b2d5612a21 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:41.970136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535964ec-418d-46a0-ad25-27b2d5612a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:41.970448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535964ec-418d-46a0-ad25-27b2d5612a21 None admin] PATH_INFO: `/v3/users/11dd8e5ff4964167bf21a3db3e4fe8d7` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:41.971615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535964ec-418d-46a0-ad25-27b2d5612a21 None admin] RBAC: Authorizing `identity:get_user(user_id=11dd8e5ff4964167bf21a3db3e4fe8d7)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:41.973040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535964ec-418d-46a0-ad25-27b2d5612a21 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:41.974662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 562/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:51:41 2022] GET /identity/v3/users/11dd8e5ff4964167bf21a3db3e4fe8d7 => generated 286 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:41.980373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64b8d9-f56f-4d86-8aba-2a965026f075 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:42.062679 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:42.077627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e64b8d9-f56f-4d86-8aba-2a965026f075 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:42.109978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df76612c-cb58-4b66-b6c7-beafb4fc004f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:42.110531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76612c-cb58-4b66-b6c7-beafb4fc004f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:42.110803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76612c-cb58-4b66-b6c7-beafb4fc004f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:42.111069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df76612c-cb58-4b66-b6c7-beafb4fc004f None admin] PATH_INFO: `/v3/projects/a72dc770239240df858e7955129b5330` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:42.112201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76612c-cb58-4b66-b6c7-beafb4fc004f None admin] RBAC: Authorizing `identity:get_project(project_id=a72dc770239240df858e7955129b5330)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:42.113641 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df76612c-cb58-4b66-b6c7-beafb4fc004f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:42.115241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 560/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:51:41 2022] GET /identity/v3/projects/a72dc770239240df858e7955129b5330 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:42.120952 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535964ec-418d-46a0-ad25-27b2d5612a21 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:42.151132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:42.219975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535964ec-418d-46a0-ad25-27b2d5612a21 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:42.252946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03f1d6-9c5e-4eea-9ee8-0543e23f427e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:42.253621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03f1d6-9c5e-4eea-9ee8-0543e23f427e None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:42.253897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03f1d6-9c5e-4eea-9ee8-0543e23f427e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:42.254161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03f1d6-9c5e-4eea-9ee8-0543e23f427e None admin] PATH_INFO: `/v3/projects/a72dc770239240df858e7955129b5330/users/11dd8e5ff4964167bf21a3db3e4fe8d7/roles/d0262ce715f7448babe9cef93dc25e9d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:42.256272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03f1d6-9c5e-4eea-9ee8-0543e23f427e None admin] RBAC: Authorizing `identity:create_grant(project_id=a72dc770239240df858e7955129b5330, user_id=11dd8e5ff4964167bf21a3db3e4fe8d7, role_id=d0262ce715f7448babe9cef93dc25e9d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:42.257709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03f1d6-9c5e-4eea-9ee8-0543e23f427e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:42.269906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 563/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:51:42 2022] PUT /identity/v3/projects/a72dc770239240df858e7955129b5330/users/11dd8e5ff4964167bf21a3db3e4fe8d7/roles/d0262ce715f7448babe9cef93dc25e9d => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 11:51:44.209090 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71970a-6964-4fec-87ed-bafbafb639a6 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:44.209674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71970a-6964-4fec-87ed-bafbafb639a6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:44.209674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e71970a-6964-4fec-87ed-bafbafb639a6 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:44.210994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 561/1124] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:44.216110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be6fe1-dcb1-45fb-97b4-fcfd989baf2c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:44.216538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be6fe1-dcb1-45fb-97b4-fcfd989baf2c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:44.216640 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19be6fe1-dcb1-45fb-97b4-fcfd989baf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:44.235230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-19be6fe1-dcb1-45fb-97b4-fcfd989baf2c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:44.236389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-19be6fe1-dcb1-45fb-97b4-fcfd989baf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:44.302324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 564/1125] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:44.325396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71970a-6964-4fec-87ed-bafbafb639a6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:44.422463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e71970a-6964-4fec-87ed-bafbafb639a6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:44.454896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03831c39-eda1-48ba-ad27-c3b093a28fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:44.455511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03831c39-eda1-48ba-ad27-c3b093a28fbd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:44.455787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03831c39-eda1-48ba-ad27-c3b093a28fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:44.456054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03831c39-eda1-48ba-ad27-c3b093a28fbd None admin] PATH_INFO: `/v3/roles/d0262ce715f7448babe9cef93dc25e9d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:44.457501 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03831c39-eda1-48ba-ad27-c3b093a28fbd None admin] RBAC: Authorizing `identity:get_role(role_id=d0262ce715f7448babe9cef93dc25e9d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:44.458876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03831c39-eda1-48ba-ad27-c3b093a28fbd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:44.460229 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 562/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:51:44 2022] GET /identity/v3/roles/d0262ce715f7448babe9cef93dc25e9d => generated 223 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:44.465895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be6fe1-dcb1-45fb-97b4-fcfd989baf2c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:44.489059 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:44.560443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19be6fe1-dcb1-45fb-97b4-fcfd989baf2c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:44.592374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf47c7-b76e-460a-9fe9-bc18b3478453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:44.592992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf47c7-b76e-460a-9fe9-bc18b3478453 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:44.593807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf47c7-b76e-460a-9fe9-bc18b3478453 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:44.594076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bf47c7-b76e-460a-9fe9-bc18b3478453 None admin] PATH_INFO: `/v3/users/11dd8e5ff4964167bf21a3db3e4fe8d7` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:44.595209 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf47c7-b76e-460a-9fe9-bc18b3478453 None admin] RBAC: Authorizing `identity:get_user(user_id=11dd8e5ff4964167bf21a3db3e4fe8d7)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:44.596621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bf47c7-b76e-460a-9fe9-bc18b3478453 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:44.598207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 565/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:51:44 2022] GET /identity/v3/users/11dd8e5ff4964167bf21a3db3e4fe8d7 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:44.604034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03831c39-eda1-48ba-ad27-c3b093a28fbd None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:44.627966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:44.700085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03831c39-eda1-48ba-ad27-c3b093a28fbd None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:44.732853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52fa47-21c5-49aa-b3e8-24ce2c93ff72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:44.733479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52fa47-21c5-49aa-b3e8-24ce2c93ff72 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:44.733712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52fa47-21c5-49aa-b3e8-24ce2c93ff72 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:44.734497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52fa47-21c5-49aa-b3e8-24ce2c93ff72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:44.799970 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52fa47-21c5-49aa-b3e8-24ce2c93ff72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:44.801439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52fa47-21c5-49aa-b3e8-24ce2c93ff72 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:44.823153 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:44.895646 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 563/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:51:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:51:44.901495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf47c7-b76e-460a-9fe9-bc18b3478453 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:44.987870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:45.001994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bf47c7-b76e-460a-9fe9-bc18b3478453 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:45.035624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088cb83-d0c2-4501-b7d2-db06710bdd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:45.036258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088cb83-d0c2-4501-b7d2-db06710bdd65 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:45.036539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088cb83-d0c2-4501-b7d2-db06710bdd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:45.036811 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088cb83-d0c2-4501-b7d2-db06710bdd65 None admin] PATH_INFO: `/v3/projects/a72dc770239240df858e7955129b5330` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:45.037969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088cb83-d0c2-4501-b7d2-db06710bdd65 None admin] RBAC: Authorizing `identity:get_project(project_id=a72dc770239240df858e7955129b5330)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:45.039398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4088cb83-d0c2-4501-b7d2-db06710bdd65 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:45.041052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 566/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:51:44 2022] GET /identity/v3/projects/a72dc770239240df858e7955129b5330 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:45.047255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52fa47-21c5-49aa-b3e8-24ce2c93ff72 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:45.144186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52fa47-21c5-49aa-b3e8-24ce2c93ff72 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:45.166272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:45.177870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7499aa-c518-42db-bb2f-c7a77a5db53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:45.178469 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7499aa-c518-42db-bb2f-c7a77a5db53e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:45.178748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7499aa-c518-42db-bb2f-c7a77a5db53e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:45.179020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7499aa-c518-42db-bb2f-c7a77a5db53e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:45.179794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7499aa-c518-42db-bb2f-c7a77a5db53e None admin] RBAC: Adding query filter params (role.id=d0262ce715f7448babe9cef93dc25e9d, scope.project.id=a72dc770239240df858e7955129b5330, user.id=11dd8e5ff4964167bf21a3db3e4fe8d7) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:45.180186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7499aa-c518-42db-bb2f-c7a77a5db53e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:45.181662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7499aa-c518-42db-bb2f-c7a77a5db53e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:45.187309 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 564/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:51:45 2022] GET /identity/v3/role_assignments?user.id=11dd8e5ff4964167bf21a3db3e4fe8d7&scope.project.id=a72dc770239240df858e7955129b5330&role.id=d0262ce715f7448babe9cef93dc25e9d => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:47.182449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb67fd9-2ad6-44a4-aff4-91970d7977c0 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:47.182998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb67fd9-2ad6-44a4-aff4-91970d7977c0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:47.183089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb67fd9-2ad6-44a4-aff4-91970d7977c0 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:47.184370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 567/1131] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:47.189920 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d053493-c11c-4ce6-bc14-43815bcf3094 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:47.190353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d053493-c11c-4ce6-bc14-43815bcf3094 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:47.190447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d053493-c11c-4ce6-bc14-43815bcf3094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:47.208471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6d053493-c11c-4ce6-bc14-43815bcf3094 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:47.209664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6d053493-c11c-4ce6-bc14-43815bcf3094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:47.273060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 565/1132] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:47.295764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb67fd9-2ad6-44a4-aff4-91970d7977c0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:47.394822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb67fd9-2ad6-44a4-aff4-91970d7977c0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:47.426918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848ebb8a-4c95-4559-b223-9c576e511995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:47.427545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ebb8a-4c95-4559-b223-9c576e511995 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:47.427824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ebb8a-4c95-4559-b223-9c576e511995 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:47.428096 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848ebb8a-4c95-4559-b223-9c576e511995 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:47.429226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ebb8a-4c95-4559-b223-9c576e511995 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:47.430676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848ebb8a-4c95-4559-b223-9c576e511995 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:47.432246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 568/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:47.438663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d053493-c11c-4ce6-bc14-43815bcf3094 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:47.532399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d053493-c11c-4ce6-bc14-43815bcf3094 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:47.548543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:47.566436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b96b2-2380-4858-826e-42566a94fe9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:47.567041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b96b2-2380-4858-826e-42566a94fe9b None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:47.567323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b96b2-2380-4858-826e-42566a94fe9b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:47.567597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b96b2-2380-4858-826e-42566a94fe9b None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:47.568281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b96b2-2380-4858-826e-42566a94fe9b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:47.569770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b96b2-2380-4858-826e-42566a94fe9b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:47.595567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 566/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:51:47 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:51:49.598292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4553bd-1bdc-4019-978e-e430baf09885 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:49.598791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4553bd-1bdc-4019-978e-e430baf09885 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:49.598791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4553bd-1bdc-4019-978e-e430baf09885 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:49.600112 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 569/1135] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:49.605432 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6b74e-2dff-4395-9e8e-4a8aaaee1aa5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:49.605871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6b74e-2dff-4395-9e8e-4a8aaaee1aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:49.605972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f6b74e-2dff-4395-9e8e-4a8aaaee1aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:49.623707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-40f6b74e-2dff-4395-9e8e-4a8aaaee1aa5 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:49.624891 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-40f6b74e-2dff-4395-9e8e-4a8aaaee1aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:49.689304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 567/1136] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:49.713889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4553bd-1bdc-4019-978e-e430baf09885 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:49.741139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:49.813237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4553bd-1bdc-4019-978e-e430baf09885 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:49.846953 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b49379-f785-4fe8-aa17-b3b1a8eec996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:49.847571 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b49379-f785-4fe8-aa17-b3b1a8eec996 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:49.847849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b49379-f785-4fe8-aa17-b3b1a8eec996 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:49.848119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b49379-f785-4fe8-aa17-b3b1a8eec996 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:49.849327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b49379-f785-4fe8-aa17-b3b1a8eec996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:49.850710 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b49379-f785-4fe8-aa17-b3b1a8eec996 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:49.852539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 570/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:51:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:49.858176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6b74e-2dff-4395-9e8e-4a8aaaee1aa5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:49.949072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:49.953059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f6b74e-2dff-4395-9e8e-4a8aaaee1aa5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:49.991200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfe3a62-5c7b-4a32-a52f-cf2396769635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:49.991814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe3a62-5c7b-4a32-a52f-cf2396769635 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:49.992093 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe3a62-5c7b-4a32-a52f-cf2396769635 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:49.992366 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfe3a62-5c7b-4a32-a52f-cf2396769635 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:49.993044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe3a62-5c7b-4a32-a52f-cf2396769635 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:49.994516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfe3a62-5c7b-4a32-a52f-cf2396769635 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:50.015694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 568/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:51:49 2022] POST /identity/v3/users => generated 286 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:51:52.026614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28459e0-9aed-45ea-8375-f9aadf4a6bc1 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:52.027145 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28459e0-9aed-45ea-8375-f9aadf4a6bc1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:52.027145 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28459e0-9aed-45ea-8375-f9aadf4a6bc1 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:52.028490 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 571/1139] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:52.033814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eef13-ffc3-4af4-9bcf-fc618302678f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:52.034187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eef13-ffc3-4af4-9bcf-fc618302678f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:52.034365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896eef13-ffc3-4af4-9bcf-fc618302678f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:52.052559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-896eef13-ffc3-4af4-9bcf-fc618302678f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:52.053784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-896eef13-ffc3-4af4-9bcf-fc618302678f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:52.119481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 569/1140] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:52.142169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28459e0-9aed-45ea-8375-f9aadf4a6bc1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:52.233046 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:52.243648 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28459e0-9aed-45ea-8375-f9aadf4a6bc1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:52.278755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51ab68-03a2-48d8-91c8-b65257d690fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:52.279329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51ab68-03a2-48d8-91c8-b65257d690fa None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:52.279609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51ab68-03a2-48d8-91c8-b65257d690fa None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:52.279947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51ab68-03a2-48d8-91c8-b65257d690fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:52.290501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c51ab68-03a2-48d8-91c8-b65257d690fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-8c51ab68-03a2-48d8-91c8-b65257d690fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:51:52.295385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:52.297188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:52.298341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 572/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:51:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:52.303743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eef13-ffc3-4af4-9bcf-fc618302678f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:52.383652 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:52.399731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896eef13-ffc3-4af4-9bcf-fc618302678f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:52.432928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3fdb4-3da7-4116-bf87-5c13fff3cfdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:52.433559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3fdb4-3da7-4116-bf87-5c13fff3cfdf None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:52.433836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3fdb4-3da7-4116-bf87-5c13fff3cfdf None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:52.434113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3fdb4-3da7-4116-bf87-5c13fff3cfdf None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:52.434817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3fdb4-3da7-4116-bf87-5c13fff3cfdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:52.435117 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3fdb4-3da7-4116-bf87-5c13fff3cfdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:52.436492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3fdb4-3da7-4116-bf87-5c13fff3cfdf None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:52.444399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 570/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:51:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:52.450144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51ab68-03a2-48d8-91c8-b65257d690fa None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:52.546677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51ab68-03a2-48d8-91c8-b65257d690fa None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:52.578946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0204aca-59c0-4a96-bcc3-ccf09290445c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:52.579565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204aca-59c0-4a96-bcc3-ccf09290445c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:52.579841 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204aca-59c0-4a96-bcc3-ccf09290445c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:52.580111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0204aca-59c0-4a96-bcc3-ccf09290445c None admin] PATH_INFO: `/v3/users/a463a824c9cc4fc8b2d342c9c49fa311` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:52.592544 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0204aca-59c0-4a96-bcc3-ccf09290445c None admin] RBAC: Authorizing `identity:get_user(user_id=a463a824c9cc4fc8b2d342c9c49fa311)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:52.594565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0204aca-59c0-4a96-bcc3-ccf09290445c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:52.596146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 573/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:51:52 2022] GET /identity/v3/users/a463a824c9cc4fc8b2d342c9c49fa311 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:52.602035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3fdb4-3da7-4116-bf87-5c13fff3cfdf None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:52.697335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3fdb4-3da7-4116-bf87-5c13fff3cfdf None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:52.730196 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e55439-d7b6-4e23-a389-cdaa4b413d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:52.730785 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e55439-d7b6-4e23-a389-cdaa4b413d70 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:52.731065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e55439-d7b6-4e23-a389-cdaa4b413d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:52.731340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e55439-d7b6-4e23-a389-cdaa4b413d70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:52.745701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:52.795960 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e55439-d7b6-4e23-a389-cdaa4b413d70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:52.797488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e55439-d7b6-4e23-a389-cdaa4b413d70 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:52.891472 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 571/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:51:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:51:52.897230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0204aca-59c0-4a96-bcc3-ccf09290445c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:52.911228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:52.993825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0204aca-59c0-4a96-bcc3-ccf09290445c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:53.026229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56632e7-e8d2-4b3f-8a23-303d1dd2a87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:53.026851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56632e7-e8d2-4b3f-8a23-303d1dd2a87e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:53.027387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56632e7-e8d2-4b3f-8a23-303d1dd2a87e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:53.027387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56632e7-e8d2-4b3f-8a23-303d1dd2a87e None admin] PATH_INFO: `/v3/projects/bb341261518d40a7a45fbe852a7e8806` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:53.028495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56632e7-e8d2-4b3f-8a23-303d1dd2a87e None admin] RBAC: Authorizing `identity:get_project(project_id=bb341261518d40a7a45fbe852a7e8806)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:53.029935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56632e7-e8d2-4b3f-8a23-303d1dd2a87e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:53.031581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 574/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:51:52 2022] GET /identity/v3/projects/bb341261518d40a7a45fbe852a7e8806 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:53.037626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e55439-d7b6-4e23-a389-cdaa4b413d70 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:53.082443 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:53.133074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e55439-d7b6-4e23-a389-cdaa4b413d70 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:53.166402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a13825-d9e7-4397-b1e9-3e3f2cd99879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:53.166997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a13825-d9e7-4397-b1e9-3e3f2cd99879 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:53.167272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a13825-d9e7-4397-b1e9-3e3f2cd99879 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:53.167537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a13825-d9e7-4397-b1e9-3e3f2cd99879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:53.168307 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a13825-d9e7-4397-b1e9-3e3f2cd99879 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=bb341261518d40a7a45fbe852a7e8806, user.id=a463a824c9cc4fc8b2d342c9c49fa311) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:53.168606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a13825-d9e7-4397-b1e9-3e3f2cd99879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:53.170045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a13825-d9e7-4397-b1e9-3e3f2cd99879 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:53.175270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 572/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:51:53 2022] GET /identity/v3/role_assignments?user.id=a463a824c9cc4fc8b2d342c9c49fa311&scope.project.id=bb341261518d40a7a45fbe852a7e8806&role.id=0195bf688a7e464e8ff594afe80b050e => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:55.145378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b263bf-34cb-49a3-8ad1-8e2283c8ec45 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:55.145935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b263bf-34cb-49a3-8ad1-8e2283c8ec45 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:55.145935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b263bf-34cb-49a3-8ad1-8e2283c8ec45 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:55.147250 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 575/1147] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:55.152551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e831c6b-8431-4b88-b894-4e6473318d6b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:55.152952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e831c6b-8431-4b88-b894-4e6473318d6b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:55.153095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e831c6b-8431-4b88-b894-4e6473318d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:55.172557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7e831c6b-8431-4b88-b894-4e6473318d6b None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:55.173768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7e831c6b-8431-4b88-b894-4e6473318d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:55.241242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 573/1148] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:55.263406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b263bf-34cb-49a3-8ad1-8e2283c8ec45 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:55.342071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:55.363351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b263bf-34cb-49a3-8ad1-8e2283c8ec45 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:55.396843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888bfcb-a48c-41a1-8f8d-dd8c8b00122c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:55.397442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888bfcb-a48c-41a1-8f8d-dd8c8b00122c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:55.397721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888bfcb-a48c-41a1-8f8d-dd8c8b00122c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:55.397991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888bfcb-a48c-41a1-8f8d-dd8c8b00122c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:55.408124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888bfcb-a48c-41a1-8f8d-dd8c8b00122c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-e888bfcb-a48c-41a1-8f8d-dd8c8b00122c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:51:55.412898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:55.413916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:51:55.414829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 576/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:51:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:55.420139 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e831c6b-8431-4b88-b894-4e6473318d6b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:55.459980 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:55.516917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e831c6b-8431-4b88-b894-4e6473318d6b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:55.549424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bcb16-4a90-4fed-bef2-235afedea7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:55.550029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bcb16-4a90-4fed-bef2-235afedea7df None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:55.550306 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bcb16-4a90-4fed-bef2-235afedea7df None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:55.550576 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91bcb16-4a90-4fed-bef2-235afedea7df None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:55.551286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bcb16-4a90-4fed-bef2-235afedea7df None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:55.551588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bcb16-4a90-4fed-bef2-235afedea7df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:55.552955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91bcb16-4a90-4fed-bef2-235afedea7df None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:55.560820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 574/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:51:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:55.566588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888bfcb-a48c-41a1-8f8d-dd8c8b00122c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:55.664567 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888bfcb-a48c-41a1-8f8d-dd8c8b00122c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:55.696946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee251c-fdf9-40b1-829f-95e485b48a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:55.697587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee251c-fdf9-40b1-829f-95e485b48a91 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:55.697872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee251c-fdf9-40b1-829f-95e485b48a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:55.698144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aee251c-fdf9-40b1-829f-95e485b48a91 None admin] PATH_INFO: `/v3/users/a463a824c9cc4fc8b2d342c9c49fa311` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:55.699292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee251c-fdf9-40b1-829f-95e485b48a91 None admin] RBAC: Authorizing `identity:get_user(user_id=a463a824c9cc4fc8b2d342c9c49fa311)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:55.700711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aee251c-fdf9-40b1-829f-95e485b48a91 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:55.702826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 577/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:51:55 2022] GET /identity/v3/users/a463a824c9cc4fc8b2d342c9c49fa311 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:55.708277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bcb16-4a90-4fed-bef2-235afedea7df None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:55.803954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91bcb16-4a90-4fed-bef2-235afedea7df None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:55.805471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:55.837213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c71ba0-b568-48fc-8a00-58fd5ef4abd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:55.837860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c71ba0-b568-48fc-8a00-58fd5ef4abd4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:55.838139 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c71ba0-b568-48fc-8a00-58fd5ef4abd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:55.838410 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c71ba0-b568-48fc-8a00-58fd5ef4abd4 None admin] PATH_INFO: `/v3/projects/bb341261518d40a7a45fbe852a7e8806` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:55.839548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c71ba0-b568-48fc-8a00-58fd5ef4abd4 None admin] RBAC: Authorizing `identity:get_project(project_id=bb341261518d40a7a45fbe852a7e8806)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:55.840982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c71ba0-b568-48fc-8a00-58fd5ef4abd4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:55.842632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 575/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:51:55 2022] GET /identity/v3/projects/bb341261518d40a7a45fbe852a7e8806 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:55.849243 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee251c-fdf9-40b1-829f-95e485b48a91 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:55.859865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:55.943708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aee251c-fdf9-40b1-829f-95e485b48a91 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:55.975713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10e684-bef8-42a4-91e7-009730af803b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:55.976618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10e684-bef8-42a4-91e7-009730af803b None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:55.976890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10e684-bef8-42a4-91e7-009730af803b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:55.977157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10e684-bef8-42a4-91e7-009730af803b None admin] PATH_INFO: `/v3/projects/bb341261518d40a7a45fbe852a7e8806/users/a463a824c9cc4fc8b2d342c9c49fa311/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:55.979064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10e684-bef8-42a4-91e7-009730af803b None admin] RBAC: Authorizing `identity:create_grant(project_id=bb341261518d40a7a45fbe852a7e8806, user_id=a463a824c9cc4fc8b2d342c9c49fa311, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:55.980500 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10e684-bef8-42a4-91e7-009730af803b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:55.993374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 578/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:51:55 2022] PUT /identity/v3/projects/bb341261518d40a7a45fbe852a7e8806/users/a463a824c9cc4fc8b2d342c9c49fa311/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:51:57.981131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e779b20-4c44-46f7-9488-14dcf31f7a27 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:57.981685 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e779b20-4c44-46f7-9488-14dcf31f7a27 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:57.981685 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e779b20-4c44-46f7-9488-14dcf31f7a27 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:57.983234 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 576/1154] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:51:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:51:57.988507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8a09b-551c-4ffa-aa53-b5780900a809 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:57.988897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8a09b-551c-4ffa-aa53-b5780900a809 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:57.989052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c8a09b-551c-4ffa-aa53-b5780900a809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:58.006523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-19c8a09b-551c-4ffa-aa53-b5780900a809 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:51:58.007684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-19c8a09b-551c-4ffa-aa53-b5780900a809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:51:58.072033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:58.078924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 579/1155] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:51:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:51:58.102908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e779b20-4c44-46f7-9488-14dcf31f7a27 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:58.200445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e779b20-4c44-46f7-9488-14dcf31f7a27 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:58.232456 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8f7b0-24e4-4f8f-bc57-d7fafd9de65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:58.233010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8f7b0-24e4-4f8f-bc57-d7fafd9de65a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:58.233339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8f7b0-24e4-4f8f-bc57-d7fafd9de65a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:58.233606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8f7b0-24e4-4f8f-bc57-d7fafd9de65a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:58.243628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8f7b0-24e4-4f8f-bc57-d7fafd9de65a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e6a8f7b0-24e4-4f8f-bc57-d7fafd9de65a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:51:58.248463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:51:58.250088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:51:58.251026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 577/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:51:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:51:58.256090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8a09b-551c-4ffa-aa53-b5780900a809 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:58.357150 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c8a09b-551c-4ffa-aa53-b5780900a809 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:58.391626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8979a2-7c31-4071-8084-3a9a91f0d986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:58.392236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8979a2-7c31-4071-8084-3a9a91f0d986 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:58.392516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8979a2-7c31-4071-8084-3a9a91f0d986 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:58.392787 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8979a2-7c31-4071-8084-3a9a91f0d986 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:58.393518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8979a2-7c31-4071-8084-3a9a91f0d986 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:58.393824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8979a2-7c31-4071-8084-3a9a91f0d986 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:58.395183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8979a2-7c31-4071-8084-3a9a91f0d986 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:58.402920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 580/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:51:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:58.408731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8f7b0-24e4-4f8f-bc57-d7fafd9de65a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:58.438538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:58.505700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8f7b0-24e4-4f8f-bc57-d7fafd9de65a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:58.537119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc57c8-07cb-420b-8662-0a53eb2f4805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:58.537762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc57c8-07cb-420b-8662-0a53eb2f4805 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:58.538039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc57c8-07cb-420b-8662-0a53eb2f4805 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:58.538304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dc57c8-07cb-420b-8662-0a53eb2f4805 None admin] PATH_INFO: `/v3/users/a463a824c9cc4fc8b2d342c9c49fa311` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:58.539448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc57c8-07cb-420b-8662-0a53eb2f4805 None admin] RBAC: Authorizing `identity:get_user(user_id=a463a824c9cc4fc8b2d342c9c49fa311)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:58.540872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dc57c8-07cb-420b-8662-0a53eb2f4805 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:58.542473 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 578/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:51:58 2022] GET /identity/v3/users/a463a824c9cc4fc8b2d342c9c49fa311 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:58.548798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8979a2-7c31-4071-8084-3a9a91f0d986 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:58.606215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:58.646733 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8979a2-7c31-4071-8084-3a9a91f0d986 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:58.678911 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c117eb-76cb-4f87-b787-090c59b74883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:58.679513 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c117eb-76cb-4f87-b787-090c59b74883 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:58.679793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c117eb-76cb-4f87-b787-090c59b74883 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:58.680065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c117eb-76cb-4f87-b787-090c59b74883 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:58.744326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c117eb-76cb-4f87-b787-090c59b74883 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:58.745796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c117eb-76cb-4f87-b787-090c59b74883 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:58.801549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:58.842379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 581/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:51:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:51:58.848682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc57c8-07cb-420b-8662-0a53eb2f4805 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:58.941903 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:51:58.946307 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dc57c8-07cb-420b-8662-0a53eb2f4805 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:58.982553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8b5e0-558e-4b25-ae28-7e446b2e1ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:58.983217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8b5e0-558e-4b25-ae28-7e446b2e1ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:58.984106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8b5e0-558e-4b25-ae28-7e446b2e1ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:58.984377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8b5e0-558e-4b25-ae28-7e446b2e1ea0 None admin] PATH_INFO: `/v3/projects/bb341261518d40a7a45fbe852a7e8806` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:58.985553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8b5e0-558e-4b25-ae28-7e446b2e1ea0 None admin] RBAC: Authorizing `identity:get_project(project_id=bb341261518d40a7a45fbe852a7e8806)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:58.986974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8b5e0-558e-4b25-ae28-7e446b2e1ea0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:58.988593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 579/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:51:58 2022] GET /identity/v3/projects/bb341261518d40a7a45fbe852a7e8806 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:51:58.994681 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c117eb-76cb-4f87-b787-090c59b74883 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:51:59.088721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c117eb-76cb-4f87-b787-090c59b74883 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:51:59.121960 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a43164f-2883-49d8-9570-2818073bf590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:51:59.122554 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43164f-2883-49d8-9570-2818073bf590 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:51:59.122831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43164f-2883-49d8-9570-2818073bf590 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:51:59.123100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a43164f-2883-49d8-9570-2818073bf590 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:51:59.123901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43164f-2883-49d8-9570-2818073bf590 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=bb341261518d40a7a45fbe852a7e8806, user.id=a463a824c9cc4fc8b2d342c9c49fa311) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:51:59.124207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43164f-2883-49d8-9570-2818073bf590 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:51:59.125655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a43164f-2883-49d8-9570-2818073bf590 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:51:59.131202 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 582/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:51:58 2022] GET /identity/v3/role_assignments?user.id=a463a824c9cc4fc8b2d342c9c49fa311&scope.project.id=bb341261518d40a7a45fbe852a7e8806&role.id=0195bf688a7e464e8ff594afe80b050e => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:01.119919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b9836-896d-4430-98c0-ad3685cc2d32 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:01.120451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b9836-896d-4430-98c0-ad3685cc2d32 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:01.120451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b9836-896d-4430-98c0-ad3685cc2d32 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:01.121859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 580/1162] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:52:01.127624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abfd4a-b864-4c88-bb69-8efca1b28c90 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:01.128042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abfd4a-b864-4c88-bb69-8efca1b28c90 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:01.128175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abfd4a-b864-4c88-bb69-8efca1b28c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:01.146464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-85abfd4a-b864-4c88-bb69-8efca1b28c90 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:52:01.147656 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-85abfd4a-b864-4c88-bb69-8efca1b28c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:52:01.164294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:01.212297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 583/1163] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:52:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:52:01.233945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b9836-896d-4430-98c0-ad3685cc2d32 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:01.334053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3b9836-896d-4430-98c0-ad3685cc2d32 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:01.370748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e22d6-f139-4b32-ba62-ea7059c02a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:01.371282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e22d6-f139-4b32-ba62-ea7059c02a00 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:01.371566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e22d6-f139-4b32-ba62-ea7059c02a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:01.371840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e22d6-f139-4b32-ba62-ea7059c02a00 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:01.405109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:01.438079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e22d6-f139-4b32-ba62-ea7059c02a00 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:01.439535 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e22d6-f139-4b32-ba62-ea7059c02a00 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:01.534514 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 581/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:52:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:52:01.540411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abfd4a-b864-4c88-bb69-8efca1b28c90 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:01.634340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abfd4a-b864-4c88-bb69-8efca1b28c90 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:01.666311 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36fa951-88a2-459e-a741-287546fe995f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:01.666945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa951-88a2-459e-a741-287546fe995f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:01.667225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa951-88a2-459e-a741-287546fe995f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:01.667497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36fa951-88a2-459e-a741-287546fe995f None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:01.674425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fa951-88a2-459e-a741-287546fe995f None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:01.675863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36fa951-88a2-459e-a741-287546fe995f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-a36fa951-88a2-459e-a741-287546fe995f None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:52:01.687537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:52:01.688764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:52:01.689700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 584/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Aug 1 11:52:01 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:52:01.694673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e22d6-f139-4b32-ba62-ea7059c02a00 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:01.757146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:01.790503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e22d6-f139-4b32-ba62-ea7059c02a00 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:01.823865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6323c399-3638-497e-8f7f-d3dbf61d0031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:01.824462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323c399-3638-497e-8f7f-d3dbf61d0031 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:01.824741 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323c399-3638-497e-8f7f-d3dbf61d0031 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:01.825013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6323c399-3638-497e-8f7f-d3dbf61d0031 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:01.825717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323c399-3638-497e-8f7f-d3dbf61d0031 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:52:01.826017 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323c399-3638-497e-8f7f-d3dbf61d0031 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:01.827411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6323c399-3638-497e-8f7f-d3dbf61d0031 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:01.834289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 582/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Mon Aug 1 11:52:01 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:03.820234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af62412-fb0d-4c1d-94c4-bc43c6c7c542 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:03.820776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af62412-fb0d-4c1d-94c4-bc43c6c7c542 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:03.820776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af62412-fb0d-4c1d-94c4-bc43c6c7c542 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:03.822164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 585/1167] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:52:03.827826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426fb52-157d-4ad8-abae-da14f29fe130 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:03.828248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426fb52-157d-4ad8-abae-da14f29fe130 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:03.828360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426fb52-157d-4ad8-abae-da14f29fe130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:03.846481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e426fb52-157d-4ad8-abae-da14f29fe130 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:52:03.847668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e426fb52-157d-4ad8-abae-da14f29fe130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:52:03.912069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 583/1168] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:52:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:52:03.939614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af62412-fb0d-4c1d-94c4-bc43c6c7c542 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:03.956016 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:04.039129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af62412-fb0d-4c1d-94c4-bc43c6c7c542 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:04.070917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3519fc0-0592-46b3-8a2d-fcff8f1e34db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:04.071460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519fc0-0592-46b3-8a2d-fcff8f1e34db None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:04.071736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519fc0-0592-46b3-8a2d-fcff8f1e34db None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:04.072004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3519fc0-0592-46b3-8a2d-fcff8f1e34db None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:04.072706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3519fc0-0592-46b3-8a2d-fcff8f1e34db None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:04.074090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3519fc0-0592-46b3-8a2d-fcff8f1e34db None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:04.089605 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 586/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Mon Aug 1 11:52:03 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 11:52:06.085967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b1ee4-5a69-42b8-898e-afeaecbdfc71 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:06.086517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b1ee4-5a69-42b8-898e-afeaecbdfc71 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:06.086517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b1ee4-5a69-42b8-898e-afeaecbdfc71 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:06.087854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 584/1170] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:52:06.092849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a283074-5470-47e3-bd39-56e24f0fbd72 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:06.093222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a283074-5470-47e3-bd39-56e24f0fbd72 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:06.093438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a283074-5470-47e3-bd39-56e24f0fbd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:06.111909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0a283074-5470-47e3-bd39-56e24f0fbd72 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:52:06.113083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0a283074-5470-47e3-bd39-56e24f0fbd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:52:06.177650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 587/1171] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:52:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:52:06.200563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b1ee4-5a69-42b8-898e-afeaecbdfc71 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:06.259869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:06.300406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b1ee4-5a69-42b8-898e-afeaecbdfc71 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:06.335660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa6754d-0862-4dd8-8414-233ed17ccec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:06.336398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6754d-0862-4dd8-8414-233ed17ccec1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:06.336620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6754d-0862-4dd8-8414-233ed17ccec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:06.336958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa6754d-0862-4dd8-8414-233ed17ccec1 None admin] PATH_INFO: `/v3/domains/692487e7f69c475f9c8254ea0b7c7be2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:06.348527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6754d-0862-4dd8-8414-233ed17ccec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=692487e7f69c475f9c8254ea0b7c7be2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:06.350012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa6754d-0862-4dd8-8414-233ed17ccec1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:06.351889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 585/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Mon Aug 1 11:52:06 2022] GET /identity/v3/domains/692487e7f69c475f9c8254ea0b7c7be2 => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:06.357874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a283074-5470-47e3-bd39-56e24f0fbd72 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:06.361498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:06.456557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a283074-5470-47e3-bd39-56e24f0fbd72 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:06.500505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63c685b-fe16-4304-bc73-1addb505640d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:06.501124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c685b-fe16-4304-bc73-1addb505640d None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:06.501428 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c685b-fe16-4304-bc73-1addb505640d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:06.501697 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63c685b-fe16-4304-bc73-1addb505640d None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:06.502380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c685b-fe16-4304-bc73-1addb505640d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:06.503799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63c685b-fe16-4304-bc73-1addb505640d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:06.530523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 588/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:52:06 2022] POST /identity/v3/projects => generated 361 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:52:08.539386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d1cc1-0d7a-4850-ac95-58b47aa3933d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:08.539905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d1cc1-0d7a-4850-ac95-58b47aa3933d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:08.539905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d1cc1-0d7a-4850-ac95-58b47aa3933d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:08.541326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 586/1174] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:52:08.546809 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8317a-006d-4499-bd0b-2e2c30d9c6c1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:08.547224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8317a-006d-4499-bd0b-2e2c30d9c6c1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:08.547351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f8317a-006d-4499-bd0b-2e2c30d9c6c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:08.565567 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-50f8317a-006d-4499-bd0b-2e2c30d9c6c1 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:52:08.566676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-50f8317a-006d-4499-bd0b-2e2c30d9c6c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:52:08.615212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:08.631630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 589/1175] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:52:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:52:08.656447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d1cc1-0d7a-4850-ac95-58b47aa3933d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:08.756255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d1cc1-0d7a-4850-ac95-58b47aa3933d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:08.775097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:08.789379 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc372242-17a3-4bb1-bfde-0559e6fb55fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:08.790008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372242-17a3-4bb1-bfde-0559e6fb55fc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:08.790287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372242-17a3-4bb1-bfde-0559e6fb55fc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:08.790559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc372242-17a3-4bb1-bfde-0559e6fb55fc None admin] PATH_INFO: `/v3/domains/692487e7f69c475f9c8254ea0b7c7be2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:08.791701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc372242-17a3-4bb1-bfde-0559e6fb55fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=692487e7f69c475f9c8254ea0b7c7be2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:08.793143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc372242-17a3-4bb1-bfde-0559e6fb55fc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:08.794741 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 587/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Mon Aug 1 11:52:08 2022] GET /identity/v3/domains/692487e7f69c475f9c8254ea0b7c7be2 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:08.801052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8317a-006d-4499-bd0b-2e2c30d9c6c1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:08.913499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f8317a-006d-4499-bd0b-2e2c30d9c6c1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:08.946801 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc638aa-7643-49b0-9528-5ec9d0d80421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:08.947416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc638aa-7643-49b0-9528-5ec9d0d80421 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:08.947694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc638aa-7643-49b0-9528-5ec9d0d80421 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:08.947963 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc638aa-7643-49b0-9528-5ec9d0d80421 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:08.948643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc638aa-7643-49b0-9528-5ec9d0d80421 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:08.950096 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc638aa-7643-49b0-9528-5ec9d0d80421 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:08.972393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 590/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:52:08 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:52:11.014654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afcb22-2b29-4066-a6d2-03f94c11e75d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:11.015214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afcb22-2b29-4066-a6d2-03f94c11e75d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:11.015214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afcb22-2b29-4066-a6d2-03f94c11e75d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:11.016572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 588/1178] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:52:11.021704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76e470-68ca-4ec5-9ebd-ba4339167e5a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:11.022101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76e470-68ca-4ec5-9ebd-ba4339167e5a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:11.022284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76e470-68ca-4ec5-9ebd-ba4339167e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:11.040163 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-cf76e470-68ca-4ec5-9ebd-ba4339167e5a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:52:11.041344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cf76e470-68ca-4ec5-9ebd-ba4339167e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:52:11.074805 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:11.106947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 591/1179] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:52:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:52:11.130183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afcb22-2b29-4066-a6d2-03f94c11e75d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:11.228922 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afcb22-2b29-4066-a6d2-03f94c11e75d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:11.261145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9fe9b-fa1e-4b3b-bd5c-ff37d1ec50b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:11.261794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9fe9b-fa1e-4b3b-bd5c-ff37d1ec50b7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:11.262077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9fe9b-fa1e-4b3b-bd5c-ff37d1ec50b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:11.262350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e9fe9b-fa1e-4b3b-bd5c-ff37d1ec50b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:11.273085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e9fe9b-fa1e-4b3b-bd5c-ff37d1ec50b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c1e9fe9b-fa1e-4b3b-bd5c-ff37d1ec50b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:52:11.277909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:52:11.279008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:52:11.280569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 589/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:52:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:52:11.285267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76e470-68ca-4ec5-9ebd-ba4339167e5a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:11.380033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76e470-68ca-4ec5-9ebd-ba4339167e5a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:11.413353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69623a6-0c73-41f0-b9aa-1e99fddd0feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:11.413961 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69623a6-0c73-41f0-b9aa-1e99fddd0feb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:11.414234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69623a6-0c73-41f0-b9aa-1e99fddd0feb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:11.414497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69623a6-0c73-41f0-b9aa-1e99fddd0feb None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:11.415196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69623a6-0c73-41f0-b9aa-1e99fddd0feb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:52:11.415492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69623a6-0c73-41f0-b9aa-1e99fddd0feb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:11.416851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69623a6-0c73-41f0-b9aa-1e99fddd0feb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:11.424561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 592/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:52:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:11.430279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9fe9b-fa1e-4b3b-bd5c-ff37d1ec50b7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:11.478795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:11.528441 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e9fe9b-fa1e-4b3b-bd5c-ff37d1ec50b7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:11.560884 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d8e3-60aa-4c86-827b-08f4e4cfa3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:11.561561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d8e3-60aa-4c86-827b-08f4e4cfa3a5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:11.561845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d8e3-60aa-4c86-827b-08f4e4cfa3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:11.562119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be00d8e3-60aa-4c86-827b-08f4e4cfa3a5 None admin] PATH_INFO: `/v3/users/7d19ec00f2be4787bfee298713e763e5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:11.574709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00d8e3-60aa-4c86-827b-08f4e4cfa3a5 None admin] RBAC: Authorizing `identity:get_user(user_id=7d19ec00f2be4787bfee298713e763e5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:11.576160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be00d8e3-60aa-4c86-827b-08f4e4cfa3a5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:11.578293 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 590/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:52:11 2022] GET /identity/v3/users/7d19ec00f2be4787bfee298713e763e5 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:11.583935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69623a6-0c73-41f0-b9aa-1e99fddd0feb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:11.617931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:11.682113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69623a6-0c73-41f0-b9aa-1e99fddd0feb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:11.715314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe9c92-73bc-4326-a8c4-f7c530f319c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:11.715911 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe9c92-73bc-4326-a8c4-f7c530f319c4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:11.716189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe9c92-73bc-4326-a8c4-f7c530f319c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:11.716460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbe9c92-73bc-4326-a8c4-f7c530f319c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:11.781327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe9c92-73bc-4326-a8c4-f7c530f319c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:11.782710 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbe9c92-73bc-4326-a8c4-f7c530f319c4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:11.813791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:11.888834 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 593/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:52:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:52:11.895440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d8e3-60aa-4c86-827b-08f4e4cfa3a5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:11.991481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be00d8e3-60aa-4c86-827b-08f4e4cfa3a5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:11.999023 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:12.024938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dcb928-c182-4dd3-be08-e8075f5ea0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:12.025596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcb928-c182-4dd3-be08-e8075f5ea0fe None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:12.025874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcb928-c182-4dd3-be08-e8075f5ea0fe None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:12.026146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dcb928-c182-4dd3-be08-e8075f5ea0fe None admin] PATH_INFO: `/v3/projects/25d97d055b8f4f13bf48ce7c4a568963` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:12.027297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcb928-c182-4dd3-be08-e8075f5ea0fe None admin] RBAC: Authorizing `identity:get_project(project_id=25d97d055b8f4f13bf48ce7c4a568963)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:12.028736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dcb928-c182-4dd3-be08-e8075f5ea0fe None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:12.030430 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 591/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:52:11 2022] GET /identity/v3/projects/25d97d055b8f4f13bf48ce7c4a568963 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:12.036548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe9c92-73bc-4326-a8c4-f7c530f319c4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:12.132690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbe9c92-73bc-4326-a8c4-f7c530f319c4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:12.166539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218a6cf-b72e-42a2-a02f-50eb8707efd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:12.167150 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218a6cf-b72e-42a2-a02f-50eb8707efd1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:12.167429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218a6cf-b72e-42a2-a02f-50eb8707efd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:12.167704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218a6cf-b72e-42a2-a02f-50eb8707efd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:12.168481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218a6cf-b72e-42a2-a02f-50eb8707efd1 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=25d97d055b8f4f13bf48ce7c4a568963, user.id=7d19ec00f2be4787bfee298713e763e5) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:52:12.168790 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218a6cf-b72e-42a2-a02f-50eb8707efd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:12.170753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218a6cf-b72e-42a2-a02f-50eb8707efd1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:12.172529 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:12.176432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 594/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:52:12 2022] GET /identity/v3/role_assignments?user.id=7d19ec00f2be4787bfee298713e763e5&scope.project.id=25d97d055b8f4f13bf48ce7c4a568963&role.id=0195bf688a7e464e8ff594afe80b050e => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:14.149310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5fff3-394f-47f7-add3-8705b79892a4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:14.149881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5fff3-394f-47f7-add3-8705b79892a4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:14.149881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e5fff3-394f-47f7-add3-8705b79892a4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:14.151238 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 592/1186] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:52:14.156816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b06064-03f1-4b21-92e4-fe4a809ccbbf None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:14.157221 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b06064-03f1-4b21-92e4-fe4a809ccbbf None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:14.157390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b06064-03f1-4b21-92e4-fe4a809ccbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:14.175648 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-05b06064-03f1-4b21-92e4-fe4a809ccbbf None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:52:14.176907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-05b06064-03f1-4b21-92e4-fe4a809ccbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:52:14.240469 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 595/1187] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:52:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:52:14.262215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5fff3-394f-47f7-add3-8705b79892a4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:14.362419 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e5fff3-394f-47f7-add3-8705b79892a4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:14.397678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adda430-a0e5-4967-99f1-8f7f5832d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:14.398303 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adda430-a0e5-4967-99f1-8f7f5832d83e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:14.398588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adda430-a0e5-4967-99f1-8f7f5832d83e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:14.398865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adda430-a0e5-4967-99f1-8f7f5832d83e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:14.409422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adda430-a0e5-4967-99f1-8f7f5832d83e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-9adda430-a0e5-4967-99f1-8f7f5832d83e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:52:14.414254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:52:14.415396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:52:14.416671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 593/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:52:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:52:14.421512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b06064-03f1-4b21-92e4-fe4a809ccbbf None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:14.518232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b06064-03f1-4b21-92e4-fe4a809ccbbf None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:14.543722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:14.551601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2051066-9562-4e55-af89-46e83e0bf327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:14.552206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2051066-9562-4e55-af89-46e83e0bf327 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:14.552486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2051066-9562-4e55-af89-46e83e0bf327 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:14.552759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2051066-9562-4e55-af89-46e83e0bf327 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:14.553506 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2051066-9562-4e55-af89-46e83e0bf327 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:52:14.553813 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2051066-9562-4e55-af89-46e83e0bf327 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:14.555172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2051066-9562-4e55-af89-46e83e0bf327 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:14.562924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 596/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:52:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:14.568544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adda430-a0e5-4967-99f1-8f7f5832d83e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:14.603810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:14.667670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adda430-a0e5-4967-99f1-8f7f5832d83e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:14.700718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ce7b-bb32-450d-876f-16e73e8dcd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:14.701373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ce7b-bb32-450d-876f-16e73e8dcd56 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:14.702229 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ce7b-bb32-450d-876f-16e73e8dcd56 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:14.702506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a543ce7b-bb32-450d-876f-16e73e8dcd56 None admin] PATH_INFO: `/v3/users/7d19ec00f2be4787bfee298713e763e5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:14.703684 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543ce7b-bb32-450d-876f-16e73e8dcd56 None admin] RBAC: Authorizing `identity:get_user(user_id=7d19ec00f2be4787bfee298713e763e5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:14.705139 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a543ce7b-bb32-450d-876f-16e73e8dcd56 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:14.706738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 594/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:52:14 2022] GET /identity/v3/users/7d19ec00f2be4787bfee298713e763e5 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:14.712366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2051066-9562-4e55-af89-46e83e0bf327 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:14.809284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2051066-9562-4e55-af89-46e83e0bf327 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:14.842303 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b315fb24-590b-498e-808b-ded9a2c5d20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:14.842928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315fb24-590b-498e-808b-ded9a2c5d20b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:14.843199 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315fb24-590b-498e-808b-ded9a2c5d20b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:14.843463 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b315fb24-590b-498e-808b-ded9a2c5d20b None admin] PATH_INFO: `/v3/projects/25d97d055b8f4f13bf48ce7c4a568963` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:14.844585 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315fb24-590b-498e-808b-ded9a2c5d20b None admin] RBAC: Authorizing `identity:get_project(project_id=25d97d055b8f4f13bf48ce7c4a568963)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:14.846066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b315fb24-590b-498e-808b-ded9a2c5d20b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:14.847698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 597/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:52:14 2022] GET /identity/v3/projects/25d97d055b8f4f13bf48ce7c4a568963 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:14.854280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ce7b-bb32-450d-876f-16e73e8dcd56 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:14.951259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a543ce7b-bb32-450d-876f-16e73e8dcd56 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:14.953215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:14.986719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12be5df7-4020-4aef-9898-6c6537e08edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:14.987373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be5df7-4020-4aef-9898-6c6537e08edf None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:14.987648 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be5df7-4020-4aef-9898-6c6537e08edf None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:14.987916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12be5df7-4020-4aef-9898-6c6537e08edf None admin] PATH_INFO: `/v3/projects/25d97d055b8f4f13bf48ce7c4a568963/users/7d19ec00f2be4787bfee298713e763e5/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:14.989839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be5df7-4020-4aef-9898-6c6537e08edf None admin] RBAC: Authorizing `identity:create_grant(project_id=25d97d055b8f4f13bf48ce7c4a568963, user_id=7d19ec00f2be4787bfee298713e763e5, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:14.991302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12be5df7-4020-4aef-9898-6c6537e08edf None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:15.004005 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 595/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:52:14 2022] PUT /identity/v3/projects/25d97d055b8f4f13bf48ce7c4a568963/users/7d19ec00f2be4787bfee298713e763e5/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:52:16.977951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30509bd7-d72a-491e-8e15-c9c5314c1c25 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:16.978506 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30509bd7-d72a-491e-8e15-c9c5314c1c25 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:16.978506 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30509bd7-d72a-491e-8e15-c9c5314c1c25 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:16.979850 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 598/1193] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:52:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:52:16.985636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c4e58-9e00-449d-bb02-46b57b2955f0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:16.986035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c4e58-9e00-449d-bb02-46b57b2955f0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:16.986169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c4e58-9e00-449d-bb02-46b57b2955f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:17.003616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5c1c4e58-9e00-449d-bb02-46b57b2955f0 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:52:17.004803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5c1c4e58-9e00-449d-bb02-46b57b2955f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:52:17.068120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 596/1194] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:52:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:52:17.090606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30509bd7-d72a-491e-8e15-c9c5314c1c25 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:17.152062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:17.193889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30509bd7-d72a-491e-8e15-c9c5314c1c25 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:17.227044 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf7348-1176-4ae0-a414-c057e1c83d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:17.227664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf7348-1176-4ae0-a414-c057e1c83d2d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:17.227941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf7348-1176-4ae0-a414-c057e1c83d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:17.228261 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cf7348-1176-4ae0-a414-c057e1c83d2d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:17.237956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cf7348-1176-4ae0-a414-c057e1c83d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-c6cf7348-1176-4ae0-a414-c057e1c83d2d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:52:17.242807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:52:17.243899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:52:17.244946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 599/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:52:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:52:17.249976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c4e58-9e00-449d-bb02-46b57b2955f0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:17.337844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:17.348070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c4e58-9e00-449d-bb02-46b57b2955f0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:17.380676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc85710-b0b3-431f-9345-06b13efeae47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:17.381281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc85710-b0b3-431f-9345-06b13efeae47 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:17.381591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc85710-b0b3-431f-9345-06b13efeae47 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:17.381863 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc85710-b0b3-431f-9345-06b13efeae47 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:17.382570 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc85710-b0b3-431f-9345-06b13efeae47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:52:17.382871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc85710-b0b3-431f-9345-06b13efeae47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:17.384242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc85710-b0b3-431f-9345-06b13efeae47 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:17.392542 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 597/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:52:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:17.398295 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf7348-1176-4ae0-a414-c057e1c83d2d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:17.494225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cf7348-1176-4ae0-a414-c057e1c83d2d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:17.510324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:17.527387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6f0cd-dfb1-4945-b041-db26dc4c656c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:17.527998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6f0cd-dfb1-4945-b041-db26dc4c656c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:17.528273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6f0cd-dfb1-4945-b041-db26dc4c656c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:17.528538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff6f0cd-dfb1-4945-b041-db26dc4c656c None admin] PATH_INFO: `/v3/users/7d19ec00f2be4787bfee298713e763e5` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:17.529703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6f0cd-dfb1-4945-b041-db26dc4c656c None admin] RBAC: Authorizing `identity:get_user(user_id=7d19ec00f2be4787bfee298713e763e5)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:17.531695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff6f0cd-dfb1-4945-b041-db26dc4c656c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:17.533252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 600/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Mon Aug 1 11:52:17 2022] GET /identity/v3/users/7d19ec00f2be4787bfee298713e763e5 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:17.538871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc85710-b0b3-431f-9345-06b13efeae47 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:17.635258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc85710-b0b3-431f-9345-06b13efeae47 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:17.667549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099e732-431b-4cce-8d21-174276f88c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:17.668146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099e732-431b-4cce-8d21-174276f88c76 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:17.668429 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099e732-431b-4cce-8d21-174276f88c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:17.668703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099e732-431b-4cce-8d21-174276f88c76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:17.691756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:17.734570 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099e732-431b-4cce-8d21-174276f88c76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:17.736022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5099e732-431b-4cce-8d21-174276f88c76 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:17.832189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 598/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:52:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:52:17.838050 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6f0cd-dfb1-4945-b041-db26dc4c656c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:17.933009 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff6f0cd-dfb1-4945-b041-db26dc4c656c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:17.966999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d8eb9d-b0c2-41c4-b94d-e2278ecb48ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:17.967859 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8eb9d-b0c2-41c4-b94d-e2278ecb48ab None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:17.968139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8eb9d-b0c2-41c4-b94d-e2278ecb48ab None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:17.968436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d8eb9d-b0c2-41c4-b94d-e2278ecb48ab None admin] PATH_INFO: `/v3/projects/25d97d055b8f4f13bf48ce7c4a568963` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:17.969608 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8eb9d-b0c2-41c4-b94d-e2278ecb48ab None admin] RBAC: Authorizing `identity:get_project(project_id=25d97d055b8f4f13bf48ce7c4a568963)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:17.971033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d8eb9d-b0c2-41c4-b94d-e2278ecb48ab None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:17.972660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 601/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Mon Aug 1 11:52:17 2022] GET /identity/v3/projects/25d97d055b8f4f13bf48ce7c4a568963 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:17.978873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099e732-431b-4cce-8d21-174276f88c76 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:52:18.032442 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:18.075850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099e732-431b-4cce-8d21-174276f88c76 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:52:18.108329 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8e8e4e-fb9c-4774-9a42-16acc3be7fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:52:18.108873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e8e4e-fb9c-4774-9a42-16acc3be7fba None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:52:18.109674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e8e4e-fb9c-4774-9a42-16acc3be7fba None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:52:18.109946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8e8e4e-fb9c-4774-9a42-16acc3be7fba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:52:18.110721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e8e4e-fb9c-4774-9a42-16acc3be7fba None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=25d97d055b8f4f13bf48ce7c4a568963, user.id=7d19ec00f2be4787bfee298713e763e5) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:52:18.111025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e8e4e-fb9c-4774-9a42-16acc3be7fba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:52:18.112446 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8e8e4e-fb9c-4774-9a42-16acc3be7fba None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:52:18.118058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 599/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:52:17 2022] GET /identity/v3/role_assignments?user.id=7d19ec00f2be4787bfee298713e763e5&scope.project.id=25d97d055b8f4f13bf48ce7c4a568963&role.id=0195bf688a7e464e8ff594afe80b050e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:52:27.962193 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=73 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:52:28.115550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=41 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:13.298458 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31eb60-185c-4023-a3dc-d13cc55aa9b5 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:13.299095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31eb60-185c-4023-a3dc-d13cc55aa9b5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:13.299095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31eb60-185c-4023-a3dc-d13cc55aa9b5 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:13.300750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 602/1201] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:53:13.306490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6ebe8-ee11-4653-aaea-9d6ddfd812e3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:13.307101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6ebe8-ee11-4653-aaea-9d6ddfd812e3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:13.307101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6ebe8-ee11-4653-aaea-9d6ddfd812e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:13.327993 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9cb6ebe8-ee11-4653-aaea-9d6ddfd812e3 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:53:13.329360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9cb6ebe8-ee11-4653-aaea-9d6ddfd812e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:53:13.421332 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 600/1202] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:53:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:53:13.445932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31eb60-185c-4023-a3dc-d13cc55aa9b5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:13.600680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31eb60-185c-4023-a3dc-d13cc55aa9b5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:13.663717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbce14-a73d-48cd-898b-d4f886dbbef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:13.664702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbce14-a73d-48cd-898b-d4f886dbbef6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:13.665160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbce14-a73d-48cd-898b-d4f886dbbef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:13.665662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbce14-a73d-48cd-898b-d4f886dbbef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:13.683915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbce14-a73d-48cd-898b-d4f886dbbef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:13.688321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbce14-a73d-48cd-898b-d4f886dbbef6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-6abbce14-a73d-48cd-898b-d4f886dbbef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:13.706906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:13.708003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:13.708978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:13.708978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:13.708978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:13.708978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:13.708978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 603/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:13.714861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6ebe8-ee11-4653-aaea-9d6ddfd812e3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:13.860785 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6ebe8-ee11-4653-aaea-9d6ddfd812e3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:13.901376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:13.911768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83398867-2f5f-4188-a014-ae6af7840ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:13.912707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83398867-2f5f-4188-a014-ae6af7840ec4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:13.913046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83398867-2f5f-4188-a014-ae6af7840ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:13.913342 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83398867-2f5f-4188-a014-ae6af7840ec4 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:13.914938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83398867-2f5f-4188-a014-ae6af7840ec4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:13.914938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83398867-2f5f-4188-a014-ae6af7840ec4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:13.916641 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83398867-2f5f-4188-a014-ae6af7840ec4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:13.930847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 601/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:13.937641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbce14-a73d-48cd-898b-d4f886dbbef6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:14.042627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:14.101848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbce14-a73d-48cd-898b-d4f886dbbef6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:14.143698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7fcae-e484-4f43-acb6-b8af0740edf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:14.144292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7fcae-e484-4f43-acb6-b8af0740edf5 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:14.144614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7fcae-e484-4f43-acb6-b8af0740edf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:14.144849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7fcae-e484-4f43-acb6-b8af0740edf5 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:14.145685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7fcae-e484-4f43-acb6-b8af0740edf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:14.147204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7fcae-e484-4f43-acb6-b8af0740edf5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:14.181774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 604/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Mon Aug 1 11:53:13 2022] POST /identity/v3/users => generated 251 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:53:16.430636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca0e5-e91b-4c7f-b045-7f3f167bc292 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:16.431197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca0e5-e91b-4c7f-b045-7f3f167bc292 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:16.431290 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eca0e5-e91b-4c7f-b045-7f3f167bc292 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:16.432913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 602/1206] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:53:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:53:16.439962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce52712-34d4-40dd-9d06-550c16c4d601 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:16.439962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce52712-34d4-40dd-9d06-550c16c4d601 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:16.439962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce52712-34d4-40dd-9d06-550c16c4d601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:16.460503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-dce52712-34d4-40dd-9d06-550c16c4d601 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:53:16.461749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dce52712-34d4-40dd-9d06-550c16c4d601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:53:16.535847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 605/1207] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:53:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:53:16.561175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eca0e5-e91b-4c7f-b045-7f3f167bc292 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:16.692048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eca0e5-e91b-4c7f-b045-7f3f167bc292 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:16.731564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a0e51-9f60-4b2e-a2ec-b415c3292452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:16.732673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a0e51-9f60-4b2e-a2ec-b415c3292452 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:16.732952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a0e51-9f60-4b2e-a2ec-b415c3292452 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:16.733227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a0e51-9f60-4b2e-a2ec-b415c3292452 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:16.744600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a0e51-9f60-4b2e-a2ec-b415c3292452 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0f0a0e51-9f60-4b2e-a2ec-b415c3292452 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:53:16.752028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:16.753650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:16.755135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 603/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:53:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:16.757328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce52712-34d4-40dd-9d06-550c16c4d601 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:16.798232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:16.872072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce52712-34d4-40dd-9d06-550c16c4d601 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:16.906362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30311a4b-ba96-4b48-85f9-0d4069adcea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:16.907025 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311a4b-ba96-4b48-85f9-0d4069adcea6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:16.907326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311a4b-ba96-4b48-85f9-0d4069adcea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:16.907624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30311a4b-ba96-4b48-85f9-0d4069adcea6 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:16.908407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30311a4b-ba96-4b48-85f9-0d4069adcea6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:16.908712 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30311a4b-ba96-4b48-85f9-0d4069adcea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:16.910172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30311a4b-ba96-4b48-85f9-0d4069adcea6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:16.919023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 606/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:53:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:16.926341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a0e51-9f60-4b2e-a2ec-b415c3292452 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:16.982164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:17.050106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a0e51-9f60-4b2e-a2ec-b415c3292452 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:17.090663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abf0a6-c358-4afe-a2a6-291706da4cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:17.091374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf0a6-c358-4afe-a2a6-291706da4cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:17.091703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf0a6-c358-4afe-a2a6-291706da4cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:17.091999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85abf0a6-c358-4afe-a2a6-291706da4cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:17.104370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abf0a6-c358-4afe-a2a6-291706da4cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:17.106113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85abf0a6-c358-4afe-a2a6-291706da4cc1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-85abf0a6-c358-4afe-a2a6-291706da4cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:17.121279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:17.122958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:17.124008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:17.124008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:17.124008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:17.124008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:17.124008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 604/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:17.129226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30311a4b-ba96-4b48-85f9-0d4069adcea6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:17.243650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:17.246722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30311a4b-ba96-4b48-85f9-0d4069adcea6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:17.286768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dbad7-076e-42c8-bff8-7f6912c26528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:17.287401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dbad7-076e-42c8-bff8-7f6912c26528 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:17.287695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dbad7-076e-42c8-bff8-7f6912c26528 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:17.287958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748dbad7-076e-42c8-bff8-7f6912c26528 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:17.288705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748dbad7-076e-42c8-bff8-7f6912c26528 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:17.289011 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748dbad7-076e-42c8-bff8-7f6912c26528 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:17.290437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748dbad7-076e-42c8-bff8-7f6912c26528 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:17.303643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 607/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:17.310540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abf0a6-c358-4afe-a2a6-291706da4cc1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:17.436600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85abf0a6-c358-4afe-a2a6-291706da4cc1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:17.439030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:17.480532 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2c22f-006d-4433-acc0-122cb3ee091d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:17.481246 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2c22f-006d-4433-acc0-122cb3ee091d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:17.481614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2c22f-006d-4433-acc0-122cb3ee091d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:17.481964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2c22f-006d-4433-acc0-122cb3ee091d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:17.490455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2c22f-006d-4433-acc0-122cb3ee091d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:17.492063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2c22f-006d-4433-acc0-122cb3ee091d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-eda2c22f-006d-4433-acc0-122cb3ee091d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:53:17.508101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:17.509262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:17.510552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:17.510552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:17.510552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:53:17.510552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:53:17.510552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:53:17.510552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:53:17.510552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:53:17.510552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:53:17.510552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 11:53:17.510552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:17.510552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 605/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:17.516359 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dbad7-076e-42c8-bff8-7f6912c26528 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:17.637079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748dbad7-076e-42c8-bff8-7f6912c26528 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:17.677798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10411a3-1974-4e4b-bd2f-ad1a61c0a8e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:17.678391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10411a3-1974-4e4b-bd2f-ad1a61c0a8e7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:17.678709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10411a3-1974-4e4b-bd2f-ad1a61c0a8e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:17.679040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10411a3-1974-4e4b-bd2f-ad1a61c0a8e7 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:17.679991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10411a3-1974-4e4b-bd2f-ad1a61c0a8e7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:17.680343 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10411a3-1974-4e4b-bd2f-ad1a61c0a8e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:17.682046 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10411a3-1974-4e4b-bd2f-ad1a61c0a8e7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:17.707495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 608/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Aug 1 11:53:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:17.714202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2c22f-006d-4433-acc0-122cb3ee091d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:17.843832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2c22f-006d-4433-acc0-122cb3ee091d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:17.883548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bef5c-c529-4c5a-bdda-16573aaed8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:17.884247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bef5c-c529-4c5a-bdda-16573aaed8ab None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:17.884535 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bef5c-c529-4c5a-bdda-16573aaed8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:17.884904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bef5c-c529-4c5a-bdda-16573aaed8ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:17.916048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:17.955317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bef5c-c529-4c5a-bdda-16573aaed8ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:17.956784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bef5c-c529-4c5a-bdda-16573aaed8ab None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:18.087328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 606/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:53:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:53:18.094223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10411a3-1974-4e4b-bd2f-ad1a61c0a8e7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:18.119426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:18.219100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10411a3-1974-4e4b-bd2f-ad1a61c0a8e7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:18.258178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a9a05-5797-4e5c-93a5-a1d936c04b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:18.258877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a9a05-5797-4e5c-93a5-a1d936c04b3f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:18.259397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a9a05-5797-4e5c-93a5-a1d936c04b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:18.259537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734a9a05-5797-4e5c-93a5-a1d936c04b3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:18.270608 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a9a05-5797-4e5c-93a5-a1d936c04b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:18.272070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734a9a05-5797-4e5c-93a5-a1d936c04b3f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-734a9a05-5797-4e5c-93a5-a1d936c04b3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:18.289224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:18.291300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:18.292207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:18.292207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:18.292207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:18.292207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:18.297333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 609/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:18.297525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bef5c-c529-4c5a-bdda-16573aaed8ab None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:18.382278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:18.436125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bef5c-c529-4c5a-bdda-16573aaed8ab None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:18.474669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e00c9c-dbb9-4137-9f22-acce81bd3973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:18.475411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e00c9c-dbb9-4137-9f22-acce81bd3973 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:18.475656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e00c9c-dbb9-4137-9f22-acce81bd3973 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:18.475856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e00c9c-dbb9-4137-9f22-acce81bd3973 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:18.476968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e00c9c-dbb9-4137-9f22-acce81bd3973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:18.477383 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e00c9c-dbb9-4137-9f22-acce81bd3973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:18.478852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e00c9c-dbb9-4137-9f22-acce81bd3973 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:18.494144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 607/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:18.500425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a9a05-5797-4e5c-93a5-a1d936c04b3f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:18.583607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:18.626756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734a9a05-5797-4e5c-93a5-a1d936c04b3f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:18.668117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c1efe-9053-4db4-98ce-61ff74dc8dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:18.669151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1efe-9053-4db4-98ce-61ff74dc8dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:18.670113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1efe-9053-4db4-98ce-61ff74dc8dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:18.670388 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c1efe-9053-4db4-98ce-61ff74dc8dd8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:18.677965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c1efe-9053-4db4-98ce-61ff74dc8dd8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:18.679461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924c1efe-9053-4db4-98ce-61ff74dc8dd8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-924c1efe-9053-4db4-98ce-61ff74dc8dd8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:53:18.691032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:18.691985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:18.697822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:53:18.697822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:53:18.697822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:53:18.697822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:53:18.697822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:53:18.697822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:53:18.697822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:53:18.697822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:18.697822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 610/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:53:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:18.698343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e00c9c-dbb9-4137-9f22-acce81bd3973 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:18.829595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e00c9c-dbb9-4137-9f22-acce81bd3973 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:18.855789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:18.869157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72acde1-6639-4bb8-8a7c-9f3cd15e9a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:18.869799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72acde1-6639-4bb8-8a7c-9f3cd15e9a2c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:18.870079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72acde1-6639-4bb8-8a7c-9f3cd15e9a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:18.870346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72acde1-6639-4bb8-8a7c-9f3cd15e9a2c None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:18.871085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72acde1-6639-4bb8-8a7c-9f3cd15e9a2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:18.871387 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72acde1-6639-4bb8-8a7c-9f3cd15e9a2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:18.873201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72acde1-6639-4bb8-8a7c-9f3cd15e9a2c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:18.888704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 608/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:53:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:18.894439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c1efe-9053-4db4-98ce-61ff74dc8dd8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:19.032446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c1efe-9053-4db4-98ce-61ff74dc8dd8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:19.064297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:19.070503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38bd11-53b8-4951-80f1-9575716f69cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:19.071161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38bd11-53b8-4951-80f1-9575716f69cb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:19.071668 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38bd11-53b8-4951-80f1-9575716f69cb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:19.072144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38bd11-53b8-4951-80f1-9575716f69cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:19.073069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38bd11-53b8-4951-80f1-9575716f69cb None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=35b5e545d75d40d0abb9c8d996e3b4a0) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:19.073593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38bd11-53b8-4951-80f1-9575716f69cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:19.075112 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38bd11-53b8-4951-80f1-9575716f69cb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:19.089357 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 611/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:53:18 2022] GET /identity/v3/role_assignments?user.id=35b5e545d75d40d0abb9c8d996e3b4a0&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:53:21.134321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d44879-492f-4938-8be7-eb40f3e17f15 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:21.134869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d44879-492f-4938-8be7-eb40f3e17f15 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:21.134869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d44879-492f-4938-8be7-eb40f3e17f15 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:21.136175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 609/1220] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:53:21.142470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cce85-c9a8-405f-8599-8b712414430a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:21.143008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cce85-c9a8-405f-8599-8b712414430a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:21.143130 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64cce85-c9a8-405f-8599-8b712414430a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:21.163498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f64cce85-c9a8-405f-8599-8b712414430a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:53:21.164709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f64cce85-c9a8-405f-8599-8b712414430a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:53:21.245568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 612/1221] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:53:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:53:21.268805 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d44879-492f-4938-8be7-eb40f3e17f15 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:21.394361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d44879-492f-4938-8be7-eb40f3e17f15 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:21.436498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15e11-fdda-441e-8218-76b1445449e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:21.436498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15e11-fdda-441e-8218-76b1445449e5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:21.436848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15e11-fdda-441e-8218-76b1445449e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:21.437058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b15e11-fdda-441e-8218-76b1445449e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:21.448767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b15e11-fdda-441e-8218-76b1445449e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-47b15e11-fdda-441e-8218-76b1445449e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:53:21.454370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:21.455625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:21.456552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 610/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:53:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:21.462129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cce85-c9a8-405f-8599-8b712414430a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:21.577413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64cce85-c9a8-405f-8599-8b712414430a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:21.604212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:21.617142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c2999-4705-4c55-b18a-42be915087e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:21.617795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2999-4705-4c55-b18a-42be915087e5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:21.618075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2999-4705-4c55-b18a-42be915087e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:21.618350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c2999-4705-4c55-b18a-42be915087e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:21.619064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c2999-4705-4c55-b18a-42be915087e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:21.619371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c2999-4705-4c55-b18a-42be915087e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:21.620845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c2999-4705-4c55-b18a-42be915087e5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:21.635087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 613/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:53:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:21.636427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15e11-fdda-441e-8218-76b1445449e5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:21.685575 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:21.743584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b15e11-fdda-441e-8218-76b1445449e5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:21.780759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567e2cc-5355-4988-a1b2-5a6afd226cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:21.781419 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567e2cc-5355-4988-a1b2-5a6afd226cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:21.781695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567e2cc-5355-4988-a1b2-5a6afd226cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:21.781963 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9567e2cc-5355-4988-a1b2-5a6afd226cd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:21.792796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567e2cc-5355-4988-a1b2-5a6afd226cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:21.794528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9567e2cc-5355-4988-a1b2-5a6afd226cd4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-9567e2cc-5355-4988-a1b2-5a6afd226cd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:21.810892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:21.811954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:21.813212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:21.813212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:21.813212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:21.813212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:21.813212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 611/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:21.818021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c2999-4705-4c55-b18a-42be915087e5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:21.921565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c2999-4705-4c55-b18a-42be915087e5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:21.955994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00ad67-f222-4ee8-8b9a-ac0ba019741d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:21.956436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00ad67-f222-4ee8-8b9a-ac0ba019741d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:21.956715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00ad67-f222-4ee8-8b9a-ac0ba019741d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:21.956984 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00ad67-f222-4ee8-8b9a-ac0ba019741d None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:21.957708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00ad67-f222-4ee8-8b9a-ac0ba019741d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:21.958027 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00ad67-f222-4ee8-8b9a-ac0ba019741d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:21.959367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00ad67-f222-4ee8-8b9a-ac0ba019741d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:21.971967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 614/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:21.978156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567e2cc-5355-4988-a1b2-5a6afd226cd4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:22.092254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:22.099671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9567e2cc-5355-4988-a1b2-5a6afd226cd4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:22.138647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c39ec9-a1f7-442e-8505-c2f6d6552b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:22.139431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39ec9-a1f7-442e-8505-c2f6d6552b4f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:22.139855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39ec9-a1f7-442e-8505-c2f6d6552b4f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:22.140252 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c39ec9-a1f7-442e-8505-c2f6d6552b4f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:22.148697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c39ec9-a1f7-442e-8505-c2f6d6552b4f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:22.150229 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c39ec9-a1f7-442e-8505-c2f6d6552b4f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-02c39ec9-a1f7-442e-8505-c2f6d6552b4f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:53:22.161489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:22.162597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:22.163581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:22.163581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:22.163581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:53:22.163581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:53:22.163581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:53:22.163581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:53:22.163581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:53:22.163581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:53:22.163581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 11:53:22.163581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:22.163581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 612/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:22.169750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00ad67-f222-4ee8-8b9a-ac0ba019741d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:22.223304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:22.281473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00ad67-f222-4ee8-8b9a-ac0ba019741d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:22.319204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71639630-5921-41ef-a951-a05b8ed3d755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:22.319854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71639630-5921-41ef-a951-a05b8ed3d755 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:22.320169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71639630-5921-41ef-a951-a05b8ed3d755 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:22.320474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71639630-5921-41ef-a951-a05b8ed3d755 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:22.321354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71639630-5921-41ef-a951-a05b8ed3d755 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:22.321669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71639630-5921-41ef-a951-a05b8ed3d755 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:22.323236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71639630-5921-41ef-a951-a05b8ed3d755 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:22.343057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 615/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Aug 1 11:53:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:53:22.349160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c39ec9-a1f7-442e-8505-c2f6d6552b4f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:22.457318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c39ec9-a1f7-442e-8505-c2f6d6552b4f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:22.496676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217bf5b-3fe5-461d-a5cb-8051508267c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:22.497496 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217bf5b-3fe5-461d-a5cb-8051508267c0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:22.497857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217bf5b-3fe5-461d-a5cb-8051508267c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:22.498114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217bf5b-3fe5-461d-a5cb-8051508267c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:22.509924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217bf5b-3fe5-461d-a5cb-8051508267c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:22.511528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217bf5b-3fe5-461d-a5cb-8051508267c0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-3217bf5b-3fe5-461d-a5cb-8051508267c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:22.527955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:22.529675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:22.530876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:22.530876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:22.530876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:22.530876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:22.534919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 613/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:22.535744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71639630-5921-41ef-a951-a05b8ed3d755 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:22.647429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71639630-5921-41ef-a951-a05b8ed3d755 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:22.649802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:22.683003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0d382-1cbc-451c-824f-d5242131400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:22.683628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0d382-1cbc-451c-824f-d5242131400f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:22.683899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0d382-1cbc-451c-824f-d5242131400f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:22.684211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d0d382-1cbc-451c-824f-d5242131400f None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:22.685483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0d382-1cbc-451c-824f-d5242131400f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:22.685828 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0d382-1cbc-451c-824f-d5242131400f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:22.687281 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d0d382-1cbc-451c-824f-d5242131400f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:22.699747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 616/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:22.706994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217bf5b-3fe5-461d-a5cb-8051508267c0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:22.716974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:22.823316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217bf5b-3fe5-461d-a5cb-8051508267c0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:22.862060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e68a0-215d-47ad-a348-141715e1d006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:22.863070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e68a0-215d-47ad-a348-141715e1d006 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:22.863389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e68a0-215d-47ad-a348-141715e1d006 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:22.863677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e68a0-215d-47ad-a348-141715e1d006 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:22.870703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e68a0-215d-47ad-a348-141715e1d006 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:22.872205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e68a0-215d-47ad-a348-141715e1d006 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6b7e68a0-215d-47ad-a348-141715e1d006 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:53:22.884060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:22.885166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:22.886363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:53:22.886363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:53:22.886363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:53:22.886363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:53:22.886363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:53:22.886363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:53:22.886363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:53:22.886363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:22.891421 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 614/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:53:22.893424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0d382-1cbc-451c-824f-d5242131400f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:23.017973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d0d382-1cbc-451c-824f-d5242131400f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:23.055515 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a78b05-1135-48e7-b7f3-4e045c586515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:23.056347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a78b05-1135-48e7-b7f3-4e045c586515 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:23.056696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a78b05-1135-48e7-b7f3-4e045c586515 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:23.057094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a78b05-1135-48e7-b7f3-4e045c586515 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:23.058035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a78b05-1135-48e7-b7f3-4e045c586515 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:23.058369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a78b05-1135-48e7-b7f3-4e045c586515 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:23.060362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a78b05-1135-48e7-b7f3-4e045c586515 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:23.076809 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 617/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:23.092600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e68a0-215d-47ad-a348-141715e1d006 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:23.166836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:23.204182 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e68a0-215d-47ad-a348-141715e1d006 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:23.240662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e228f-6e05-4844-8ec6-8fe1e34542bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:23.241896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e228f-6e05-4844-8ec6-8fe1e34542bc None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:23.241896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e228f-6e05-4844-8ec6-8fe1e34542bc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:23.241896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e228f-6e05-4844-8ec6-8fe1e34542bc None admin] PATH_INFO: `/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/35b5e545d75d40d0abb9c8d996e3b4a0/roles/17e82eb8c8384f43a591d08c9cf1f63e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:23.257083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e228f-6e05-4844-8ec6-8fe1e34542bc None admin] RBAC: Authorizing `identity:create_grant(project_id=99857fcf20fd4cb8b7def2bc2de521bc, user_id=35b5e545d75d40d0abb9c8d996e3b4a0, role_id=17e82eb8c8384f43a591d08c9cf1f63e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:23.258566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e228f-6e05-4844-8ec6-8fe1e34542bc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:23.272423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 615/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:53:23 2022] PUT /identity/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/35b5e545d75d40d0abb9c8d996e3b4a0/roles/17e82eb8c8384f43a591d08c9cf1f63e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:53:25.305111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256281d-34a3-457f-b4b6-cfaf66aa192f None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:25.305568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256281d-34a3-457f-b4b6-cfaf66aa192f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:25.305692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256281d-34a3-457f-b4b6-cfaf66aa192f None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:25.307056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 618/1233] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:53:25.313259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774779f-120d-429e-83b8-15fa600fa1e2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:25.313838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774779f-120d-429e-83b8-15fa600fa1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:25.313987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7774779f-120d-429e-83b8-15fa600fa1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:25.335393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7774779f-120d-429e-83b8-15fa600fa1e2 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:53:25.336652 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7774779f-120d-429e-83b8-15fa600fa1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:53:25.408287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 616/1234] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:53:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:53:25.431142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256281d-34a3-457f-b4b6-cfaf66aa192f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:25.458756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:25.536813 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9256281d-34a3-457f-b4b6-cfaf66aa192f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:25.573784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2785730-ea4c-4dff-ab47-260d4f691b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:25.574557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785730-ea4c-4dff-ab47-260d4f691b96 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:25.574802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785730-ea4c-4dff-ab47-260d4f691b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:25.575121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2785730-ea4c-4dff-ab47-260d4f691b96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:25.586249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2785730-ea4c-4dff-ab47-260d4f691b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-a2785730-ea4c-4dff-ab47-260d4f691b96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:53:25.591866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:25.593007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:25.594073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 619/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Mon Aug 1 11:53:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:25.599392 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774779f-120d-429e-83b8-15fa600fa1e2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:25.648180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:25.706059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7774779f-120d-429e-83b8-15fa600fa1e2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:25.743908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872b19b-95f6-4476-a012-09d8086a71d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:25.744724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872b19b-95f6-4476-a012-09d8086a71d3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:25.744976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872b19b-95f6-4476-a012-09d8086a71d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:25.745368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5872b19b-95f6-4476-a012-09d8086a71d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:25.746087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872b19b-95f6-4476-a012-09d8086a71d3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:25.746400 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872b19b-95f6-4476-a012-09d8086a71d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:25.747891 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5872b19b-95f6-4476-a012-09d8086a71d3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:25.755924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 617/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Mon Aug 1 11:53:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:25.761866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2785730-ea4c-4dff-ab47-260d4f691b96 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:25.853289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:25.870406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2785730-ea4c-4dff-ab47-260d4f691b96 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:25.909418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb056793-36c9-4e58-8884-31a1efd43a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:25.910062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb056793-36c9-4e58-8884-31a1efd43a65 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:25.910338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb056793-36c9-4e58-8884-31a1efd43a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:25.910615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb056793-36c9-4e58-8884-31a1efd43a65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:25.922735 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb056793-36c9-4e58-8884-31a1efd43a65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:25.924286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb056793-36c9-4e58-8884-31a1efd43a65 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-fb056793-36c9-4e58-8884-31a1efd43a65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:25.939768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:25.940955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:25.942067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:25.942067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:25.942067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:25.942067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:25.942067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 620/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:25.946716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872b19b-95f6-4476-a012-09d8086a71d3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:26.058225 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5872b19b-95f6-4476-a012-09d8086a71d3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:26.067446 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:26.094125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcc5eb-6ce4-4217-9d2a-2ae7a13770ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:26.094738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcc5eb-6ce4-4217-9d2a-2ae7a13770ed None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:26.095018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcc5eb-6ce4-4217-9d2a-2ae7a13770ed None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:26.095289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdcc5eb-6ce4-4217-9d2a-2ae7a13770ed None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:26.095975 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcc5eb-6ce4-4217-9d2a-2ae7a13770ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:26.096278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcc5eb-6ce4-4217-9d2a-2ae7a13770ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:26.097717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdcc5eb-6ce4-4217-9d2a-2ae7a13770ed None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:26.109870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 618/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:26.115425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb056793-36c9-4e58-8884-31a1efd43a65 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:26.224181 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb056793-36c9-4e58-8884-31a1efd43a65 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:26.264154 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea666665-3710-4b63-b7f9-35a6c8c56372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:26.264868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea666665-3710-4b63-b7f9-35a6c8c56372 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:26.265201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea666665-3710-4b63-b7f9-35a6c8c56372 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:26.265534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea666665-3710-4b63-b7f9-35a6c8c56372 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:26.268377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:26.274636 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea666665-3710-4b63-b7f9-35a6c8c56372 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:26.276507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea666665-3710-4b63-b7f9-35a6c8c56372 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-ea666665-3710-4b63-b7f9-35a6c8c56372 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:53:26.290028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:26.291225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:26.292470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:26.292470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:26.292470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:53:26.292470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:53:26.292470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:53:26.292470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:53:26.292470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:53:26.292470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:53:26.292470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 11:53:26.292470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:26.292470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 621/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:26.297702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcc5eb-6ce4-4217-9d2a-2ae7a13770ed None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:26.411721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdcc5eb-6ce4-4217-9d2a-2ae7a13770ed None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:26.452174 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff84a4-478c-4cf2-bfd0-d39ca3c8fdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:26.452971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff84a4-478c-4cf2-bfd0-d39ca3c8fdb9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:26.453283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff84a4-478c-4cf2-bfd0-d39ca3c8fdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:26.453625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dff84a4-478c-4cf2-bfd0-d39ca3c8fdb9 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:26.454412 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff84a4-478c-4cf2-bfd0-d39ca3c8fdb9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:26.454902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff84a4-478c-4cf2-bfd0-d39ca3c8fdb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:26.456325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dff84a4-478c-4cf2-bfd0-d39ca3c8fdb9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:26.476095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 619/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Aug 1 11:53:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:26.482802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea666665-3710-4b63-b7f9-35a6c8c56372 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:26.599554 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea666665-3710-4b63-b7f9-35a6c8c56372 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:26.635824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fe878-1823-4d4d-af84-255e25e05603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:26.636866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fe878-1823-4d4d-af84-255e25e05603 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:26.637413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fe878-1823-4d4d-af84-255e25e05603 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:26.637919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6fe878-1823-4d4d-af84-255e25e05603 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:26.702751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:26.709759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fe878-1823-4d4d-af84-255e25e05603 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:26.711209 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6fe878-1823-4d4d-af84-255e25e05603 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:26.824135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 622/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:53:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:53:26.830837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff84a4-478c-4cf2-bfd0-d39ca3c8fdb9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:26.866569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:26.963514 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dff84a4-478c-4cf2-bfd0-d39ca3c8fdb9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:27.002945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e08f1-66e0-4e2b-96a9-bdc723d8811b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:27.003620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e08f1-66e0-4e2b-96a9-bdc723d8811b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:27.003906 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e08f1-66e0-4e2b-96a9-bdc723d8811b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:27.004242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243e08f1-66e0-4e2b-96a9-bdc723d8811b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:27.015811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e08f1-66e0-4e2b-96a9-bdc723d8811b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:27.017338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243e08f1-66e0-4e2b-96a9-bdc723d8811b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-243e08f1-66e0-4e2b-96a9-bdc723d8811b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:27.033974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:27.035345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:27.036467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:27.036467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:27.036467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:27.036467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:27.040202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 620/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:27.041639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fe878-1823-4d4d-af84-255e25e05603 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:27.142720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:27.151061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6fe878-1823-4d4d-af84-255e25e05603 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:27.193268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13cdaa-0fe3-402a-86ee-2a3ab4b311cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:27.193919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cdaa-0fe3-402a-86ee-2a3ab4b311cb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:27.194198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cdaa-0fe3-402a-86ee-2a3ab4b311cb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:27.196087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb13cdaa-0fe3-402a-86ee-2a3ab4b311cb None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:27.196087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13cdaa-0fe3-402a-86ee-2a3ab4b311cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:27.196087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13cdaa-0fe3-402a-86ee-2a3ab4b311cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:27.196825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb13cdaa-0fe3-402a-86ee-2a3ab4b311cb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:27.209016 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 623/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:27.216762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e08f1-66e0-4e2b-96a9-bdc723d8811b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:27.305927 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:27.330022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243e08f1-66e0-4e2b-96a9-bdc723d8811b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:27.366777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a60ebd-4556-4b23-8859-4f4cedbb9c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:27.367564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a60ebd-4556-4b23-8859-4f4cedbb9c5b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:27.367956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a60ebd-4556-4b23-8859-4f4cedbb9c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:27.368372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a60ebd-4556-4b23-8859-4f4cedbb9c5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:27.378054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a60ebd-4556-4b23-8859-4f4cedbb9c5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:27.379611 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a60ebd-4556-4b23-8859-4f4cedbb9c5b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d2a60ebd-4556-4b23-8859-4f4cedbb9c5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:53:27.395310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:27.396486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:27.397817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:53:27.397817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:53:27.397817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:53:27.397817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:53:27.397817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:53:27.397817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:53:27.397817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:53:27.397817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:27.397817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 621/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:53:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:27.403907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13cdaa-0fe3-402a-86ee-2a3ab4b311cb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:27.533267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb13cdaa-0fe3-402a-86ee-2a3ab4b311cb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:27.568061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbb8a3-0787-41e0-9070-47e71a7ce63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:27.568672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbb8a3-0787-41e0-9070-47e71a7ce63a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:27.568952 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbb8a3-0787-41e0-9070-47e71a7ce63a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:27.569219 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbb8a3-0787-41e0-9070-47e71a7ce63a None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:27.569991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbb8a3-0787-41e0-9070-47e71a7ce63a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:27.570293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbb8a3-0787-41e0-9070-47e71a7ce63a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:27.571718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbb8a3-0787-41e0-9070-47e71a7ce63a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:27.583730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 624/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:53:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:27.590532 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a60ebd-4556-4b23-8859-4f4cedbb9c5b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:27.696915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a60ebd-4556-4b23-8859-4f4cedbb9c5b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:27.732350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4209c051-3db3-45f9-b855-2f4217d61bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:27.732971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209c051-3db3-45f9-b855-2f4217d61bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:27.733251 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209c051-3db3-45f9-b855-2f4217d61bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:27.733584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4209c051-3db3-45f9-b855-2f4217d61bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:27.734341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209c051-3db3-45f9-b855-2f4217d61bb9 None admin] RBAC: Adding query filter params (role.id=17e82eb8c8384f43a591d08c9cf1f63e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=35b5e545d75d40d0abb9c8d996e3b4a0) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:27.734673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209c051-3db3-45f9-b855-2f4217d61bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:27.736120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4209c051-3db3-45f9-b855-2f4217d61bb9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:27.742302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 622/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:53:27 2022] GET /identity/v3/role_assignments?user.id=35b5e545d75d40d0abb9c8d996e3b4a0&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=17e82eb8c8384f43a591d08c9cf1f63e => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:30.093571 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ed9e5-a4c0-427c-b742-d701af5957ff None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:30.094103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ed9e5-a4c0-427c-b742-d701af5957ff None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:30.094103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271ed9e5-a4c0-427c-b742-d701af5957ff None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:30.095462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 625/1247] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:53:30.101978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6494a-dee2-4036-aa41-be504cdbbab5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:30.102440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6494a-dee2-4036-aa41-be504cdbbab5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:30.102545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f6494a-dee2-4036-aa41-be504cdbbab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:30.112290 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:30.126099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-17f6494a-dee2-4036-aa41-be504cdbbab5 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:53:30.127370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-17f6494a-dee2-4036-aa41-be504cdbbab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:53:30.205804 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 623/1248] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:53:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:53:30.229711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ed9e5-a4c0-427c-b742-d701af5957ff None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:30.249205 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:30.341594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271ed9e5-a4c0-427c-b742-d701af5957ff None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:30.382038 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef69b96-82f0-41d1-9ad5-48c8baccc6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:30.382599 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef69b96-82f0-41d1-9ad5-48c8baccc6c7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:30.382872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef69b96-82f0-41d1-9ad5-48c8baccc6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:30.383145 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef69b96-82f0-41d1-9ad5-48c8baccc6c7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:30.395943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef69b96-82f0-41d1-9ad5-48c8baccc6c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-6ef69b96-82f0-41d1-9ad5-48c8baccc6c7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:53:30.401842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:30.403764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:30.404823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 626/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:53:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:53:30.409446 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6494a-dee2-4036-aa41-be504cdbbab5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:30.521869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f6494a-dee2-4036-aa41-be504cdbbab5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:30.559139 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:30.566043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76165ccc-935f-4bb0-84ab-4d9a6d8c27f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:30.566674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76165ccc-935f-4bb0-84ab-4d9a6d8c27f0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:30.566951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76165ccc-935f-4bb0-84ab-4d9a6d8c27f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:30.567220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76165ccc-935f-4bb0-84ab-4d9a6d8c27f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:30.567983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76165ccc-935f-4bb0-84ab-4d9a6d8c27f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:30.568286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76165ccc-935f-4bb0-84ab-4d9a6d8c27f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:30.569701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76165ccc-935f-4bb0-84ab-4d9a6d8c27f0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:30.579239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 624/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:53:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:30.585378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef69b96-82f0-41d1-9ad5-48c8baccc6c7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:30.673436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:30.699233 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef69b96-82f0-41d1-9ad5-48c8baccc6c7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:30.740750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12654a3c-df2f-4e1d-86e5-52b251a0a7c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:30.741636 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654a3c-df2f-4e1d-86e5-52b251a0a7c0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:30.742078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654a3c-df2f-4e1d-86e5-52b251a0a7c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:30.742558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12654a3c-df2f-4e1d-86e5-52b251a0a7c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:30.757399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12654a3c-df2f-4e1d-86e5-52b251a0a7c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:30.758856 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12654a3c-df2f-4e1d-86e5-52b251a0a7c0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-12654a3c-df2f-4e1d-86e5-52b251a0a7c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:30.777419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:30.778579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:30.779732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:30.779732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:30.779732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:30.779732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:30.779732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 627/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:30.785696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76165ccc-935f-4bb0-84ab-4d9a6d8c27f0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:30.895336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76165ccc-935f-4bb0-84ab-4d9a6d8c27f0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:30.932404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80267cb4-7108-4f85-b675-331053f5356f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:30.933199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80267cb4-7108-4f85-b675-331053f5356f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:30.933523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80267cb4-7108-4f85-b675-331053f5356f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:30.933797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80267cb4-7108-4f85-b675-331053f5356f None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:30.935104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80267cb4-7108-4f85-b675-331053f5356f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:30.935426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80267cb4-7108-4f85-b675-331053f5356f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:30.936872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80267cb4-7108-4f85-b675-331053f5356f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:30.950707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 625/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:30.956926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12654a3c-df2f-4e1d-86e5-52b251a0a7c0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:31.108139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12654a3c-df2f-4e1d-86e5-52b251a0a7c0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:31.144935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:31.156650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff889c07-ae18-411d-963c-128ce941ea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:31.157748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff889c07-ae18-411d-963c-128ce941ea9c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:31.158213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff889c07-ae18-411d-963c-128ce941ea9c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:31.158581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff889c07-ae18-411d-963c-128ce941ea9c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:31.169940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff889c07-ae18-411d-963c-128ce941ea9c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:31.171405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff889c07-ae18-411d-963c-128ce941ea9c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-ff889c07-ae18-411d-963c-128ce941ea9c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:53:31.184355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:31.185519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:31.186531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:31.186531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:31.186531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:53:31.186531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:53:31.186531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:53:31.186531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:53:31.186531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:53:31.186531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:53:31.186531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 11:53:31.186531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:31.186531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 628/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:31.191955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80267cb4-7108-4f85-b675-331053f5356f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:31.259969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:31.311033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80267cb4-7108-4f85-b675-331053f5356f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:31.352482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174a1d4-6efc-4b71-be0d-2abb81c86579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:31.353179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174a1d4-6efc-4b71-be0d-2abb81c86579 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:31.353535 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174a1d4-6efc-4b71-be0d-2abb81c86579 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:31.353804 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c174a1d4-6efc-4b71-be0d-2abb81c86579 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:31.354719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174a1d4-6efc-4b71-be0d-2abb81c86579 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:31.355022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174a1d4-6efc-4b71-be0d-2abb81c86579 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:31.357280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c174a1d4-6efc-4b71-be0d-2abb81c86579 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:31.378175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 626/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Aug 1 11:53:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:31.385347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff889c07-ae18-411d-963c-128ce941ea9c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:31.498166 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff889c07-ae18-411d-963c-128ce941ea9c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:31.532602 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621e515-dcd1-4f1f-b4f0-f94909c26881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:31.533227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621e515-dcd1-4f1f-b4f0-f94909c26881 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:31.533572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621e515-dcd1-4f1f-b4f0-f94909c26881 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:31.533829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6621e515-dcd1-4f1f-b4f0-f94909c26881 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:31.595314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:31.611477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621e515-dcd1-4f1f-b4f0-f94909c26881 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:31.612935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6621e515-dcd1-4f1f-b4f0-f94909c26881 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:31.714034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 629/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:53:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 11:53:31.720079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174a1d4-6efc-4b71-be0d-2abb81c86579 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:31.834037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c174a1d4-6efc-4b71-be0d-2abb81c86579 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:31.849856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:31.876610 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47f1e5-c5ad-47be-8c7d-4fc6e359769f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:31.877258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47f1e5-c5ad-47be-8c7d-4fc6e359769f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:31.877565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47f1e5-c5ad-47be-8c7d-4fc6e359769f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:31.877837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47f1e5-c5ad-47be-8c7d-4fc6e359769f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:31.890223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47f1e5-c5ad-47be-8c7d-4fc6e359769f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:31.891782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47f1e5-c5ad-47be-8c7d-4fc6e359769f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-3e47f1e5-c5ad-47be-8c7d-4fc6e359769f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:31.907763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:31.909330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:31.910494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:31.910494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:31.910494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:31.910494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:31.910494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 627/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 11:53:31.914922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621e515-dcd1-4f1f-b4f0-f94909c26881 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:32.016536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:32.030711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6621e515-dcd1-4f1f-b4f0-f94909c26881 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:32.074861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5142b-568c-449d-abb2-945d31003199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:32.075533 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5142b-568c-449d-abb2-945d31003199 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:32.075803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5142b-568c-449d-abb2-945d31003199 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:32.076075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff5142b-568c-449d-abb2-945d31003199 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:32.076761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5142b-568c-449d-abb2-945d31003199 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:32.077058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5142b-568c-449d-abb2-945d31003199 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:32.078610 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff5142b-568c-449d-abb2-945d31003199 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:32.096185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 630/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:32.097354 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47f1e5-c5ad-47be-8c7d-4fc6e359769f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:32.197967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47f1e5-c5ad-47be-8c7d-4fc6e359769f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:32.234681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a135f-218e-469d-9667-ecc12fc8d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:32.235422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a135f-218e-469d-9667-ecc12fc8d6e6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:32.235711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a135f-218e-469d-9667-ecc12fc8d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:32.235982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284a135f-218e-469d-9667-ecc12fc8d6e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:32.243077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a135f-218e-469d-9667-ecc12fc8d6e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:32.244674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284a135f-218e-469d-9667-ecc12fc8d6e6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-284a135f-218e-469d-9667-ecc12fc8d6e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:53:32.257065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:32.263624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:32.264719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:53:32.264719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:53:32.264719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:53:32.264719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:53:32.264719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:53:32.264719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:53:32.264719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:53:32.264719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:32.264719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 628/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:53:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:32.265212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5142b-568c-449d-abb2-945d31003199 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:32.381473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff5142b-568c-449d-abb2-945d31003199 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:32.417370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc1cc27-9393-4308-9cea-0863a227a977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:32.418095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1cc27-9393-4308-9cea-0863a227a977 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:32.418374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1cc27-9393-4308-9cea-0863a227a977 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:32.418646 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc1cc27-9393-4308-9cea-0863a227a977 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:32.419410 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1cc27-9393-4308-9cea-0863a227a977 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:32.419700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1cc27-9393-4308-9cea-0863a227a977 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:32.421145 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc1cc27-9393-4308-9cea-0863a227a977 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:32.434305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 631/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:53:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 11:53:32.440526 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a135f-218e-469d-9667-ecc12fc8d6e6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:32.468347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:32.551097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284a135f-218e-469d-9667-ecc12fc8d6e6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:32.587115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e0085f-c31e-47d6-b2bf-bf3bf9f03e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:32.587712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0085f-c31e-47d6-b2bf-bf3bf9f03e28 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:32.587989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0085f-c31e-47d6-b2bf-bf3bf9f03e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:32.588258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e0085f-c31e-47d6-b2bf-bf3bf9f03e28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:32.589038 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0085f-c31e-47d6-b2bf-bf3bf9f03e28 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=35b5e545d75d40d0abb9c8d996e3b4a0) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:32.589370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0085f-c31e-47d6-b2bf-bf3bf9f03e28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:32.591204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e0085f-c31e-47d6-b2bf-bf3bf9f03e28 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:32.603341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 629/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:53:32 2022] GET /identity/v3/role_assignments?user.id=35b5e545d75d40d0abb9c8d996e3b4a0&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=0195bf688a7e464e8ff594afe80b050e => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:34.685327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43d744-0699-4848-93af-e3a27824aa39 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:34.685831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43d744-0699-4848-93af-e3a27824aa39 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:34.685831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43d744-0699-4848-93af-e3a27824aa39 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:34.687113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 632/1261] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:53:34.692087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c51d2-3f26-4e95-a656-435d91ae3ad9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:34.692469 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c51d2-3f26-4e95-a656-435d91ae3ad9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:34.692670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51c51d2-3f26-4e95-a656-435d91ae3ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:34.710791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a51c51d2-3f26-4e95-a656-435d91ae3ad9 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:53:34.711972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a51c51d2-3f26-4e95-a656-435d91ae3ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:53:34.776071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 630/1262] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:53:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:53:34.797834 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43d744-0699-4848-93af-e3a27824aa39 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:34.808355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:34.895521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43d744-0699-4848-93af-e3a27824aa39 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:34.927526 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0195c-a901-4dda-b007-0dc114663bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:34.928133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0195c-a901-4dda-b007-0dc114663bdc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:34.928405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0195c-a901-4dda-b007-0dc114663bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:34.928668 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a0195c-a901-4dda-b007-0dc114663bdc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:34.938769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a0195c-a901-4dda-b007-0dc114663bdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-51a0195c-a901-4dda-b007-0dc114663bdc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:53:34.943492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:34.944604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:34.945874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 633/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:53:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:34.951077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c51d2-3f26-4e95-a656-435d91ae3ad9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:34.968842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:35.057456 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51c51d2-3f26-4e95-a656-435d91ae3ad9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:35.090202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2462868-adfb-4ed0-9a43-38243a7a7e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:35.091308 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2462868-adfb-4ed0-9a43-38243a7a7e97 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:35.091584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2462868-adfb-4ed0-9a43-38243a7a7e97 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:35.091850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2462868-adfb-4ed0-9a43-38243a7a7e97 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:35.092549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2462868-adfb-4ed0-9a43-38243a7a7e97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:35.092845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2462868-adfb-4ed0-9a43-38243a7a7e97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:35.094236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2462868-adfb-4ed0-9a43-38243a7a7e97 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:35.102286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 631/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:53:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:35.108710 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0195c-a901-4dda-b007-0dc114663bdc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:35.173338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:35.209812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a0195c-a901-4dda-b007-0dc114663bdc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:35.242425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11343d4-c12a-40e1-976c-799a196f72f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:35.243052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11343d4-c12a-40e1-976c-799a196f72f2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:35.243330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11343d4-c12a-40e1-976c-799a196f72f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:35.243603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11343d4-c12a-40e1-976c-799a196f72f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:35.253770 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11343d4-c12a-40e1-976c-799a196f72f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:35.255213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11343d4-c12a-40e1-976c-799a196f72f2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-c11343d4-c12a-40e1-976c-799a196f72f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:35.269423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:35.270450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:35.271698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:35.271698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:35.271698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:35.271698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:35.271698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 634/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:35.276269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2462868-adfb-4ed0-9a43-38243a7a7e97 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:35.355954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:35.374806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2462868-adfb-4ed0-9a43-38243a7a7e97 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:35.407494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071df6a-b331-4c85-9db1-86fd10f46f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:35.408092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071df6a-b331-4c85-9db1-86fd10f46f0b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:35.408370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071df6a-b331-4c85-9db1-86fd10f46f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:35.408639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9071df6a-b331-4c85-9db1-86fd10f46f0b None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:35.409333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071df6a-b331-4c85-9db1-86fd10f46f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:35.409637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071df6a-b331-4c85-9db1-86fd10f46f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:35.411010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9071df6a-b331-4c85-9db1-86fd10f46f0b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:35.422616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 632/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:35.428320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11343d4-c12a-40e1-976c-799a196f72f2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:35.525635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11343d4-c12a-40e1-976c-799a196f72f2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:35.544877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:35.559587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd4826-10c3-4221-a82c-fc721592015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:35.560223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd4826-10c3-4221-a82c-fc721592015e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:35.560501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd4826-10c3-4221-a82c-fc721592015e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:35.560773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fd4826-10c3-4221-a82c-fc721592015e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:35.567950 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd4826-10c3-4221-a82c-fc721592015e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:35.569413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fd4826-10c3-4221-a82c-fc721592015e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-e3fd4826-10c3-4221-a82c-fc721592015e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:53:35.580966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:35.582083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:35.583208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:35.583208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:35.583208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:53:35.583208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:53:35.583208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:53:35.583208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:53:35.583208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:53:35.583208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:53:35.583208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 11:53:35.583208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:35.583208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 635/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:35 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:35.587841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071df6a-b331-4c85-9db1-86fd10f46f0b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:35.683640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9071df6a-b331-4c85-9db1-86fd10f46f0b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:35.716971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05e5c9-d7ba-463e-9d7c-49062a4642e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:35.717603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05e5c9-d7ba-463e-9d7c-49062a4642e8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:35.717887 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05e5c9-d7ba-463e-9d7c-49062a4642e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:35.718159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc05e5c9-d7ba-463e-9d7c-49062a4642e8 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:35.718934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05e5c9-d7ba-463e-9d7c-49062a4642e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:35.719237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05e5c9-d7ba-463e-9d7c-49062a4642e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:35.720645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc05e5c9-d7ba-463e-9d7c-49062a4642e8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:35.729186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:35.737638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 633/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Aug 1 11:53:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:35.743224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd4826-10c3-4221-a82c-fc721592015e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:35.838978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fd4826-10c3-4221-a82c-fc721592015e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:35.870666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08fcf4-3c6a-4d31-aa9c-52aec3f89b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:35.871282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08fcf4-3c6a-4d31-aa9c-52aec3f89b74 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:35.871558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08fcf4-3c6a-4d31-aa9c-52aec3f89b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:35.872349 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a08fcf4-3c6a-4d31-aa9c-52aec3f89b74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:35.882387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08fcf4-3c6a-4d31-aa9c-52aec3f89b74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:35.883814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a08fcf4-3c6a-4d31-aa9c-52aec3f89b74 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-4a08fcf4-3c6a-4d31-aa9c-52aec3f89b74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:35.897933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:35.898986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:35.900100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:35.900100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:35.900100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:35.900100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:35.900100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 636/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:35.904521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05e5c9-d7ba-463e-9d7c-49062a4642e8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:36.008540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc05e5c9-d7ba-463e-9d7c-49062a4642e8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:36.046690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5d7c9-7908-4a23-8107-8afb93b81120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:36.047300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5d7c9-7908-4a23-8107-8afb93b81120 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:36.047582 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5d7c9-7908-4a23-8107-8afb93b81120 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:36.047857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e5d7c9-7908-4a23-8107-8afb93b81120 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:36.048542 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5d7c9-7908-4a23-8107-8afb93b81120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:36.048846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5d7c9-7908-4a23-8107-8afb93b81120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:36.050244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e5d7c9-7908-4a23-8107-8afb93b81120 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:36.061822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 634/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:36.067478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08fcf4-3c6a-4d31-aa9c-52aec3f89b74 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:36.098015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:36.164860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a08fcf4-3c6a-4d31-aa9c-52aec3f89b74 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:36.197479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfb6fd-bb8f-46ff-a4d4-e9256708ffaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:36.198094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb6fd-bb8f-46ff-a4d4-e9256708ffaf None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:36.198395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb6fd-bb8f-46ff-a4d4-e9256708ffaf None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:36.198662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfb6fd-bb8f-46ff-a4d4-e9256708ffaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:36.205034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfb6fd-bb8f-46ff-a4d4-e9256708ffaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:36.206485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcfb6fd-bb8f-46ff-a4d4-e9256708ffaf None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-2bcfb6fd-bb8f-46ff-a4d4-e9256708ffaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:53:36.218013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:36.219111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:36.220118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:53:36.220118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:53:36.220118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:53:36.220118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:53:36.220118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:53:36.220118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:53:36.220118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:53:36.220118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:36.220118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 637/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:53:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:36.224773 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5d7c9-7908-4a23-8107-8afb93b81120 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:36.282853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:36.325202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e5d7c9-7908-4a23-8107-8afb93b81120 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:36.358795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee851354-9234-4ab1-a463-49ef57553453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:36.359345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee851354-9234-4ab1-a463-49ef57553453 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:36.359624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee851354-9234-4ab1-a463-49ef57553453 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:36.359899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee851354-9234-4ab1-a463-49ef57553453 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:36.360642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee851354-9234-4ab1-a463-49ef57553453 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:36.360951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee851354-9234-4ab1-a463-49ef57553453 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:36.362411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee851354-9234-4ab1-a463-49ef57553453 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:36.374002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 635/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:53:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:36.379992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfb6fd-bb8f-46ff-a4d4-e9256708ffaf None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:36.467594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:36.476576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcfb6fd-bb8f-46ff-a4d4-e9256708ffaf None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:36.509080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad41b3ed-36b7-4759-b872-03f17066e37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:36.509757 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41b3ed-36b7-4759-b872-03f17066e37a None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:36.510037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41b3ed-36b7-4759-b872-03f17066e37a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:36.510307 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad41b3ed-36b7-4759-b872-03f17066e37a None admin] PATH_INFO: `/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/35b5e545d75d40d0abb9c8d996e3b4a0/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:36.512216 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41b3ed-36b7-4759-b872-03f17066e37a None admin] RBAC: Authorizing `identity:create_grant(project_id=99857fcf20fd4cb8b7def2bc2de521bc, user_id=35b5e545d75d40d0abb9c8d996e3b4a0, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:36.513662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad41b3ed-36b7-4759-b872-03f17066e37a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:36.525710 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 638/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Mon Aug 1 11:53:36 2022] PUT /identity/v3/projects/99857fcf20fd4cb8b7def2bc2de521bc/users/35b5e545d75d40d0abb9c8d996e3b4a0/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:53:38.513248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676acfc-be0d-4e21-ae8f-057099e586bd None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:38.513822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676acfc-be0d-4e21-ae8f-057099e586bd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:38.513822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3676acfc-be0d-4e21-ae8f-057099e586bd None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:38.515164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 636/1274] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:53:38.520271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc533c-00bf-429e-9524-531c005c61c9 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:38.520687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc533c-00bf-429e-9524-531c005c61c9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:38.520823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc533c-00bf-429e-9524-531c005c61c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:38.539050 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-bedc533c-00bf-429e-9524-531c005c61c9 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:53:38.540226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bedc533c-00bf-429e-9524-531c005c61c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:53:38.604315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 639/1275] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:53:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:53:38.627340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676acfc-be0d-4e21-ae8f-057099e586bd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:38.738447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3676acfc-be0d-4e21-ae8f-057099e586bd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:38.754986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:38.771511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a191db-b37f-41c7-8005-9da85f0cc5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:38.772146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a191db-b37f-41c7-8005-9da85f0cc5a9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:38.772427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a191db-b37f-41c7-8005-9da85f0cc5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:38.772700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a191db-b37f-41c7-8005-9da85f0cc5a9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:38.783086 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a191db-b37f-41c7-8005-9da85f0cc5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-41a191db-b37f-41c7-8005-9da85f0cc5a9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 11:53:38.787965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:38.789043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:38.790222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 637/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Mon Aug 1 11:53:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:38.795827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc533c-00bf-429e-9524-531c005c61c9 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:38.873440 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:38.891632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc533c-00bf-429e-9524-531c005c61c9 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:38.924826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f644870-c0ba-45f5-b4a6-3d6cd2a8a02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:38.925462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f644870-c0ba-45f5-b4a6-3d6cd2a8a02c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:38.925743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f644870-c0ba-45f5-b4a6-3d6cd2a8a02c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:38.926014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f644870-c0ba-45f5-b4a6-3d6cd2a8a02c None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:38.926720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f644870-c0ba-45f5-b4a6-3d6cd2a8a02c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:38.927021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f644870-c0ba-45f5-b4a6-3d6cd2a8a02c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:38.928377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f644870-c0ba-45f5-b4a6-3d6cd2a8a02c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:38.936674 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 640/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Mon Aug 1 11:53:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:38.942204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a191db-b37f-41c7-8005-9da85f0cc5a9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:39.043300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a191db-b37f-41c7-8005-9da85f0cc5a9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:39.077831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ce184-ffdb-454a-aa91-ef6419f2e123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:39.078691 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ce184-ffdb-454a-aa91-ef6419f2e123 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:39.078973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ce184-ffdb-454a-aa91-ef6419f2e123 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:39.079250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ce184-ffdb-454a-aa91-ef6419f2e123 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:39.091153 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ce184-ffdb-454a-aa91-ef6419f2e123 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:39.092610 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882ce184-ffdb-454a-aa91-ef6419f2e123 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-882ce184-ffdb-454a-aa91-ef6419f2e123 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:39.106810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:39.107877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:39.109162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:39.109162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:39.109162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:39.109162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:39.109162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 638/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:39.113773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f644870-c0ba-45f5-b4a6-3d6cd2a8a02c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:39.209915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f644870-c0ba-45f5-b4a6-3d6cd2a8a02c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:39.242403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a52f5e-fa72-4982-83aa-3ad0c9952173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:39.243008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a52f5e-fa72-4982-83aa-3ad0c9952173 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:39.243289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a52f5e-fa72-4982-83aa-3ad0c9952173 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:39.243562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a52f5e-fa72-4982-83aa-3ad0c9952173 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:39.244245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a52f5e-fa72-4982-83aa-3ad0c9952173 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:39.244548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a52f5e-fa72-4982-83aa-3ad0c9952173 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:39.245942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a52f5e-fa72-4982-83aa-3ad0c9952173 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:39.257115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 641/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:39.263126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ce184-ffdb-454a-aa91-ef6419f2e123 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:39.293789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:39.365718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ce184-ffdb-454a-aa91-ef6419f2e123 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:39.398951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fba66-c842-4a28-9d48-b51874bc8438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:39.399577 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fba66-c842-4a28-9d48-b51874bc8438 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:39.399858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fba66-c842-4a28-9d48-b51874bc8438 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:39.400130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57fba66-c842-4a28-9d48-b51874bc8438 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:39.407349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fba66-c842-4a28-9d48-b51874bc8438 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:39.408811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57fba66-c842-4a28-9d48-b51874bc8438 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b57fba66-c842-4a28-9d48-b51874bc8438 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 11:53:39.419826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:39.420947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:39.422240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:39.422240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:39.422240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 11:53:39.422240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 11:53:39.422240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 11:53:39.422240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 11:53:39.422240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 11:53:39.422240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 11:53:39.422240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 11:53:39.422240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:39.422240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 639/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:39.426754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a52f5e-fa72-4982-83aa-3ad0c9952173 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:39.430480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:39.524101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a52f5e-fa72-4982-83aa-3ad0c9952173 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:39.556411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9515ca6-8993-4c33-9fbb-aa7ded01eba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:39.557011 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9515ca6-8993-4c33-9fbb-aa7ded01eba1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:39.557289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9515ca6-8993-4c33-9fbb-aa7ded01eba1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:39.557586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9515ca6-8993-4c33-9fbb-aa7ded01eba1 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:39.558367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9515ca6-8993-4c33-9fbb-aa7ded01eba1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:39.558670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9515ca6-8993-4c33-9fbb-aa7ded01eba1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:39.560581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9515ca6-8993-4c33-9fbb-aa7ded01eba1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:39.578291 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 642/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Mon Aug 1 11:53:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:39.584109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fba66-c842-4a28-9d48-b51874bc8438 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:39.671807 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:39.681868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57fba66-c842-4a28-9d48-b51874bc8438 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:39.714677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a11dff-df85-496d-a7e5-9b4341fb4638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:39.715317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a11dff-df85-496d-a7e5-9b4341fb4638 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:39.715599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a11dff-df85-496d-a7e5-9b4341fb4638 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:39.715896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a11dff-df85-496d-a7e5-9b4341fb4638 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:39.780536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a11dff-df85-496d-a7e5-9b4341fb4638 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:39.781957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a11dff-df85-496d-a7e5-9b4341fb4638 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:39.867085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:39.877915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 640/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Mon Aug 1 11:53:39 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 11:53:39.883567 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9515ca6-8993-4c33-9fbb-aa7ded01eba1 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:39.941980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:39.978577 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9515ca6-8993-4c33-9fbb-aa7ded01eba1 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:40.011403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df29444-a525-4e4e-9fd5-aad114bba73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:40.012022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df29444-a525-4e4e-9fd5-aad114bba73a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:40.012323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df29444-a525-4e4e-9fd5-aad114bba73a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:40.012595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df29444-a525-4e4e-9fd5-aad114bba73a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:40.022346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df29444-a525-4e4e-9fd5-aad114bba73a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:40.023781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df29444-a525-4e4e-9fd5-aad114bba73a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-5df29444-a525-4e4e-9fd5-aad114bba73a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 11:53:40.037759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:40.038810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:40.039933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 11:53:40.039933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 11:53:40.039933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 11:53:40.039933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:40.039933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 643/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:53:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:40.044824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a11dff-df85-496d-a7e5-9b4341fb4638 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:40.140470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a11dff-df85-496d-a7e5-9b4341fb4638 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:40.173654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef32b9-5470-4da9-a3fe-bacafb7bbd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:40.174252 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef32b9-5470-4da9-a3fe-bacafb7bbd0a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:40.174528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef32b9-5470-4da9-a3fe-bacafb7bbd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:40.174799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef32b9-5470-4da9-a3fe-bacafb7bbd0a None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:40.175482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef32b9-5470-4da9-a3fe-bacafb7bbd0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:40.175780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef32b9-5470-4da9-a3fe-bacafb7bbd0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:40.177149 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef32b9-5470-4da9-a3fe-bacafb7bbd0a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:40.187968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 641/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Mon Aug 1 11:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:40.193607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df29444-a525-4e4e-9fd5-aad114bba73a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:40.290453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df29444-a525-4e4e-9fd5-aad114bba73a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:40.305083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:40.324692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0599e10-0e61-425d-9a47-86c172038cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:40.325351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0599e10-0e61-425d-9a47-86c172038cfe None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:40.325633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0599e10-0e61-425d-9a47-86c172038cfe None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:40.325904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0599e10-0e61-425d-9a47-86c172038cfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:40.332325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0599e10-0e61-425d-9a47-86c172038cfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:40.333803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0599e10-0e61-425d-9a47-86c172038cfe None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-f0599e10-0e61-425d-9a47-86c172038cfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 11:53:40.345442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:40.346499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:40.347617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 11:53:40.347617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 11:53:40.347617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 11:53:40.347617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 11:53:40.347617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 11:53:40.347617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 11:53:40.347617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 11:53:40.347617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 11:53:40.347617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 644/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Mon Aug 1 11:53:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:40.352650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef32b9-5470-4da9-a3fe-bacafb7bbd0a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:40.400988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:40.451134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef32b9-5470-4da9-a3fe-bacafb7bbd0a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:40.483475 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be35fe3e-5f89-43a7-9068-93f18bc74241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:40.484075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35fe3e-5f89-43a7-9068-93f18bc74241 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:40.484355 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35fe3e-5f89-43a7-9068-93f18bc74241 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:40.484625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be35fe3e-5f89-43a7-9068-93f18bc74241 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:40.485392 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35fe3e-5f89-43a7-9068-93f18bc74241 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:40.485703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35fe3e-5f89-43a7-9068-93f18bc74241 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:40.487123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be35fe3e-5f89-43a7-9068-93f18bc74241 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:40.498655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 642/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Mon Aug 1 11:53:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:40.504840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0599e10-0e61-425d-9a47-86c172038cfe None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:40.602837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0599e10-0e61-425d-9a47-86c172038cfe None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:40.634474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050fc43d-34e8-46e1-b9c6-2dd5c7c42394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:40.635069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fc43d-34e8-46e1-b9c6-2dd5c7c42394 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:40.635353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fc43d-34e8-46e1-b9c6-2dd5c7c42394 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:40.635626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050fc43d-34e8-46e1-b9c6-2dd5c7c42394 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:40.636402 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fc43d-34e8-46e1-b9c6-2dd5c7c42394 None admin] RBAC: Adding query filter params (role.id=0195bf688a7e464e8ff594afe80b050e, scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc, user.id=35b5e545d75d40d0abb9c8d996e3b4a0) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:40.636713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fc43d-34e8-46e1-b9c6-2dd5c7c42394 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:40.638678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050fc43d-34e8-46e1-b9c6-2dd5c7c42394 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:40.644269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 645/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Mon Aug 1 11:53:40 2022] GET /identity/v3/role_assignments?user.id=35b5e545d75d40d0abb9c8d996e3b4a0&scope.project.id=99857fcf20fd4cb8b7def2bc2de521bc&role.id=0195bf688a7e464e8ff594afe80b050e => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:42.704911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f81289-cda6-48ad-b4c9-7d50ff0e7de6 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:42.705451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f81289-cda6-48ad-b4c9-7d50ff0e7de6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:42.705451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f81289-cda6-48ad-b4c9-7d50ff0e7de6 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:42.706726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 643/1288] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:53:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:53:42.711723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea3122-1466-4ac8-89a5-bf9f7e54d6be None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:42.712156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea3122-1466-4ac8-89a5-bf9f7e54d6be None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:42.712277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aea3122-1466-4ac8-89a5-bf9f7e54d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:42.730879 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-5aea3122-1466-4ac8-89a5-bf9f7e54d6be None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:53:42.732061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5aea3122-1466-4ac8-89a5-bf9f7e54d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:53:42.765956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:42.802847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 646/1289] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:53:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:53:42.824081 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f81289-cda6-48ad-b4c9-7d50ff0e7de6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:42.921887 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f81289-cda6-48ad-b4c9-7d50ff0e7de6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:42.932283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:42.955762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3021d14-8687-4c43-b1a3-f7845d71b9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:42.956326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021d14-8687-4c43-b1a3-f7845d71b9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:42.956602 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021d14-8687-4c43-b1a3-f7845d71b9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:42.956875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3021d14-8687-4c43-b1a3-f7845d71b9e7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:42.957526 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3021d14-8687-4c43-b1a3-f7845d71b9e7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:42.958886 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3021d14-8687-4c43-b1a3-f7845d71b9e7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e3021d14-8687-4c43-b1a3-f7845d71b9e7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:42.968070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:42.969142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:42.970156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 644/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Aug 1 11:53:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:42.975340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea3122-1466-4ac8-89a5-bf9f7e54d6be None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:43.090465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aea3122-1466-4ac8-89a5-bf9f7e54d6be None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:43.124854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1a739-bc09-458a-bee9-2b212f5acd3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:43.125491 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a739-bc09-458a-bee9-2b212f5acd3a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:43.125769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a739-bc09-458a-bee9-2b212f5acd3a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:43.126037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1a739-bc09-458a-bee9-2b212f5acd3a None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:43.126706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1a739-bc09-458a-bee9-2b212f5acd3a None admin] RBAC: Adding query filter params (name=placement) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:43.127006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1a739-bc09-458a-bee9-2b212f5acd3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:43.128365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1a739-bc09-458a-bee9-2b212f5acd3a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:43.133073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 647/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Aug 1 11:53:42 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:43.139520 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3021d14-8687-4c43-b1a3-f7845d71b9e7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:43.237865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3021d14-8687-4c43-b1a3-f7845d71b9e7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:43.269308 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb144ef-ad14-48ed-8510-d585c697cee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:43.269908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb144ef-ad14-48ed-8510-d585c697cee6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:43.270182 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb144ef-ad14-48ed-8510-d585c697cee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:43.270452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb144ef-ad14-48ed-8510-d585c697cee6 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:43.271110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb144ef-ad14-48ed-8510-d585c697cee6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:43.271406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb144ef-ad14-48ed-8510-d585c697cee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:43.272767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb144ef-ad14-48ed-8510-d585c697cee6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:43.277046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 645/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Aug 1 11:53:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:45.280505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb407b-606b-4cd8-930e-e2026483077b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:45.281144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb407b-606b-4cd8-930e-e2026483077b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:45.281144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb407b-606b-4cd8-930e-e2026483077b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:45.282438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 648/1293] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:53:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:53:45.287537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382169a-2c21-47dc-b49d-d33e445ce019 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:45.287983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382169a-2c21-47dc-b49d-d33e445ce019 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:45.288083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a382169a-2c21-47dc-b49d-d33e445ce019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:45.306185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a382169a-2c21-47dc-b49d-d33e445ce019 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:53:45.307375 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a382169a-2c21-47dc-b49d-d33e445ce019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:53:45.336708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:45.373284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 646/1294] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:53:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:53:45.395468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb407b-606b-4cd8-930e-e2026483077b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:45.425208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:45.498674 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcb407b-606b-4cd8-930e-e2026483077b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:45.530946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07e67a-165a-4433-af75-941210a27f50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:45.531497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07e67a-165a-4433-af75-941210a27f50 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:45.531776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07e67a-165a-4433-af75-941210a27f50 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:45.532049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07e67a-165a-4433-af75-941210a27f50 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:45.532739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07e67a-165a-4433-af75-941210a27f50 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:45.534112 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07e67a-165a-4433-af75-941210a27f50 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:45.547713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 649/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Mon Aug 1 11:53:45 2022] POST /identity/v3/services => generated 246 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 11:53:47.553892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b67d0a-b3f0-420a-8a5e-fb65255fac66 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:47.554395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b67d0a-b3f0-420a-8a5e-fb65255fac66 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:47.554395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b67d0a-b3f0-420a-8a5e-fb65255fac66 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:47.555714 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 647/1296] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:53:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:53:47.561064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57763cc7-d3da-486b-a09c-84a23ffd5ab7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:47.561462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57763cc7-d3da-486b-a09c-84a23ffd5ab7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:47.561652 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57763cc7-d3da-486b-a09c-84a23ffd5ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:47.579181 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-57763cc7-d3da-486b-a09c-84a23ffd5ab7 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:53:47.580366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-57763cc7-d3da-486b-a09c-84a23ffd5ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:53:47.651187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 650/1297] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:53:47 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:53:47.674157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b67d0a-b3f0-420a-8a5e-fb65255fac66 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:47.772211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b67d0a-b3f0-420a-8a5e-fb65255fac66 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:47.805218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b022df-afbb-47eb-badc-7523dfd9ead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:47.805831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b022df-afbb-47eb-badc-7523dfd9ead3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:47.806109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b022df-afbb-47eb-badc-7523dfd9ead3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:47.806378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b022df-afbb-47eb-badc-7523dfd9ead3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:47.806994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b022df-afbb-47eb-badc-7523dfd9ead3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:47.808362 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b022df-afbb-47eb-badc-7523dfd9ead3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-78b022df-afbb-47eb-badc-7523dfd9ead3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:47.817540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:47.818909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:47.820114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 648/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Aug 1 11:53:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:47.825197 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57763cc7-d3da-486b-a09c-84a23ffd5ab7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:47.843023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:47.921409 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57763cc7-d3da-486b-a09c-84a23ffd5ab7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:47.954553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954415f-960a-4a97-85e0-92a1d8d6660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:47.955162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954415f-960a-4a97-85e0-92a1d8d6660f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:47.955441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954415f-960a-4a97-85e0-92a1d8d6660f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:47.955714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7954415f-960a-4a97-85e0-92a1d8d6660f None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:47.956382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954415f-960a-4a97-85e0-92a1d8d6660f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:47.956683 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954415f-960a-4a97-85e0-92a1d8d6660f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:47.958075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7954415f-960a-4a97-85e0-92a1d8d6660f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:47.963065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 651/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Aug 1 11:53:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:47.968838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b022df-afbb-47eb-badc-7523dfd9ead3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:48.007286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:48.082385 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b022df-afbb-47eb-badc-7523dfd9ead3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:48.114662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7b224-9962-4d21-8a98-480dcc5c1dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:48.115264 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b224-9962-4d21-8a98-480dcc5c1dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:48.115541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b224-9962-4d21-8a98-480dcc5c1dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:48.115812 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7b224-9962-4d21-8a98-480dcc5c1dd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:48.116557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7b224-9962-4d21-8a98-480dcc5c1dd0 None admin] RBAC: Adding query filter params (interface=public, service_id=29903abff39e45c489b41119c3ba1787, region_id=RegionOne) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:48.116860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7b224-9962-4d21-8a98-480dcc5c1dd0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:48.118254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f7b224-9962-4d21-8a98-480dcc5c1dd0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:48.123717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 649/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Mon Aug 1 11:53:47 2022] GET /identity/v3/endpoints?service_id=29903abff39e45c489b41119c3ba1787&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:48.129391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954415f-960a-4a97-85e0-92a1d8d6660f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:48.218403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:48.236706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7954415f-960a-4a97-85e0-92a1d8d6660f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:48.268975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686e9954-8c50-4869-8759-1bf5bf38ec98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:48.269608 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e9954-8c50-4869-8759-1bf5bf38ec98 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:48.269881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e9954-8c50-4869-8759-1bf5bf38ec98 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:48.270149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686e9954-8c50-4869-8759-1bf5bf38ec98 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:48.270788 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e9954-8c50-4869-8759-1bf5bf38ec98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:48.272129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686e9954-8c50-4869-8759-1bf5bf38ec98 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:48.278785 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 652/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Mon Aug 1 11:53:48 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 11:53:50.243367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bd73c-158e-4af8-9019-13b4038d6ebd None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:50.243918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bd73c-158e-4af8-9019-13b4038d6ebd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:50.243918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5bd73c-158e-4af8-9019-13b4038d6ebd None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:50.245315 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 650/1302] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:53:50.250431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce403f8-1d69-4263-98d0-fdb1291a5716 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:50.250840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce403f8-1d69-4263-98d0-fdb1291a5716 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:50.250987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce403f8-1d69-4263-98d0-fdb1291a5716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:50.269346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-cce403f8-1d69-4263-98d0-fdb1291a5716 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:53:50.270559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cce403f8-1d69-4263-98d0-fdb1291a5716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:53:50.335849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 653/1303] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:53:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 11:53:50.358721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bd73c-158e-4af8-9019-13b4038d6ebd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:50.451790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:50.458866 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5bd73c-158e-4af8-9019-13b4038d6ebd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:50.491625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70e7f2-3a96-4699-8dcd-090c945691ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:50.492245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70e7f2-3a96-4699-8dcd-090c945691ff None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:50.492520 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70e7f2-3a96-4699-8dcd-090c945691ff None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:50.492788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f70e7f2-3a96-4699-8dcd-090c945691ff None admin] PATH_INFO: `/v3/services/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:50.493478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70e7f2-3a96-4699-8dcd-090c945691ff None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:50.494787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f70e7f2-3a96-4699-8dcd-090c945691ff None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0f70e7f2-3a96-4699-8dcd-090c945691ff None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 11:53:50.503285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 11:53:50.504558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 11:53:50.505729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 651/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Mon Aug 1 11:53:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 11:53:50.510352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce403f8-1d69-4263-98d0-fdb1291a5716 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:50.584921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:53:50.607562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce403f8-1d69-4263-98d0-fdb1291a5716 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:50.641531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0e1a09-b532-4212-85a1-bb0e8a32996b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:50.642136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e1a09-b532-4212-85a1-bb0e8a32996b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:50.642414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e1a09-b532-4212-85a1-bb0e8a32996b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:50.642687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0e1a09-b532-4212-85a1-bb0e8a32996b None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:50.643354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e1a09-b532-4212-85a1-bb0e8a32996b None admin] RBAC: Adding query filter params (name=placement) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:53:50.643655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e1a09-b532-4212-85a1-bb0e8a32996b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:50.645012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0e1a09-b532-4212-85a1-bb0e8a32996b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:50.650008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 654/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Mon Aug 1 11:53:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:53:50.655693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70e7f2-3a96-4699-8dcd-090c945691ff None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:53:50.752382 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f70e7f2-3a96-4699-8dcd-090c945691ff None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:53:50.785616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae62103b-008b-4d81-b582-f5cdc1ba450b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:53:50.786216 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62103b-008b-4d81-b582-f5cdc1ba450b None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:53:50.786490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62103b-008b-4d81-b582-f5cdc1ba450b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:53:50.786752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae62103b-008b-4d81-b582-f5cdc1ba450b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:53:50.787450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62103b-008b-4d81-b582-f5cdc1ba450b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:53:50.788806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae62103b-008b-4d81-b582-f5cdc1ba450b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:53:50.807268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 652/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 11:53:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:54:00.647211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=30 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:54:00.803172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:54:53.754496 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56d3e9-0d5e-4b5c-9350-b81e2dfb139d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:54:53.754988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56d3e9-0d5e-4b5c-9350-b81e2dfb139d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:54:53.755078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f56d3e9-0d5e-4b5c-9350-b81e2dfb139d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:54:53.762061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94b780-e348-4deb-9197-bcfc6b29da03 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:54:53.762480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94b780-e348-4deb-9197-bcfc6b29da03 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:54:53.762654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca94b780-e348-4deb-9197-bcfc6b29da03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:54:53.767587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 655/1307] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:54:53 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:54:53.842832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ca94b780-e348-4deb-9197-bcfc6b29da03 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:54:53.843572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ca94b780-e348-4deb-9197-bcfc6b29da03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:54:53.981994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 653/1308] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:54:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:54:54.020510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254087e-b0ac-46c3-99df-28d778ed11d2 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:54:54.020790 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254087e-b0ac-46c3-99df-28d778ed11d2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:54:54.021213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254087e-b0ac-46c3-99df-28d778ed11d2 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:54:54.022921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 656/1309] 10.222.0.42 () {54 vars in 965 bytes} [Mon Aug 1 11:54:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:54:54.030411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7361b-458d-4667-98bc-ff1cb43c1a58 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:54:54.030940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7361b-458d-4667-98bc-ff1cb43c1a58 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:54:54.031357 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7361b-458d-4667-98bc-ff1cb43c1a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:54:54.119083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-cef7361b-458d-4667-98bc-ff1cb43c1a58 None None] MFA Rules not processed for user `a2afb18a441549e3b853966ea1ad286e`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:54:54.120462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cef7361b-458d-4667-98bc-ff1cb43c1a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:54:54.142724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:54:54.201788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 654/1310] 10.222.0.42 () {58 vars in 1062 bytes} [Mon Aug 1 11:54:54 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:54:54.210846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254087e-b0ac-46c3-99df-28d778ed11d2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:54:54.212605 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2254087e-b0ac-46c3-99df-28d778ed11d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:54:54.348069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254087e-b0ac-46c3-99df-28d778ed11d2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:54:54.435440 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7876d5-ac71-440c-8f7c-4e032cd38021 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:54:54.436075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7876d5-ac71-440c-8f7c-4e032cd38021 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:54:54.436353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7876d5-ac71-440c-8f7c-4e032cd38021 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:54:54.436620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7876d5-ac71-440c-8f7c-4e032cd38021 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:54:54.438495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1d7876d5-ac71-440c-8f7c-4e032cd38021 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:54:54.498447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:54:54.556421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7876d5-ac71-440c-8f7c-4e032cd38021 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:54:54.558541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7876d5-ac71-440c-8f7c-4e032cd38021 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:54:54.579171 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 657/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:54:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:54:56.876530 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1effe5-2b6b-4e47-9044-d2b472d9c8db None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:54:56.877030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1effe5-2b6b-4e47-9044-d2b472d9c8db None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:54:56.877158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1effe5-2b6b-4e47-9044-d2b472d9c8db None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:54:56.878593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 655/1312] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:54:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:54:56.883726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aad403-6d2e-498c-ba5b-1140ef5542a0 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:54:56.884151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aad403-6d2e-498c-ba5b-1140ef5542a0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:54:56.884282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19aad403-6d2e-498c-ba5b-1140ef5542a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:54:56.967541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-19aad403-6d2e-498c-ba5b-1140ef5542a0 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:54:56.969035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-19aad403-6d2e-498c-ba5b-1140ef5542a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:54:57.081448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 658/1313] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:54:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:54:57.113986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1effe5-2b6b-4e47-9044-d2b472d9c8db None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:54:57.115802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cd1effe5-2b6b-4e47-9044-d2b472d9c8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:54:57.226927 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1effe5-2b6b-4e47-9044-d2b472d9c8db None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:54:57.299666 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:54:57.302468 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18018f72-eaf5-4926-ab22-42cbbda01722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:54:57.302903 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18018f72-eaf5-4926-ab22-42cbbda01722 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:54:57.303191 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18018f72-eaf5-4926-ab22-42cbbda01722 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:54:57.303572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18018f72-eaf5-4926-ab22-42cbbda01722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:54:57.305255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-18018f72-eaf5-4926-ab22-42cbbda01722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:54:57.420768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18018f72-eaf5-4926-ab22-42cbbda01722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:54:57.422179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18018f72-eaf5-4926-ab22-42cbbda01722 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:54:57.441530 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 656/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:54:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:54:59.794146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec0010-2b39-42ee-99c1-31b44ae8c876 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:54:59.794675 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec0010-2b39-42ee-99c1-31b44ae8c876 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:54:59.794675 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dec0010-2b39-42ee-99c1-31b44ae8c876 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:54:59.796055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 659/1315] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:54:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:54:59.801302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb739393-a0ff-4104-b8ee-bc0fad54b802 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:54:59.801695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb739393-a0ff-4104-b8ee-bc0fad54b802 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:54:59.801867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb739393-a0ff-4104-b8ee-bc0fad54b802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:54:59.868037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bb739393-a0ff-4104-b8ee-bc0fad54b802 None None] MFA Rules not processed for user `ede771e5606b4919bb7574deefd0336b`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:54:59.869237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bb739393-a0ff-4104-b8ee-bc0fad54b802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:54:59.920084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:54:59.963727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 657/1316] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:54:59 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:00.015907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ee29-b014-4fdd-9522-c3f971d1c82a None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:00.016188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ee29-b014-4fdd-9522-c3f971d1c82a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:00.016463 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b26ee29-b014-4fdd-9522-c3f971d1c82a None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:00.017862 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 660/1317] 10.222.0.42 () {54 vars in 965 bytes} [Mon Aug 1 11:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:00.023847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf67f-5434-4054-89da-d2ecc318d892 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:00.024129 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf67f-5434-4054-89da-d2ecc318d892 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:00.024399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aaf67f-5434-4054-89da-d2ecc318d892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:00.098194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-11aaf67f-5434-4054-89da-d2ecc318d892 None None] MFA Rules not processed for user `a2afb18a441549e3b853966ea1ad286e`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:00.099307 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-11aaf67f-5434-4054-89da-d2ecc318d892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:00.172053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 658/1318] 10.222.0.42 () {58 vars in 1062 bytes} [Mon Aug 1 11:55:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:00.181095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26ee29-b014-4fdd-9522-c3f971d1c82a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:00.182677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7b26ee29-b014-4fdd-9522-c3f971d1c82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:00.192449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:00.303182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b26ee29-b014-4fdd-9522-c3f971d1c82a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:00.377698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71247409-9d84-4984-9525-e0aeae32819b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:00.378254 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71247409-9d84-4984-9525-e0aeae32819b service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:00.378533 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71247409-9d84-4984-9525-e0aeae32819b service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:00.378803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71247409-9d84-4984-9525-e0aeae32819b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:00.380400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-71247409-9d84-4984-9525-e0aeae32819b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:00.443461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:00.493618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71247409-9d84-4984-9525-e0aeae32819b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:00.495599 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71247409-9d84-4984-9525-e0aeae32819b service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:00.514702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 661/1319] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:00 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:03.477638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf5c93-abbe-4a12-b130-78e85d6c48dc None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:03.478156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf5c93-abbe-4a12-b130-78e85d6c48dc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:03.478156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf5c93-abbe-4a12-b130-78e85d6c48dc None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:03.480098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 659/1320] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:03.485048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903361f-336d-4473-a4ed-6a10c2e43a94 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:03.485447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903361f-336d-4473-a4ed-6a10c2e43a94 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:03.485629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903361f-336d-4473-a4ed-6a10c2e43a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:03.549492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d903361f-336d-4473-a4ed-6a10c2e43a94 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:03.550682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d903361f-336d-4473-a4ed-6a10c2e43a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:03.646533 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 662/1321] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:03.687511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf5c93-abbe-4a12-b130-78e85d6c48dc None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:03.689057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c4bf5c93-abbe-4a12-b130-78e85d6c48dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:03.744867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:03.798087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf5c93-abbe-4a12-b130-78e85d6c48dc None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:03.870209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c335f03f-7928-41d4-a138-663a5227bf60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:03.870838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335f03f-7928-41d4-a138-663a5227bf60 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:03.871111 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335f03f-7928-41d4-a138-663a5227bf60 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:03.871377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c335f03f-7928-41d4-a138-663a5227bf60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:03.872970 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c335f03f-7928-41d4-a138-663a5227bf60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:03.965782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:03.978960 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335f03f-7928-41d4-a138-663a5227bf60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:03.980400 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c335f03f-7928-41d4-a138-663a5227bf60 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:03.998700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 660/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:03 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:06.749690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d314de-dbae-41a7-9db2-dd080106f01d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:06.750206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d314de-dbae-41a7-9db2-dd080106f01d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:06.750358 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d314de-dbae-41a7-9db2-dd080106f01d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:06.751771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 663/1323] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:06.756964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092319a-5e6b-41b0-b247-63030600c264 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:06.757392 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092319a-5e6b-41b0-b247-63030600c264 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:06.757622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8092319a-5e6b-41b0-b247-63030600c264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:06.827568 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8092319a-5e6b-41b0-b247-63030600c264 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:06.828786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8092319a-5e6b-41b0-b247-63030600c264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:06.930260 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 661/1324] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:06.967813 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d314de-dbae-41a7-9db2-dd080106f01d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:06.969399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-21d314de-dbae-41a7-9db2-dd080106f01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:06.990859 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:07.080021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d314de-dbae-41a7-9db2-dd080106f01d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:07.155354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac57211-184d-435d-8871-1ba4354faf8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:07.155974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac57211-184d-435d-8871-1ba4354faf8c service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:07.156255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac57211-184d-435d-8871-1ba4354faf8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:07.156526 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac57211-184d-435d-8871-1ba4354faf8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:07.158187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1ac57211-184d-435d-8871-1ba4354faf8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:07.228566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:07.267821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac57211-184d-435d-8871-1ba4354faf8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:07.269328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac57211-184d-435d-8871-1ba4354faf8c service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:07.289672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 664/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:09.375928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91a93e-8fcd-4c49-918e-9141ed694456 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:09.376435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91a93e-8fcd-4c49-918e-9141ed694456 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:09.376435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de91a93e-8fcd-4c49-918e-9141ed694456 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:09.377937 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 662/1326] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:09.383169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8b952-deba-49d8-b52a-fc93e7b5689f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:09.383594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8b952-deba-49d8-b52a-fc93e7b5689f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:09.383847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d8b952-deba-49d8-b52a-fc93e7b5689f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:09.450180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-41d8b952-deba-49d8-b52a-fc93e7b5689f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:09.451403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-41d8b952-deba-49d8-b52a-fc93e7b5689f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:09.551262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 665/1327] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:09.587226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91a93e-8fcd-4c49-918e-9141ed694456 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:09.589430 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-de91a93e-8fcd-4c49-918e-9141ed694456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:09.650831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:09.696730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de91a93e-8fcd-4c49-918e-9141ed694456 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:09.772377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab86c4e-afaa-4c27-839d-d90e99c70257 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:09.773009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab86c4e-afaa-4c27-839d-d90e99c70257 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:09.773286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab86c4e-afaa-4c27-839d-d90e99c70257 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:09.773581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab86c4e-afaa-4c27-839d-d90e99c70257 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:09.775893 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bab86c4e-afaa-4c27-839d-d90e99c70257 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:09.888612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:09.891352 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab86c4e-afaa-4c27-839d-d90e99c70257 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:09.893569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab86c4e-afaa-4c27-839d-d90e99c70257 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:09.912144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 663/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:12.002318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240246df-e434-4297-baab-a06c3b22ed0a None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:12.002868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240246df-e434-4297-baab-a06c3b22ed0a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:12.002868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240246df-e434-4297-baab-a06c3b22ed0a None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:12.004212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 666/1329] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:12.010009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1824c5-f540-4213-95ed-268841a75a42 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:12.010422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1824c5-f540-4213-95ed-268841a75a42 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:12.010694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1824c5-f540-4213-95ed-268841a75a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:12.078674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6d1824c5-f540-4213-95ed-268841a75a42 None None] MFA Rules not processed for user `ede771e5606b4919bb7574deefd0336b`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:12.079975 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6d1824c5-f540-4213-95ed-268841a75a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:12.178347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 664/1330] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:12 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:12.216301 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240246df-e434-4297-baab-a06c3b22ed0a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:12.217877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-240246df-e434-4297-baab-a06c3b22ed0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:12.248776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:12.325485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240246df-e434-4297-baab-a06c3b22ed0a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:12.399343 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bd35d1-2ca1-4b0c-b70d-7786153d8c36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:12.400723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd35d1-2ca1-4b0c-b70d-7786153d8c36 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:12.401175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd35d1-2ca1-4b0c-b70d-7786153d8c36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:12.401631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bd35d1-2ca1-4b0c-b70d-7786153d8c36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:12.403311 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-17bd35d1-2ca1-4b0c-b70d-7786153d8c36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:12.481527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:12.513527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd35d1-2ca1-4b0c-b70d-7786153d8c36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:12.514971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bd35d1-2ca1-4b0c-b70d-7786153d8c36 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:12.533388 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 667/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:12 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:14.806163 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501fcfd-5873-436d-8dc5-c04d2d7efee3 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:14.806733 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501fcfd-5873-436d-8dc5-c04d2d7efee3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:14.806733 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8501fcfd-5873-436d-8dc5-c04d2d7efee3 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:14.808057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 665/1332] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:14.813084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c1cb0-0d76-425e-ad8d-55f6169d253c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:14.813540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c1cb0-0d76-425e-ad8d-55f6169d253c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:14.813681 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c1cb0-0d76-425e-ad8d-55f6169d253c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:14.877869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c32c1cb0-0d76-425e-ad8d-55f6169d253c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:14.879089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c32c1cb0-0d76-425e-ad8d-55f6169d253c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:14.972994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 668/1333] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:15.008704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501fcfd-5873-436d-8dc5-c04d2d7efee3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:15.010770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8501fcfd-5873-436d-8dc5-c04d2d7efee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:15.078334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:15.114060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8501fcfd-5873-436d-8dc5-c04d2d7efee3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:15.189226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4faf8615-32e2-452b-b9ed-c6e11755b256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:15.189889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf8615-32e2-452b-b9ed-c6e11755b256 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:15.190157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf8615-32e2-452b-b9ed-c6e11755b256 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:15.190429 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4faf8615-32e2-452b-b9ed-c6e11755b256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:15.192047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4faf8615-32e2-452b-b9ed-c6e11755b256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:15.303598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf8615-32e2-452b-b9ed-c6e11755b256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:15.305049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4faf8615-32e2-452b-b9ed-c6e11755b256 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:15.315773 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:15.324895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 666/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:17.446246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592980ec-51e4-4948-9d1e-3cfed4fbe505 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:17.447349 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592980ec-51e4-4948-9d1e-3cfed4fbe505 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:17.447349 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592980ec-51e4-4948-9d1e-3cfed4fbe505 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:17.448641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 669/1335] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:17.453774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5283d-850c-4e0a-bfcd-e45c337d21b7 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:17.454201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5283d-850c-4e0a-bfcd-e45c337d21b7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:17.454351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5283d-850c-4e0a-bfcd-e45c337d21b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:17.519501 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3ba5283d-850c-4e0a-bfcd-e45c337d21b7 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:17.520677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3ba5283d-850c-4e0a-bfcd-e45c337d21b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:17.615047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 667/1336] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:17.654992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592980ec-51e4-4948-9d1e-3cfed4fbe505 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:17.656509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-592980ec-51e4-4948-9d1e-3cfed4fbe505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:17.695819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:17.758432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592980ec-51e4-4948-9d1e-3cfed4fbe505 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:17.831177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54ec84-789c-4f4f-b450-e37a9d8ac3e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:17.831788 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54ec84-789c-4f4f-b450-e37a9d8ac3e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:17.832065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54ec84-789c-4f4f-b450-e37a9d8ac3e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:17.832333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54ec84-789c-4f4f-b450-e37a9d8ac3e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:17.833992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3a54ec84-789c-4f4f-b450-e37a9d8ac3e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:17.915414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:17.940620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54ec84-789c-4f4f-b450-e37a9d8ac3e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:17.942100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a54ec84-789c-4f4f-b450-e37a9d8ac3e3 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:17.959985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 670/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:20.327048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972ceed-eb7a-4ebe-bb28-3a3dab9ea67c None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:20.327562 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972ceed-eb7a-4ebe-bb28-3a3dab9ea67c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:20.327672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7972ceed-eb7a-4ebe-bb28-3a3dab9ea67c None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:20.328944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 668/1338] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:20.334026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39abe6b-6668-4e3b-ac6e-b38895f8962d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:20.334488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39abe6b-6668-4e3b-ac6e-b38895f8962d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:20.334595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39abe6b-6668-4e3b-ac6e-b38895f8962d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:20.400935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d39abe6b-6668-4e3b-ac6e-b38895f8962d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:20.402185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d39abe6b-6668-4e3b-ac6e-b38895f8962d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:20.498552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 671/1339] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:20.534253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972ceed-eb7a-4ebe-bb28-3a3dab9ea67c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:20.535791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7972ceed-eb7a-4ebe-bb28-3a3dab9ea67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:20.612869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:20.640516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7972ceed-eb7a-4ebe-bb28-3a3dab9ea67c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:20.711910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab51d99-78ac-4525-a1b8-44327c23e635 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:20.713030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab51d99-78ac-4525-a1b8-44327c23e635 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:20.713314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab51d99-78ac-4525-a1b8-44327c23e635 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:20.713596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab51d99-78ac-4525-a1b8-44327c23e635 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:20.715208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3ab51d99-78ac-4525-a1b8-44327c23e635 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:20.821782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab51d99-78ac-4525-a1b8-44327c23e635 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:20.823236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab51d99-78ac-4525-a1b8-44327c23e635 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:20.841336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 669/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:20 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:24.800225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749d7e7-76dd-4300-b701-0638e1ca5a8b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:24.800794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749d7e7-76dd-4300-b701-0638e1ca5a8b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:24.800794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b749d7e7-76dd-4300-b701-0638e1ca5a8b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:24.802193 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 672/1341] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:24.808073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce506848-a797-40cc-8833-c8abf36fad9a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:24.808522 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce506848-a797-40cc-8833-c8abf36fad9a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:24.808644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce506848-a797-40cc-8833-c8abf36fad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:24.814305 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:24.876632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ce506848-a797-40cc-8833-c8abf36fad9a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:24.877860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ce506848-a797-40cc-8833-c8abf36fad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:24.977268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 670/1342] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:25.018071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749d7e7-76dd-4300-b701-0638e1ca5a8b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:25.019732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b749d7e7-76dd-4300-b701-0638e1ca5a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:25.069150 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:25.126352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b749d7e7-76dd-4300-b701-0638e1ca5a8b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:25.200348 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7afa618-423f-4209-b0e0-d3afa54ec87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:25.200973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afa618-423f-4209-b0e0-d3afa54ec87d service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:25.201256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afa618-423f-4209-b0e0-d3afa54ec87d service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:25.201559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7afa618-423f-4209-b0e0-d3afa54ec87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:25.203181 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b7afa618-423f-4209-b0e0-d3afa54ec87d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:25.297335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:25.318510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afa618-423f-4209-b0e0-d3afa54ec87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:25.320068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7afa618-423f-4209-b0e0-d3afa54ec87d service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:25.338519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 673/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:27.965638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d30b15-a7c6-4aeb-bdc4-fc9e04a9fb51 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:27.966231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d30b15-a7c6-4aeb-bdc4-fc9e04a9fb51 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:27.966231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d30b15-a7c6-4aeb-bdc4-fc9e04a9fb51 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:27.967649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 671/1344] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:27.973395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee56cf4-43ff-4970-8f79-b5f027f5afde None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:27.973866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee56cf4-43ff-4970-8f79-b5f027f5afde None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:27.973984 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee56cf4-43ff-4970-8f79-b5f027f5afde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:28.051500 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8ee56cf4-43ff-4970-8f79-b5f027f5afde None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:28.052762 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8ee56cf4-43ff-4970-8f79-b5f027f5afde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:28.157638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 674/1345] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:27 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:28.194709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d30b15-a7c6-4aeb-bdc4-fc9e04a9fb51 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:28.196251 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-20d30b15-a7c6-4aeb-bdc4-fc9e04a9fb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:28.283912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:28.303424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d30b15-a7c6-4aeb-bdc4-fc9e04a9fb51 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:28.376032 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee890eb-b1c3-4fe3-96dc-59a0f4b8e80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:28.376566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee890eb-b1c3-4fe3-96dc-59a0f4b8e80e service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:28.376836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee890eb-b1c3-4fe3-96dc-59a0f4b8e80e service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:28.377099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee890eb-b1c3-4fe3-96dc-59a0f4b8e80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:28.378730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6ee890eb-b1c3-4fe3-96dc-59a0f4b8e80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:28.490142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee890eb-b1c3-4fe3-96dc-59a0f4b8e80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:28.491600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee890eb-b1c3-4fe3-96dc-59a0f4b8e80e service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:28.510508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 672/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:32.570872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093b0e3-2961-4255-9bef-29c8884f9aae None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:32.572006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093b0e3-2961-4255-9bef-29c8884f9aae None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:32.572101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0093b0e3-2961-4255-9bef-29c8884f9aae None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:32.573516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 675/1347] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:32.578879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9697f2-d6a8-4552-9796-a1f8b9909c77 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:32.579320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9697f2-d6a8-4552-9796-a1f8b9909c77 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:32.579446 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9697f2-d6a8-4552-9796-a1f8b9909c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:32.595850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:32.648619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0e9697f2-d6a8-4552-9796-a1f8b9909c77 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:32.649897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0e9697f2-d6a8-4552-9796-a1f8b9909c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:32.745428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 673/1348] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:32.783479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093b0e3-2961-4255-9bef-29c8884f9aae None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:32.784995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0093b0e3-2961-4255-9bef-29c8884f9aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:32.857825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:32.915894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0093b0e3-2961-4255-9bef-29c8884f9aae None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:32.995116 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02375b6e-e624-40e3-bd3a-85e485643e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:32.995737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02375b6e-e624-40e3-bd3a-85e485643e5c service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:32.996013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02375b6e-e624-40e3-bd3a-85e485643e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:32.996280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02375b6e-e624-40e3-bd3a-85e485643e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:32.997931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-02375b6e-e624-40e3-bd3a-85e485643e5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:33.109906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:33.114165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02375b6e-e624-40e3-bd3a-85e485643e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:33.116103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02375b6e-e624-40e3-bd3a-85e485643e5c service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:33.141739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 676/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:38.020210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23675334-b1d9-464a-afed-1237913d3e2f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:38.020682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23675334-b1d9-464a-afed-1237913d3e2f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:38.021205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23675334-b1d9-464a-afed-1237913d3e2f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:38.022195 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 674/1350] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 11:55:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:38.027450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ea98a-da2d-43e8-90f0-c65dda386c81 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:38.027839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ea98a-da2d-43e8-90f0-c65dda386c81 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:38.027995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ea98a-da2d-43e8-90f0-c65dda386c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:38.181898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f14ea98a-da2d-43e8-90f0-c65dda386c81 None None] MFA Rules not processed for user `35b5e545d75d40d0abb9c8d996e3b4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:38.183102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f14ea98a-da2d-43e8-90f0-c65dda386c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:38.315739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 677/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 11:55:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:42.506305 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46998886-11ae-4cb3-ba8e-a65e5df5e8b3 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:42.507162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46998886-11ae-4cb3-ba8e-a65e5df5e8b3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:42.507434 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46998886-11ae-4cb3-ba8e-a65e5df5e8b3 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:42.509013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 675/1352] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 11:55:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:42.514172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854e675-d7d7-4bcc-8f1d-da7e2aa5c1e9 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:42.514626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854e675-d7d7-4bcc-8f1d-da7e2aa5c1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:42.514721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854e675-d7d7-4bcc-8f1d-da7e2aa5c1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:42.576129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:42.601269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0854e675-d7d7-4bcc-8f1d-da7e2aa5c1e9 None None] MFA Rules not processed for user `35b5e545d75d40d0abb9c8d996e3b4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:42.603237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0854e675-d7d7-4bcc-8f1d-da7e2aa5c1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:42.715139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 678/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 11:55:42 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:42.743092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=59 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:43.945533 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db4b30-bbdc-4af4-883a-952961236791 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:43.946716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db4b30-bbdc-4af4-883a-952961236791 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:43.946716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db4b30-bbdc-4af4-883a-952961236791 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:43.948219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 676/1354] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 11:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:43.953415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f661517-4a9e-4245-8387-9987550555ac None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:43.953836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f661517-4a9e-4245-8387-9987550555ac None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:43.953975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f661517-4a9e-4245-8387-9987550555ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:44.032043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7f661517-4a9e-4245-8387-9987550555ac None None] MFA Rules not processed for user `35b5e545d75d40d0abb9c8d996e3b4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:44.033233 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7f661517-4a9e-4245-8387-9987550555ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:44.076003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:44.141351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 679/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 11:55:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 11:55:47.602097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e798120-6de1-429e-bd8a-82632abd61db None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:47.603225 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e798120-6de1-429e-bd8a-82632abd61db None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:47.603717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e798120-6de1-429e-bd8a-82632abd61db None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:47.605900 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 677/1356] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:47.611446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49360cca-768e-4db1-83ed-16ad83399942 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:47.612637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49360cca-768e-4db1-83ed-16ad83399942 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:47.613343 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49360cca-768e-4db1-83ed-16ad83399942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:47.688691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-49360cca-768e-4db1-83ed-16ad83399942 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:47.690015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-49360cca-768e-4db1-83ed-16ad83399942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:47.792667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 680/1357] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:47.846056 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dee6cf-bdbb-4e18-a0e7-13d175ab6559 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:47.847319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dee6cf-bdbb-4e18-a0e7-13d175ab6559 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:47.847601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dee6cf-bdbb-4e18-a0e7-13d175ab6559 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:47.849799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 678/1358] 10.222.0.42 () {54 vars in 962 bytes} [Mon Aug 1 11:55:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:47.860022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc486c05-76e6-42b2-a253-991eeda71a3b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:47.860309 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc486c05-76e6-42b2-a253-991eeda71a3b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:47.860584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc486c05-76e6-42b2-a253-991eeda71a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:47.880926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:47.947729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-bc486c05-76e6-42b2-a253-991eeda71a3b None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:47.948937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bc486c05-76e6-42b2-a253-991eeda71a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:48.088704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 681/1359] 10.222.0.42 () {58 vars in 1059 bytes} [Mon Aug 1 11:55:47 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:48.096870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dee6cf-bdbb-4e18-a0e7-13d175ab6559 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:48.098502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-67dee6cf-bdbb-4e18-a0e7-13d175ab6559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:48.271019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dee6cf-bdbb-4e18-a0e7-13d175ab6559 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:48.356714 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:48.400596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a482501f-f9d9-4f56-95d7-10bbd60b232e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:48.401373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482501f-f9d9-4f56-95d7-10bbd60b232e service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:48.401707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482501f-f9d9-4f56-95d7-10bbd60b232e service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:48.402045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a482501f-f9d9-4f56-95d7-10bbd60b232e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:48.403703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a482501f-f9d9-4f56-95d7-10bbd60b232e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:48.515827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482501f-f9d9-4f56-95d7-10bbd60b232e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:48.518696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a482501f-f9d9-4f56-95d7-10bbd60b232e service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:48.540724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 679/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:50.782234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013e6d-eb7e-40e1-b1f2-805392352ee7 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:50.782868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013e6d-eb7e-40e1-b1f2-805392352ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:50.782868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8013e6d-eb7e-40e1-b1f2-805392352ee7 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:50.784304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 682/1361] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:50.789579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c8d0c-3321-4e98-a271-a6a298dc7d05 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:50.790124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c8d0c-3321-4e98-a271-a6a298dc7d05 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:50.790124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c8d0c-3321-4e98-a271-a6a298dc7d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:50.862186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f17c8d0c-3321-4e98-a271-a6a298dc7d05 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:50.863304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f17c8d0c-3321-4e98-a271-a6a298dc7d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:50.904791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:50.968906 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 680/1362] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:51.015318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8013e6d-eb7e-40e1-b1f2-805392352ee7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:51.016964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a8013e6d-eb7e-40e1-b1f2-805392352ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:51.099629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:51.193861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8013e6d-eb7e-40e1-b1f2-805392352ee7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:51.327440 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f0764-3703-4251-849b-05d0c248df19 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:51.328060 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0764-3703-4251-849b-05d0c248df19 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:51.328338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0764-3703-4251-849b-05d0c248df19 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:51.328611 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f0764-3703-4251-849b-05d0c248df19 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:51.330494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ff0f0764-3703-4251-849b-05d0c248df19 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:51.357007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:51.427788 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f0764-3703-4251-849b-05d0c248df19 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:51.429428 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f0764-3703-4251-849b-05d0c248df19 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:51.447537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 683/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:53.810731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f7d2-787f-4e2d-a00f-8def1141916b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:53.811326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f7d2-787f-4e2d-a00f-8def1141916b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:53.811326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8f7d2-787f-4e2d-a00f-8def1141916b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:53.812714 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 681/1364] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:53.819097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f35f-d6f6-4236-82de-d92a7c3ca449 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:53.819581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f35f-d6f6-4236-82de-d92a7c3ca449 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:53.819865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae6f35f-d6f6-4236-82de-d92a7c3ca449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:53.906978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2ae6f35f-d6f6-4236-82de-d92a7c3ca449 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:53.908216 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2ae6f35f-d6f6-4236-82de-d92a7c3ca449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:54.023206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:54.026804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 684/1365] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:54.077156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e720c-ab2b-4bcb-bb18-9bd21c0ec128 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:54.077487 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e720c-ab2b-4bcb-bb18-9bd21c0ec128 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:54.077766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e720c-ab2b-4bcb-bb18-9bd21c0ec128 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:54.079099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 682/1366] 10.222.0.42 () {54 vars in 962 bytes} [Mon Aug 1 11:55:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:54.085365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a638a-1634-4f8a-9739-5eb7df486b37 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:54.085761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a638a-1634-4f8a-9739-5eb7df486b37 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:54.086168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a638a-1634-4f8a-9739-5eb7df486b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:54.174971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4b8a638a-1634-4f8a-9739-5eb7df486b37 None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:54.176229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4b8a638a-1634-4f8a-9739-5eb7df486b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:54.306894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 685/1367] 10.222.0.42 () {58 vars in 1059 bytes} [Mon Aug 1 11:55:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:54.315018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e720c-ab2b-4bcb-bb18-9bd21c0ec128 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:54.316573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-271e720c-ab2b-4bcb-bb18-9bd21c0ec128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:54.485280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e720c-ab2b-4bcb-bb18-9bd21c0ec128 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:54.507539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:54.608056 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b05273a-90bc-4c92-b41a-7a192989e490 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:54.608567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05273a-90bc-4c92-b41a-7a192989e490 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:54.608846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05273a-90bc-4c92-b41a-7a192989e490 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:54.609114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b05273a-90bc-4c92-b41a-7a192989e490 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:54.610767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7b05273a-90bc-4c92-b41a-7a192989e490 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:54.704680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05273a-90bc-4c92-b41a-7a192989e490 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:54.706345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b05273a-90bc-4c92-b41a-7a192989e490 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:54.725312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 683/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:55:55.721594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5291e35-c8d3-4c59-bc9b-56a4158be846 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:55.722132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5291e35-c8d3-4c59-bc9b-56a4158be846 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:55.722298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5291e35-c8d3-4c59-bc9b-56a4158be846 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:55.723935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 686/1369] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:55.729839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7885-abcc-4abc-8228-570bd6b54464 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:55.730242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7885-abcc-4abc-8228-570bd6b54464 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:55.730447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fe7885-abcc-4abc-8228-570bd6b54464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:55.763841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:55.801194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-66fe7885-abcc-4abc-8228-570bd6b54464 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:55.802440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-66fe7885-abcc-4abc-8228-570bd6b54464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:55.916966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 684/1370] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:56.265497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a9e9a-a98f-4c7c-87f0-9352109cd274 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:56.265497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a9e9a-a98f-4c7c-87f0-9352109cd274 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:56.265497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a9e9a-a98f-4c7c-87f0-9352109cd274 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:56.266811 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 687/1371] 10.222.0.42 () {54 vars in 964 bytes} [Mon Aug 1 11:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:56.271725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad71a44-6f18-4be6-ab39-89ffad092e74 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:56.272014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad71a44-6f18-4be6-ab39-89ffad092e74 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:56.272287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad71a44-6f18-4be6-ab39-89ffad092e74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:56.360149 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1ad71a44-6f18-4be6-ab39-89ffad092e74 None None] MFA Rules not processed for user `00d506205722431ba2995956c7981735`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:56.361421 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1ad71a44-6f18-4be6-ab39-89ffad092e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:56.410653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:56.443673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 685/1372] 10.222.0.42 () {58 vars in 1061 bytes} [Mon Aug 1 11:55:56 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:56.451347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a9e9a-a98f-4c7c-87f0-9352109cd274 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:56.452888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-846a9e9a-a98f-4c7c-87f0-9352109cd274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:56.506098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:56.568426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a9e9a-a98f-4c7c-87f0-9352109cd274 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:56.645983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7601ec-8f59-4947-ab9b-7756cb7de38c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:56.646624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7601ec-8f59-4947-ab9b-7756cb7de38c service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:56.646940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7601ec-8f59-4947-ab9b-7756cb7de38c service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:56.647251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7601ec-8f59-4947-ab9b-7756cb7de38c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:56.649482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8e7601ec-8f59-4947-ab9b-7756cb7de38c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:56.749597 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:56.764199 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7601ec-8f59-4947-ab9b-7756cb7de38c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:56.765841 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7601ec-8f59-4947-ab9b-7756cb7de38c service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:56.785106 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 688/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 11:55:56.787549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea28fd-8fba-4855-bb99-b526d746772a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:56.788036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea28fd-8fba-4855-bb99-b526d746772a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:56.788303 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea28fd-8fba-4855-bb99-b526d746772a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:56.790370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 686/1374] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:56.795976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f09cfd-f08b-4a0a-ae76-096b636b4f80 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:56.796260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f09cfd-f08b-4a0a-ae76-096b636b4f80 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:56.796533 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f09cfd-f08b-4a0a-ae76-096b636b4f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:56.870112 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f4f09cfd-f08b-4a0a-ae76-096b636b4f80 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:56.872835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f4f09cfd-f08b-4a0a-ae76-096b636b4f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:56.985804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 689/1375] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 11:55:57.027477 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea28fd-8fba-4855-bb99-b526d746772a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:57.029007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-45ea28fd-8fba-4855-bb99-b526d746772a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:57.182203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea28fd-8fba-4855-bb99-b526d746772a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:57.240031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:57.302573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a7e1b-a1bd-408a-a2fa-d85279d81379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:57.303255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a7e1b-a1bd-408a-a2fa-d85279d81379 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:57.303538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a7e1b-a1bd-408a-a2fa-d85279d81379 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:57.303806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a7e1b-a1bd-408a-a2fa-d85279d81379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:57.306220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-414a7e1b-a1bd-408a-a2fa-d85279d81379 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:57.394895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a7e1b-a1bd-408a-a2fa-d85279d81379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:55:57.396512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a7e1b-a1bd-408a-a2fa-d85279d81379 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:55:57.416020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 687/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 11:55:59.461784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cbef-c591-46e8-aa25-990820882d92 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:59.462304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cbef-c591-46e8-aa25-990820882d92 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:59.462304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6808cbef-c591-46e8-aa25-990820882d92 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:59.463600 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 690/1377] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:55:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:55:59.468669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82f8b-d953-40eb-bcae-9c11aa5f7300 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:59.469081 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82f8b-d953-40eb-bcae-9c11aa5f7300 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:59.469228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de82f8b-d953-40eb-bcae-9c11aa5f7300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:59.536170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0de82f8b-d953-40eb-bcae-9c11aa5f7300 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:55:59.537406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0de82f8b-d953-40eb-bcae-9c11aa5f7300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:59.545938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:59.643216 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 688/1378] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:55:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:55:59.689746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808cbef-c591-46e8-aa25-990820882d92 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:55:59.691272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6808cbef-c591-46e8-aa25-990820882d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:59.754029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:55:59.852535 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6808cbef-c591-46e8-aa25-990820882d92 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:55:59.968238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d05287-af34-4050-b80a-3c89e461a2fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:55:59.968867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d05287-af34-4050-b80a-3c89e461a2fc service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:55:59.969149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d05287-af34-4050-b80a-3c89e461a2fc service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:55:59.969497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d05287-af34-4050-b80a-3c89e461a2fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:55:59.971191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-69d05287-af34-4050-b80a-3c89e461a2fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:55:59.990261 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:00.065689 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d05287-af34-4050-b80a-3c89e461a2fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:00.067236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d05287-af34-4050-b80a-3c89e461a2fc service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:00.085444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 691/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:55:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:02.157604 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af587e36-8d63-451b-8f28-e241f50bc7ba None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:02.158123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af587e36-8d63-451b-8f28-e241f50bc7ba None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:02.158123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af587e36-8d63-451b-8f28-e241f50bc7ba None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:02.159497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 689/1380] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:02.165432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eecf56-09e2-4ef0-b5ca-77aeb926568e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:02.165878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eecf56-09e2-4ef0-b5ca-77aeb926568e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:02.165961 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55eecf56-09e2-4ef0-b5ca-77aeb926568e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:02.234330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-55eecf56-09e2-4ef0-b5ca-77aeb926568e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:02.235431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-55eecf56-09e2-4ef0-b5ca-77aeb926568e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:02.354409 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:02.365886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 692/1381] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:56:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:02.407796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af587e36-8d63-451b-8f28-e241f50bc7ba None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:02.409541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-af587e36-8d63-451b-8f28-e241f50bc7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:02.550065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:02.563482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af587e36-8d63-451b-8f28-e241f50bc7ba None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:02.690771 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb80ba0f-0f57-41d7-9d47-57414f613c40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:02.691387 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ba0f-0f57-41d7-9d47-57414f613c40 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:02.691661 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ba0f-0f57-41d7-9d47-57414f613c40 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:02.691929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb80ba0f-0f57-41d7-9d47-57414f613c40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:02.693590 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bb80ba0f-0f57-41d7-9d47-57414f613c40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:02.787664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80ba0f-0f57-41d7-9d47-57414f613c40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:02.789916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb80ba0f-0f57-41d7-9d47-57414f613c40 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:02.800805 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:02.809938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 690/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:05.032515 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e48f8-4acd-4548-8d6d-9627c350807a None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:05.033097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e48f8-4acd-4548-8d6d-9627c350807a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:05.033097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e48f8-4acd-4548-8d6d-9627c350807a None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:05.034593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 693/1383] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:56:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:05.042200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d1b21-8c0b-4c93-bda9-f8118f027792 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:05.042635 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d1b21-8c0b-4c93-bda9-f8118f027792 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:05.043083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d1b21-8c0b-4c93-bda9-f8118f027792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:05.128477 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-673d1b21-8c0b-4c93-bda9-f8118f027792 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:05.130106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-673d1b21-8c0b-4c93-bda9-f8118f027792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:05.230209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 691/1384] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:56:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 11:56:05.271906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e48f8-4acd-4548-8d6d-9627c350807a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:05.274013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1f5e48f8-4acd-4548-8d6d-9627c350807a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:05.450209 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e48f8-4acd-4548-8d6d-9627c350807a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:05.521591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:05.571330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2899b0d1-fa8f-49d2-9126-a0fa69f525b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:05.572274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899b0d1-fa8f-49d2-9126-a0fa69f525b1 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:05.572621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899b0d1-fa8f-49d2-9126-a0fa69f525b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:05.572973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2899b0d1-fa8f-49d2-9126-a0fa69f525b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:05.575077 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2899b0d1-fa8f-49d2-9126-a0fa69f525b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:05.672999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899b0d1-fa8f-49d2-9126-a0fa69f525b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:05.674670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2899b0d1-fa8f-49d2-9126-a0fa69f525b1 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:05.692573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 694/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:07.752794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271415ae-ce87-4ad5-ba6a-817392a11c6c None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:07.753508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271415ae-ce87-4ad5-ba6a-817392a11c6c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:07.753508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271415ae-ce87-4ad5-ba6a-817392a11c6c None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:07.754818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 692/1386] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:07.760612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325d6cb-89d6-4c32-bf12-890115ba1c68 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:07.761040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325d6cb-89d6-4c32-bf12-890115ba1c68 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:07.761406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2325d6cb-89d6-4c32-bf12-890115ba1c68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:07.845256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2325d6cb-89d6-4c32-bf12-890115ba1c68 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:07.846863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2325d6cb-89d6-4c32-bf12-890115ba1c68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:07.883383 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:07.950460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 695/1387] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:56:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:07.996181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271415ae-ce87-4ad5-ba6a-817392a11c6c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:07.997751 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-271415ae-ce87-4ad5-ba6a-817392a11c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:08.078610 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:08.160144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271415ae-ce87-4ad5-ba6a-817392a11c6c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:08.304056 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e5269-844e-4198-83cd-c6946ef5972f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:08.304823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e5269-844e-4198-83cd-c6946ef5972f service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:08.305073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e5269-844e-4198-83cd-c6946ef5972f service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:08.305455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e5269-844e-4198-83cd-c6946ef5972f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:08.307489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-636e5269-844e-4198-83cd-c6946ef5972f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:08.351672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:08.410569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e5269-844e-4198-83cd-c6946ef5972f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:08.412190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e5269-844e-4198-83cd-c6946ef5972f service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:08.430624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 693/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:10.728873 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f2b62-87f9-4c11-a058-0ea9a3effef2 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:10.729426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f2b62-87f9-4c11-a058-0ea9a3effef2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:10.729426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f2b62-87f9-4c11-a058-0ea9a3effef2 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:10.730715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 696/1389] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:56:10.735716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9f843-9d91-4479-99a7-59d7fe7ec694 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:10.736128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9f843-9d91-4479-99a7-59d7fe7ec694 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:10.736240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e9f843-9d91-4479-99a7-59d7fe7ec694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:10.802249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a1e9f843-9d91-4479-99a7-59d7fe7ec694 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:10.803418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a1e9f843-9d91-4479-99a7-59d7fe7ec694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:10.899543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 694/1390] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:56:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:10.942987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f2b62-87f9-4c11-a058-0ea9a3effef2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:10.944748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a85f2b62-87f9-4c11-a058-0ea9a3effef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:11.091301 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f2b62-87f9-4c11-a058-0ea9a3effef2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:11.108069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:11.205625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed0243-065b-45d1-818d-021ff270fc2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:11.206238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed0243-065b-45d1-818d-021ff270fc2c service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:11.206516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed0243-065b-45d1-818d-021ff270fc2c service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:11.206786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed0243-065b-45d1-818d-021ff270fc2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:11.208392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d0ed0243-065b-45d1-818d-021ff270fc2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:11.296731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed0243-065b-45d1-818d-021ff270fc2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:11.298378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed0243-065b-45d1-818d-021ff270fc2c service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:11.317093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 697/1391] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:11.865443 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a6107-fbc3-4c9f-bfc9-aa61a9ff16c9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:11.865986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a6107-fbc3-4c9f-bfc9-aa61a9ff16c9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:11.865986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a6107-fbc3-4c9f-bfc9-aa61a9ff16c9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:11.867999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 695/1392] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:11.873322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b911e-ee6b-4f02-a332-e6de49e7b1e5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:11.873773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b911e-ee6b-4f02-a332-e6de49e7b1e5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:11.873942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5b911e-ee6b-4f02-a332-e6de49e7b1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:11.900300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:11.941560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-dd5b911e-ee6b-4f02-a332-e6de49e7b1e5 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:11.942784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dd5b911e-ee6b-4f02-a332-e6de49e7b1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:12.039240 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 698/1393] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:56:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:12.094271 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a2b77-0712-4f38-9cc5-d3c3a2e8de9a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:12.094549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a2b77-0712-4f38-9cc5-d3c3a2e8de9a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:12.094817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a2b77-0712-4f38-9cc5-d3c3a2e8de9a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:12.096139 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 696/1394] 10.222.0.42 () {54 vars in 966 bytes} [Mon Aug 1 11:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:12.101786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271a21d-798a-4171-beb7-8464f3803858 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:12.102187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271a21d-798a-4171-beb7-8464f3803858 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:12.102468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2271a21d-798a-4171-beb7-8464f3803858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:12.183696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2271a21d-798a-4171-beb7-8464f3803858 None None] MFA Rules not processed for user `c358a2d9539c4ae2a5e12aa6f1ed6d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:12.184827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2271a21d-798a-4171-beb7-8464f3803858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:12.223936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:12.261009 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 699/1395] 10.222.0.42 () {58 vars in 1063 bytes} [Mon Aug 1 11:56:12 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:12.268608 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a2b77-0712-4f38-9cc5-d3c3a2e8de9a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:12.270183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-946a2b77-0712-4f38-9cc5-d3c3a2e8de9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:12.283655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:12.380796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a2b77-0712-4f38-9cc5-d3c3a2e8de9a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:12.457513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7079498-dad0-43e0-b2ab-5911801794e1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c358a2d9539c4ae2a5e12aa6f1ed6d61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:12.458054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7079498-dad0-43e0-b2ab-5911801794e1 service glance] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:12.458338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7079498-dad0-43e0-b2ab-5911801794e1 service glance] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:12.458614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7079498-dad0-43e0-b2ab-5911801794e1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:12.460813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b7079498-dad0-43e0-b2ab-5911801794e1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:12.529137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:12.570108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7079498-dad0-43e0-b2ab-5911801794e1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:12.571562 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7079498-dad0-43e0-b2ab-5911801794e1 service glance] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:12.590179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 697/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:13.322486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22691f-bbd1-4a33-afec-2e26fb7fef52 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:13.322959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22691f-bbd1-4a33-afec-2e26fb7fef52 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:13.322959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22691f-bbd1-4a33-afec-2e26fb7fef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:13.355592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359160d6-170c-4171-8dcc-8d7a7282d014 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:13.356110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359160d6-170c-4171-8dcc-8d7a7282d014 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:13.356306 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359160d6-170c-4171-8dcc-8d7a7282d014 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:13.357925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 698/1397] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:56:13.364047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f536e58-79b0-4ea5-abef-544c198a35be None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:13.364371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f536e58-79b0-4ea5-abef-544c198a35be None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:13.364645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f536e58-79b0-4ea5-abef-544c198a35be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:13.391390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fe22691f-bbd1-4a33-afec-2e26fb7fef52 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:13.392747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fe22691f-bbd1-4a33-afec-2e26fb7fef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:13.431436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5f536e58-79b0-4ea5-abef-544c198a35be None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:13.432655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5f536e58-79b0-4ea5-abef-544c198a35be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:13.481522 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 700/1398] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:13.531769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b73a-15a7-4017-a10d-038dccfffdc7 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:13.532056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b73a-15a7-4017-a10d-038dccfffdc7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:13.532361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c5b73a-15a7-4017-a10d-038dccfffdc7 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:13.533763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 701/1399] 10.222.0.42 () {54 vars in 943 bytes} [Mon Aug 1 11:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 11:56:13.533908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 699/1400] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 11:56:13.540023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162b236-b08d-4ec5-a532-64d83bd3127b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:13.540376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162b236-b08d-4ec5-a532-64d83bd3127b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:13.540838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162b236-b08d-4ec5-a532-64d83bd3127b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:13.581122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f536e58-79b0-4ea5-abef-544c198a35be None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:13.582327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5f536e58-79b0-4ea5-abef-544c198a35be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:13.609531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:13.610862 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:13.618468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d162b236-b08d-4ec5-a532-64d83bd3127b None None] MFA Rules not processed for user `e2dfb83ec65645459d41579b4b036ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:13.619675 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d162b236-b08d-4ec5-a532-64d83bd3127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:13.699419 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f536e58-79b0-4ea5-abef-544c198a35be None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:13.725283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 702/1401] 10.222.0.42 () {58 vars in 1040 bytes} [Mon Aug 1 11:56:13 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 11:56:13.735146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162b236-b08d-4ec5-a532-64d83bd3127b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:13.745058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162b236-b08d-4ec5-a532-64d83bd3127b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:13.814484 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f3290-7a10-404f-9b96-a29f01c6df16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:13.814867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f3290-7a10-404f-9b96-a29f01c6df16 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:13.815143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f3290-7a10-404f-9b96-a29f01c6df16 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:13.815471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f3290-7a10-404f-9b96-a29f01c6df16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:13.817402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5e3f3290-7a10-404f-9b96-a29f01c6df16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:13.841835 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:13.856736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36168d62-b236-4bc7-8a6c-be7d4369bf69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:13.857391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168d62-b236-4bc7-8a6c-be7d4369bf69 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:13.857672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168d62-b236-4bc7-8a6c-be7d4369bf69 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:13.858079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36168d62-b236-4bc7-8a6c-be7d4369bf69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:13.860051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-36168d62-b236-4bc7-8a6c-be7d4369bf69 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:13.863245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:13.919674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f3290-7a10-404f-9b96-a29f01c6df16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:13.921287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f3290-7a10-404f-9b96-a29f01c6df16 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:13.942854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 700/1402] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 11:56:13.972223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36168d62-b236-4bc7-8a6c-be7d4369bf69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:13.973886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36168d62-b236-4bc7-8a6c-be7d4369bf69 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:13.982227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 703/1403] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 11:56:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 11:56:15.971598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf654a-4883-4654-9b3a-1fb5108b7f0e None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:15.972160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf654a-4883-4654-9b3a-1fb5108b7f0e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:15.972160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf654a-4883-4654-9b3a-1fb5108b7f0e None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:15.973548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 701/1404] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:15.979130 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c72383-821b-4ed8-b9d1-96fcb6c4fc2a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:15.979581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c72383-821b-4ed8-b9d1-96fcb6c4fc2a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:15.979687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c72383-821b-4ed8-b9d1-96fcb6c4fc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:16.048165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e1c72383-821b-4ed8-b9d1-96fcb6c4fc2a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:16.049418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e1c72383-821b-4ed8-b9d1-96fcb6c4fc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:16.150151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:16.160164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 704/1405] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:56:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:16.207846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf654a-4883-4654-9b3a-1fb5108b7f0e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:16.209540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-52cf654a-4883-4654-9b3a-1fb5108b7f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:16.407632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:16.411164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf654a-4883-4654-9b3a-1fb5108b7f0e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:16.537133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab79e3f7-f42c-46f5-99c1-e7c3f6df88d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:16.537840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79e3f7-f42c-46f5-99c1-e7c3f6df88d9 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:16.538624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79e3f7-f42c-46f5-99c1-e7c3f6df88d9 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:16.538889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab79e3f7-f42c-46f5-99c1-e7c3f6df88d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:16.540502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ab79e3f7-f42c-46f5-99c1-e7c3f6df88d9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:16.639678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79e3f7-f42c-46f5-99c1-e7c3f6df88d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:16.641276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab79e3f7-f42c-46f5-99c1-e7c3f6df88d9 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:16.667815 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 702/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:18.738423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f0da2-912d-4b81-8a32-26f272328206 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:18.739008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f0da2-912d-4b81-8a32-26f272328206 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:18.739106 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f0da2-912d-4b81-8a32-26f272328206 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:18.742037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 705/1407] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:56:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:18.746480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7775-ec53-4438-ae4f-f23d07ea9a54 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:18.747016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7775-ec53-4438-ae4f-f23d07ea9a54 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:18.747016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807c7775-ec53-4438-ae4f-f23d07ea9a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:18.751569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:18.829845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-807c7775-ec53-4438-ae4f-f23d07ea9a54 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:18.831094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-807c7775-ec53-4438-ae4f-f23d07ea9a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:18.942708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 703/1408] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:56:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:18.999053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f0da2-912d-4b81-8a32-26f272328206 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:19.000576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-178f0da2-912d-4b81-8a32-26f272328206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:19.165246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f0da2-912d-4b81-8a32-26f272328206 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:19.238022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:19.300307 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7867c2-0f2a-4377-a7f0-257789df08d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:19.300847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7867c2-0f2a-4377-a7f0-257789df08d5 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:19.301121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7867c2-0f2a-4377-a7f0-257789df08d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:19.301419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7867c2-0f2a-4377-a7f0-257789df08d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:19.303053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8e7867c2-0f2a-4377-a7f0-257789df08d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:19.400941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7867c2-0f2a-4377-a7f0-257789df08d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:19.402583 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e7867c2-0f2a-4377-a7f0-257789df08d5 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:19.423939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 706/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:28.940420 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=64 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:29.421477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=64 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:36.348594 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220fa25-e347-4cd2-8023-6223742f899b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:36.349133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220fa25-e347-4cd2-8023-6223742f899b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:36.349133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3220fa25-e347-4cd2-8023-6223742f899b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:36.351324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 704/1410] 10.222.0.42 () {54 vars in 918 bytes} [Mon Aug 1 11:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:36.356750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67351e-4874-4cd1-9e2b-bc2ff137037a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:36.357204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67351e-4874-4cd1-9e2b-bc2ff137037a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:36.357333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c67351e-4874-4cd1-9e2b-bc2ff137037a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:36.437074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4c67351e-4874-4cd1-9e2b-bc2ff137037a None None] MFA Rules not processed for user `35b5e545d75d40d0abb9c8d996e3b4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:36.438334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4c67351e-4874-4cd1-9e2b-bc2ff137037a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:36.545712 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 707/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Aug 1 11:56:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 11:56:36.560271 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b9341-607f-4dc5-93c1-69abd80df6d4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:36.560493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b9341-607f-4dc5-93c1-69abd80df6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:36.560763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3b9341-607f-4dc5-93c1-69abd80df6d4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:36.562104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 705/1412] 10.222.0.42 () {54 vars in 918 bytes} [Mon Aug 1 11:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:36.566480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38d70d-a8b2-4c9e-bde1-7a079201dfd0 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:36.566764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38d70d-a8b2-4c9e-bde1-7a079201dfd0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:36.567033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e38d70d-a8b2-4c9e-bde1-7a079201dfd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:36.639208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:36.641997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4e38d70d-a8b2-4c9e-bde1-7a079201dfd0 None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:36.643707 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4e38d70d-a8b2-4c9e-bde1-7a079201dfd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:36.757982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 708/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Mon Aug 1 11:56:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:39.235318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c03d-96ee-4291-a53a-c00b6e5f23bd None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:39.235859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c03d-96ee-4291-a53a-c00b6e5f23bd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:39.235859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c2c03d-96ee-4291-a53a-c00b6e5f23bd None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:39.237096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 11:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:39.242977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d2df5-b298-4d7f-8285-65ed446f2ea2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:39.243423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d2df5-b298-4d7f-8285-65ed446f2ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:39.243527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d2df5-b298-4d7f-8285-65ed446f2ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:39.309155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-943d2df5-b298-4d7f-8285-65ed446f2ea2 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:39.310391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-943d2df5-b298-4d7f-8285-65ed446f2ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:39.364394 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:39.406575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 11:56:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:39.452239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2c03d-96ee-4291-a53a-c00b6e5f23bd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:39.452239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-95c2c03d-96ee-4291-a53a-c00b6e5f23bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:39.598006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c2c03d-96ee-4291-a53a-c00b6e5f23bd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:39.669488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:39.710098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f12658-6ce9-48ab-b4b2-7ad9c060622c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:39.710710 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f12658-6ce9-48ab-b4b2-7ad9c060622c service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:39.711164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f12658-6ce9-48ab-b4b2-7ad9c060622c service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:39.711439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f12658-6ce9-48ab-b4b2-7ad9c060622c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:39.713043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-44f12658-6ce9-48ab-b4b2-7ad9c060622c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:39.803836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f12658-6ce9-48ab-b4b2-7ad9c060622c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:39.805497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f12658-6ce9-48ab-b4b2-7ad9c060622c service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:39.823780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 707/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:40.717135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5de73-3d94-4824-bf37-bea84320db36 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:40.717701 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5de73-3d94-4824-bf37-bea84320db36 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:40.717701 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c5de73-3d94-4824-bf37-bea84320db36 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:40.719027 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 11:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:40.723983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdbedc-79a4-4ce4-b7fd-a958f40293bb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:40.724407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdbedc-79a4-4ce4-b7fd-a958f40293bb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:40.725040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbdbedc-79a4-4ce4-b7fd-a958f40293bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:40.800859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5dbdbedc-79a4-4ce4-b7fd-a958f40293bb None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:40.802096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5dbdbedc-79a4-4ce4-b7fd-a958f40293bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:40.829094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:40.899597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 11:56:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:41.050906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5de73-3d94-4824-bf37-bea84320db36 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:41.052455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e8c5de73-3d94-4824-bf37-bea84320db36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:41.194422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c5de73-3d94-4824-bf37-bea84320db36 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:41.233452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:41.305455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3e9e3-b5b4-4fcb-8e79-9df413dfa859 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:41.306076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3e9e3-b5b4-4fcb-8e79-9df413dfa859 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:41.306354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3e9e3-b5b4-4fcb-8e79-9df413dfa859 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:41.306625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3e9e3-b5b4-4fcb-8e79-9df413dfa859 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:41.308226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-94f3e9e3-b5b4-4fcb-8e79-9df413dfa859 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:41.395215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3e9e3-b5b4-4fcb-8e79-9df413dfa859 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:41.396915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3e9e3-b5b4-4fcb-8e79-9df413dfa859 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:41.414973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 711/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:42.297509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5b4e1-5963-4585-8e30-faf9885bcaf9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:42.298043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5b4e1-5963-4585-8e30-faf9885bcaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:42.298043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc5b4e1-5963-4585-8e30-faf9885bcaf9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:42.299403 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 11:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:42.305036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b176588-e842-4793-b078-020edc84e59a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:42.305486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b176588-e842-4793-b078-020edc84e59a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:42.305625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b176588-e842-4793-b078-020edc84e59a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:42.359899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:42.383099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6b176588-e842-4793-b078-020edc84e59a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:42.384537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6b176588-e842-4793-b078-020edc84e59a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:42.489432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 11:56:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:42.645680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5b4e1-5963-4585-8e30-faf9885bcaf9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:42.647151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5dc5b4e1-5963-4585-8e30-faf9885bcaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:42.790674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc5b4e1-5963-4585-8e30-faf9885bcaf9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:42.802560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:42.904361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a997fe6-9b33-4c9b-86c0-9bb38a08be29 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:42.904896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a997fe6-9b33-4c9b-86c0-9bb38a08be29 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:42.905171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a997fe6-9b33-4c9b-86c0-9bb38a08be29 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:42.905482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a997fe6-9b33-4c9b-86c0-9bb38a08be29 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:42.907099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4a997fe6-9b33-4c9b-86c0-9bb38a08be29 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:42.993914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a997fe6-9b33-4c9b-86c0-9bb38a08be29 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:42.995502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a997fe6-9b33-4c9b-86c0-9bb38a08be29 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:43.013829 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 710/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:43.872790 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94915-206a-4b99-8ea3-141779d278e5 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:43.873379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94915-206a-4b99-8ea3-141779d278e5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:43.873379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f94915-206a-4b99-8ea3-141779d278e5 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:43.874737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 11:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:43.879635 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949655d1-a41a-4aa1-abb4-9b5b5dc3416e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:43.880065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949655d1-a41a-4aa1-abb4-9b5b5dc3416e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:43.880170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949655d1-a41a-4aa1-abb4-9b5b5dc3416e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:43.900777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:43.957309 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-949655d1-a41a-4aa1-abb4-9b5b5dc3416e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:43.958519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-949655d1-a41a-4aa1-abb4-9b5b5dc3416e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:44.053386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 11:56:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:44.202801 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f94915-206a-4b99-8ea3-141779d278e5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:44.204259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a4f94915-206a-4b99-8ea3-141779d278e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:44.313757 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:44.350623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f94915-206a-4b99-8ea3-141779d278e5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:44.466771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c075fce-0986-47cb-8dec-0b4991d4584c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:44.467312 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c075fce-0986-47cb-8dec-0b4991d4584c service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:44.467604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c075fce-0986-47cb-8dec-0b4991d4584c service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:44.467868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c075fce-0986-47cb-8dec-0b4991d4584c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:44.469521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5c075fce-0986-47cb-8dec-0b4991d4584c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:44.544187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:44.558384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c075fce-0986-47cb-8dec-0b4991d4584c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:44.560000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c075fce-0986-47cb-8dec-0b4991d4584c service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:44.578083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 714/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:45.452653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e025056-8bf6-41da-a1fc-2ac755749c26 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:45.453209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e025056-8bf6-41da-a1fc-2ac755749c26 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:45.453209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e025056-8bf6-41da-a1fc-2ac755749c26 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:45.454503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 11:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:45.459511 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f7f5d-5527-425f-8a38-d1228bb72b2e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:45.459954 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f7f5d-5527-425f-8a38-d1228bb72b2e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:45.460053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f7f5d-5527-425f-8a38-d1228bb72b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:45.654070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-287f7f5d-5527-425f-8a38-d1228bb72b2e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:45.655293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-287f7f5d-5527-425f-8a38-d1228bb72b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:45.750414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 11:56:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:45.901915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e025056-8bf6-41da-a1fc-2ac755749c26 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:45.903439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3e025056-8bf6-41da-a1fc-2ac755749c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:45.986563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:46.049070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e025056-8bf6-41da-a1fc-2ac755749c26 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:46.158907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1c62e-47b0-47c8-9928-7a7d42613de4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:46.159516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c62e-47b0-47c8-9928-7a7d42613de4 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:46.159794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c62e-47b0-47c8-9928-7a7d42613de4 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:46.160064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c62e-47b0-47c8-9928-7a7d42613de4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:46.161701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-65a1c62e-47b0-47c8-9928-7a7d42613de4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:46.207874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:46.249495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1c62e-47b0-47c8-9928-7a7d42613de4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:46.251099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1c62e-47b0-47c8-9928-7a7d42613de4 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:46.268498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 713/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:47.073358 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0c9f-507f-4240-9d3f-dc7dc0186b2b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:47.073923 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0c9f-507f-4240-9d3f-dc7dc0186b2b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:47.074051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0f0c9f-507f-4240-9d3f-dc7dc0186b2b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:47.075371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 11:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:47.080269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe2b8-c467-4ac8-b0f3-4de526817c40 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:47.080704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe2b8-c467-4ac8-b0f3-4de526817c40 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:47.080811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cbe2b8-c467-4ac8-b0f3-4de526817c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:47.157498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-38cbe2b8-c467-4ac8-b0f3-4de526817c40 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:47.158705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-38cbe2b8-c467-4ac8-b0f3-4de526817c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:47.258108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 11:56:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:47.408444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0c9f-507f-4240-9d3f-dc7dc0186b2b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:47.409971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1c0f0c9f-507f-4240-9d3f-dc7dc0186b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:47.457174 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:47.551935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0f0c9f-507f-4240-9d3f-dc7dc0186b2b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:47.673766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f76585-ee4b-4fc6-86ae-62b690b0265a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:47.674294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f76585-ee4b-4fc6-86ae-62b690b0265a service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:47.674571 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f76585-ee4b-4fc6-86ae-62b690b0265a service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:47.674841 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f76585-ee4b-4fc6-86ae-62b690b0265a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:47.676460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-84f76585-ee4b-4fc6-86ae-62b690b0265a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:47.683761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:47.764920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f76585-ee4b-4fc6-86ae-62b690b0265a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:47.766540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f76585-ee4b-4fc6-86ae-62b690b0265a service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:47.784517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 717/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:48.590165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8557a83-7358-4ac7-aa70-f6dd1b1e2ef4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:48.590742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8557a83-7358-4ac7-aa70-f6dd1b1e2ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:48.590742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8557a83-7358-4ac7-aa70-f6dd1b1e2ef4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:48.591994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 11:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:48.597057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72e82-fe1f-43dd-b16a-4c34099efa27 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:48.597492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72e82-fe1f-43dd-b16a-4c34099efa27 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:48.597650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea72e82-fe1f-43dd-b16a-4c34099efa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:48.673893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9ea72e82-fe1f-43dd-b16a-4c34099efa27 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:48.675097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9ea72e82-fe1f-43dd-b16a-4c34099efa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:48.741925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:48.770750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 11:56:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:48.921339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8557a83-7358-4ac7-aa70-f6dd1b1e2ef4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:48.922802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e8557a83-7358-4ac7-aa70-f6dd1b1e2ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:48.940408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:49.069200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8557a83-7358-4ac7-aa70-f6dd1b1e2ef4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:49.154531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:49.188721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3a380-8715-4550-b462-1d7258d6e583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:49.189262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3a380-8715-4550-b462-1d7258d6e583 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:49.189639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3a380-8715-4550-b462-1d7258d6e583 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:49.190113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3a380-8715-4550-b462-1d7258d6e583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:49.192777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a7f3a380-8715-4550-b462-1d7258d6e583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:49.282303 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3a380-8715-4550-b462-1d7258d6e583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:49.283894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3a380-8715-4550-b462-1d7258d6e583 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:49.302197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 716/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 11:56:50.111327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9b3b9-fb9f-4272-8ec6-6b607fe7e843 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:50.111995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9b3b9-fb9f-4272-8ec6-6b607fe7e843 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:50.111995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9b3b9-fb9f-4272-8ec6-6b607fe7e843 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:50.113355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 11:56:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:50.119137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0d500-54bc-4e13-9a64-81616640c232 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:50.119578 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0d500-54bc-4e13-9a64-81616640c232 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:50.119687 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0d500-54bc-4e13-9a64-81616640c232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:50.197793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bdb0d500-54bc-4e13-9a64-81616640c232 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:50.199000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bdb0d500-54bc-4e13-9a64-81616640c232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:50.239755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:50.293893 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 11:56:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:50.453056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9b3b9-fb9f-4272-8ec6-6b607fe7e843 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:50.454530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c7e9b3b9-fb9f-4272-8ec6-6b607fe7e843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:50.598072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9b3b9-fb9f-4272-8ec6-6b607fe7e843 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:50.651928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:50.709317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706e721-2a17-4aed-9075-a995cc5862b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:50.709861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706e721-2a17-4aed-9075-a995cc5862b1 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:50.710132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706e721-2a17-4aed-9075-a995cc5862b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:50.710394 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706e721-2a17-4aed-9075-a995cc5862b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:50.711978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1706e721-2a17-4aed-9075-a995cc5862b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:50.799631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706e721-2a17-4aed-9075-a995cc5862b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:50.801223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706e721-2a17-4aed-9075-a995cc5862b1 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:50.819774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 720/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:51.622041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951dc1a-640c-484e-85a1-41ae4551397c None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:51.622617 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951dc1a-640c-484e-85a1-41ae4551397c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:51.622617 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951dc1a-640c-484e-85a1-41ae4551397c None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:51.623949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 11:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:51.628882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e32c2c-83c5-4770-87e2-74f0e9ed8bc6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:51.629363 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e32c2c-83c5-4770-87e2-74f0e9ed8bc6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:51.629480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e32c2c-83c5-4770-87e2-74f0e9ed8bc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:51.704673 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-36e32c2c-83c5-4770-87e2-74f0e9ed8bc6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:51.705882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-36e32c2c-83c5-4770-87e2-74f0e9ed8bc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:51.707839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:51.802586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 11:56:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:51.952260 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951dc1a-640c-484e-85a1-41ae4551397c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:51.953767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6951dc1a-640c-484e-85a1-41ae4551397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:52.097169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951dc1a-640c-484e-85a1-41ae4551397c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:52.128088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:52.216245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf94d74-b12c-4f03-a5e8-95633670bb77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:52.216795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf94d74-b12c-4f03-a5e8-95633670bb77 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:52.217055 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf94d74-b12c-4f03-a5e8-95633670bb77 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:52.217351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf94d74-b12c-4f03-a5e8-95633670bb77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:52.218974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-faf94d74-b12c-4f03-a5e8-95633670bb77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:52.308122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf94d74-b12c-4f03-a5e8-95633670bb77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:52.309775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf94d74-b12c-4f03-a5e8-95633670bb77 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:52.328051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 719/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:54.258762 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfbe12-9ebe-4af0-bb6e-2a4a5edb4f6b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:54.259306 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfbe12-9ebe-4af0-bb6e-2a4a5edb4f6b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:54.259406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddfbe12-9ebe-4af0-bb6e-2a4a5edb4f6b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:54.260829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 11:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:54.266108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf4bc5-2afa-4f54-9d76-164400bc639a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:54.266526 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf4bc5-2afa-4f54-9d76-164400bc639a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:54.266637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bf4bc5-2afa-4f54-9d76-164400bc639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:54.308189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:54.333711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a0bf4bc5-2afa-4f54-9d76-164400bc639a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:54.334939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a0bf4bc5-2afa-4f54-9d76-164400bc639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:54.430634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 11:56:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:54.469119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfbe12-9ebe-4af0-bb6e-2a4a5edb4f6b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:54.470709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3ddfbe12-9ebe-4af0-bb6e-2a4a5edb4f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:54.578615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddfbe12-9ebe-4af0-bb6e-2a4a5edb4f6b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:54.609612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:54.650813 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0503f-106e-4181-815b-4a1e51448dd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:54.651417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0503f-106e-4181-815b-4a1e51448dd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:54.651693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0503f-106e-4181-815b-4a1e51448dd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:54.651963 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0503f-106e-4181-815b-4a1e51448dd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:54.653586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-66c0503f-106e-4181-815b-4a1e51448dd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:54.762142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0503f-106e-4181-815b-4a1e51448dd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:54.763607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0503f-106e-4181-815b-4a1e51448dd9 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:54.780943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 723/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:56.901758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab619e72-d3aa-48df-9efa-cd83717e6ef7 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:56.902284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab619e72-d3aa-48df-9efa-cd83717e6ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:56.902284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab619e72-d3aa-48df-9efa-cd83717e6ef7 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:56.903632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 11:56:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:56.908868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fcb3a-9560-49fc-9a62-e703fde1f186 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:56.909335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fcb3a-9560-49fc-9a62-e703fde1f186 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:56.909452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fcb3a-9560-49fc-9a62-e703fde1f186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:56.975020 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2e2fcb3a-9560-49fc-9a62-e703fde1f186 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:56.976205 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2e2fcb3a-9560-49fc-9a62-e703fde1f186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:56.988694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:57.069549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 11:56:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:57.108334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab619e72-d3aa-48df-9efa-cd83717e6ef7 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:57.109890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ab619e72-d3aa-48df-9efa-cd83717e6ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:57.212391 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab619e72-d3aa-48df-9efa-cd83717e6ef7 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:56:57.224830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:57.286326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af87a4-089c-4123-a6bd-22dbbdade847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:56:57.286950 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af87a4-089c-4123-a6bd-22dbbdade847 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:57.287275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af87a4-089c-4123-a6bd-22dbbdade847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:57.287549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af87a4-089c-4123-a6bd-22dbbdade847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:57.289183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-35af87a4-089c-4123-a6bd-22dbbdade847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:57.397161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af87a4-089c-4123-a6bd-22dbbdade847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:56:57.398593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af87a4-089c-4123-a6bd-22dbbdade847 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:56:57.416343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 722/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:56:59.761776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a5a70-7553-4c64-87e3-107230e2090a None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:59.762335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a5a70-7553-4c64-87e3-107230e2090a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:59.762335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a5a70-7553-4c64-87e3-107230e2090a None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:59.763678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 11:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:56:59.768797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76b09-27ad-4440-9de2-c0e6bc6f2a98 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:56:59.769209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76b09-27ad-4440-9de2-c0e6bc6f2a98 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:56:59.769397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff76b09-27ad-4440-9de2-c0e6bc6f2a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:56:59.817151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:56:59.835533 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-aff76b09-27ad-4440-9de2-c0e6bc6f2a98 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:56:59.836736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-aff76b09-27ad-4440-9de2-c0e6bc6f2a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:56:59.932565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 11:56:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:56:59.971900 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a5a70-7553-4c64-87e3-107230e2090a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:56:59.973439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-864a5a70-7553-4c64-87e3-107230e2090a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:00.073912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864a5a70-7553-4c64-87e3-107230e2090a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:00.112642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:00.145487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e691f0f-e136-4e22-bcca-f15d317ea76f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:00.146092 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e691f0f-e136-4e22-bcca-f15d317ea76f service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:00.146366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e691f0f-e136-4e22-bcca-f15d317ea76f service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:00.147248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e691f0f-e136-4e22-bcca-f15d317ea76f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:00.149173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5e691f0f-e136-4e22-bcca-f15d317ea76f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:00.262342 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e691f0f-e136-4e22-bcca-f15d317ea76f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:00.263780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e691f0f-e136-4e22-bcca-f15d317ea76f service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:00.282078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 726/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:56:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:02.407957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c7a30-8e4e-428e-8350-ed19bedc219e None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:02.408482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c7a30-8e4e-428e-8350-ed19bedc219e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:02.408482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1c7a30-8e4e-428e-8350-ed19bedc219e None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:02.409947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 11:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:02.415565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646e090-94be-4222-8632-9dafe64baa2f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:02.415983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646e090-94be-4222-8632-9dafe64baa2f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:02.416129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d646e090-94be-4222-8632-9dafe64baa2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:02.481973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d646e090-94be-4222-8632-9dafe64baa2f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:02.483188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d646e090-94be-4222-8632-9dafe64baa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:02.506168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:02.587130 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 11:57:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:57:02.626890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c7a30-8e4e-428e-8350-ed19bedc219e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:02.628435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0b1c7a30-8e4e-428e-8350-ed19bedc219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:02.730518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1c7a30-8e4e-428e-8350-ed19bedc219e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:02.749657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:02.803603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7ad060-7b0e-4693-8521-cfe2293f67ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:02.804214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ad060-7b0e-4693-8521-cfe2293f67ea service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:02.804490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ad060-7b0e-4693-8521-cfe2293f67ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:02.804760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7ad060-7b0e-4693-8521-cfe2293f67ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:02.806401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9f7ad060-7b0e-4693-8521-cfe2293f67ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:02.913084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ad060-7b0e-4693-8521-cfe2293f67ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:02.914477 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7ad060-7b0e-4693-8521-cfe2293f67ea service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:02.931898 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 725/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:04.989817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29677249-6349-4754-9e96-ba5025f57503 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:04.990293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29677249-6349-4754-9e96-ba5025f57503 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:04.990407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29677249-6349-4754-9e96-ba5025f57503 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:04.991742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 11:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:04.996941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f107a6e-42c7-44fa-8b30-5e5d289c9a7f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:04.997409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f107a6e-42c7-44fa-8b30-5e5d289c9a7f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:04.997517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f107a6e-42c7-44fa-8b30-5e5d289c9a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:05.060513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:05.063177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7f107a6e-42c7-44fa-8b30-5e5d289c9a7f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:05.064888 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7f107a6e-42c7-44fa-8b30-5e5d289c9a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:05.158978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 11:57:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:57:05.197186 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29677249-6349-4754-9e96-ba5025f57503 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:05.198751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-29677249-6349-4754-9e96-ba5025f57503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:05.304505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29677249-6349-4754-9e96-ba5025f57503 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:05.352917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:05.377223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243cd4b-d80e-4ebe-9c85-4819c2848674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:05.377866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243cd4b-d80e-4ebe-9c85-4819c2848674 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:05.378140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243cd4b-d80e-4ebe-9c85-4819c2848674 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:05.378405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243cd4b-d80e-4ebe-9c85-4819c2848674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:05.380002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a243cd4b-d80e-4ebe-9c85-4819c2848674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:05.488706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243cd4b-d80e-4ebe-9c85-4819c2848674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:05.490167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243cd4b-d80e-4ebe-9c85-4819c2848674 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:05.517068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 729/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:07.630619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa91613-b99d-4bde-91c8-bbc9f6144c6a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:07.631689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa91613-b99d-4bde-91c8-bbc9f6144c6a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:07.631938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa91613-b99d-4bde-91c8-bbc9f6144c6a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:07.633287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 11:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:07.638484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1837-7e3f-4961-ab2a-168fc26ce671 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:07.638883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1837-7e3f-4961-ab2a-168fc26ce671 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:07.639086 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f1837-7e3f-4961-ab2a-168fc26ce671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:07.704265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7a5f1837-7e3f-4961-ab2a-168fc26ce671 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:07.705478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7a5f1837-7e3f-4961-ab2a-168fc26ce671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:07.734836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:07.802226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 11:57:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:57:07.840909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa91613-b99d-4bde-91c8-bbc9f6144c6a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:07.842519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ffa91613-b99d-4bde-91c8-bbc9f6144c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:07.942879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa91613-b99d-4bde-91c8-bbc9f6144c6a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:07.971450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:08.017026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33bb22c-8936-464a-98d6-7b7fbd461b85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:08.017671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bb22c-8936-464a-98d6-7b7fbd461b85 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:08.017958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bb22c-8936-464a-98d6-7b7fbd461b85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:08.018231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33bb22c-8936-464a-98d6-7b7fbd461b85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:08.019846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e33bb22c-8936-464a-98d6-7b7fbd461b85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:08.127133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bb22c-8936-464a-98d6-7b7fbd461b85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:08.128568 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33bb22c-8936-464a-98d6-7b7fbd461b85 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:08.146977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 728/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:10.193528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7601ae-9933-49e4-9383-295829770c13 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:10.194702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7601ae-9933-49e4-9383-295829770c13 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:10.194702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7601ae-9933-49e4-9383-295829770c13 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:10.195966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 11:57:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:10.201122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605c7e0-6050-4514-a9e5-b24a5d94f6a0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:10.201601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605c7e0-6050-4514-a9e5-b24a5d94f6a0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:10.201738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7605c7e0-6050-4514-a9e5-b24a5d94f6a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:10.268776 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7605c7e0-6050-4514-a9e5-b24a5d94f6a0 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:10.270020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7605c7e0-6050-4514-a9e5-b24a5d94f6a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:10.278347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:10.369422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 11:57:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 11:57:10.406654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7601ae-9933-49e4-9383-295829770c13 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:10.408173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2a7601ae-9933-49e4-9383-295829770c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:10.512027 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7601ae-9933-49e4-9383-295829770c13 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:10.567069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:10.588305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50eb994c-e5ba-4854-a54a-c22f6d2a5b1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:10.588920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb994c-e5ba-4854-a54a-c22f6d2a5b1b service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:10.589196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb994c-e5ba-4854-a54a-c22f6d2a5b1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:10.589493 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50eb994c-e5ba-4854-a54a-c22f6d2a5b1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:10.591100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-50eb994c-e5ba-4854-a54a-c22f6d2a5b1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:10.698154 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb994c-e5ba-4854-a54a-c22f6d2a5b1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:10.699589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50eb994c-e5ba-4854-a54a-c22f6d2a5b1b service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:10.717750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 732/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:12.752254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c4a23-6634-42cd-903d-cdcfe03c0ea1 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:12.752796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c4a23-6634-42cd-903d-cdcfe03c0ea1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:12.752796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c4a23-6634-42cd-903d-cdcfe03c0ea1 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:12.754187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 11:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:12.759941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137fb75-9be5-4f80-ba0c-389da4ca8d24 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:12.760364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137fb75-9be5-4f80-ba0c-389da4ca8d24 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:12.760479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137fb75-9be5-4f80-ba0c-389da4ca8d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:12.824928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4137fb75-9be5-4f80-ba0c-389da4ca8d24 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:12.826161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4137fb75-9be5-4f80-ba0c-389da4ca8d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:12.866126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:12.924562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 11:57:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:57:12.962268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c4a23-6634-42cd-903d-cdcfe03c0ea1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:12.963803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6b7c4a23-6634-42cd-903d-cdcfe03c0ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:13.065966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c4a23-6634-42cd-903d-cdcfe03c0ea1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:13.103204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:13.139115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e195c305-f507-48fc-824e-de3bbb985b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:13.139724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195c305-f507-48fc-824e-de3bbb985b86 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:13.140005 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195c305-f507-48fc-824e-de3bbb985b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:13.140273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e195c305-f507-48fc-824e-de3bbb985b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:13.141911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e195c305-f507-48fc-824e-de3bbb985b86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:13.251051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195c305-f507-48fc-824e-de3bbb985b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:13.252506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e195c305-f507-48fc-824e-de3bbb985b86 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:13.271059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 731/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:15.271962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e4b3a-6b83-4932-8dd8-9ae9f5a59fd1 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:15.273028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e4b3a-6b83-4932-8dd8-9ae9f5a59fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:15.273149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e4b3a-6b83-4932-8dd8-9ae9f5a59fd1 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:15.274561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 11:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:15.279772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3b19-1ca8-444b-a473-3b0050c86aa3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:15.280188 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3b19-1ca8-444b-a473-3b0050c86aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:15.280330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a3b19-1ca8-444b-a473-3b0050c86aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:15.345992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-690a3b19-1ca8-444b-a473-3b0050c86aa3 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:15.347192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-690a3b19-1ca8-444b-a473-3b0050c86aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:15.366775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:15.445881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 11:57:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:57:15.482169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e4b3a-6b83-4932-8dd8-9ae9f5a59fd1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:15.483690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-428e4b3a-6b83-4932-8dd8-9ae9f5a59fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:15.586558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e4b3a-6b83-4932-8dd8-9ae9f5a59fd1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:15.654819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:15.665012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c028fa1-fcdd-4071-b80f-a3757ab34552 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:15.666164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c028fa1-fcdd-4071-b80f-a3757ab34552 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:15.666643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c028fa1-fcdd-4071-b80f-a3757ab34552 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:15.667089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c028fa1-fcdd-4071-b80f-a3757ab34552 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:15.668949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1c028fa1-fcdd-4071-b80f-a3757ab34552 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:15.792253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c028fa1-fcdd-4071-b80f-a3757ab34552 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:15.793735 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c028fa1-fcdd-4071-b80f-a3757ab34552 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:15.811710 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 735/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:17.851659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640c65-b54d-45b7-b545-ec2a22eac12f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:17.852214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640c65-b54d-45b7-b545-ec2a22eac12f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:17.852214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64640c65-b54d-45b7-b545-ec2a22eac12f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:17.853861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 11:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:17.859176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaa058-8eeb-4629-b8dd-a7d6350be075 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:17.859560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaa058-8eeb-4629-b8dd-a7d6350be075 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:17.859786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eaa058-8eeb-4629-b8dd-a7d6350be075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:17.924318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-82eaa058-8eeb-4629-b8dd-a7d6350be075 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:17.925570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-82eaa058-8eeb-4629-b8dd-a7d6350be075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:17.973198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:18.022160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 11:57:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:57:18.059064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640c65-b54d-45b7-b545-ec2a22eac12f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:18.060638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-64640c65-b54d-45b7-b545-ec2a22eac12f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:18.163760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64640c65-b54d-45b7-b545-ec2a22eac12f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:18.211046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:18.236554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86bb98a-3b7f-4575-a13e-f079c9bc7f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:18.237166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb98a-3b7f-4575-a13e-f079c9bc7f5b service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:18.237471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb98a-3b7f-4575-a13e-f079c9bc7f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:18.237743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86bb98a-3b7f-4575-a13e-f079c9bc7f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:18.239348 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a86bb98a-3b7f-4575-a13e-f079c9bc7f5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:18.347000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bb98a-3b7f-4575-a13e-f079c9bc7f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:18.348445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86bb98a-3b7f-4575-a13e-f079c9bc7f5b service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:18.366845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 734/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:28.020255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=22 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:28.364007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=66 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:38.004806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d0e74-b474-4c24-b6b2-d4a74eabe16b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:38.005483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d0e74-b474-4c24-b6b2-d4a74eabe16b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:38.005483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d0e74-b474-4c24-b6b2-d4a74eabe16b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:38.006748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 737/1471] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:38.012558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583dfdd-5afe-44ee-b86e-e547761bf5f3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:38.012984 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583dfdd-5afe-44ee-b86e-e547761bf5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:38.013095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f583dfdd-5afe-44ee-b86e-e547761bf5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:38.085417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f583dfdd-5afe-44ee-b86e-e547761bf5f3 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:38.093890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f583dfdd-5afe-44ee-b86e-e547761bf5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:38.189860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 735/1472] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:57:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:57:38.274310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59fd17-1899-43b7-94c1-ae9b973f3cbe None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:38.274310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59fd17-1899-43b7-94c1-ae9b973f3cbe None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:38.274592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c59fd17-1899-43b7-94c1-ae9b973f3cbe None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:38.275989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 738/1473] 10.222.0.42 () {54 vars in 966 bytes} [Mon Aug 1 11:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:38.281958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d79dd-90b9-4a23-b4b9-98725b770887 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:38.282256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d79dd-90b9-4a23-b4b9-98725b770887 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:38.282559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454d79dd-90b9-4a23-b4b9-98725b770887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:38.358873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-454d79dd-90b9-4a23-b4b9-98725b770887 None None] MFA Rules not processed for user `c358a2d9539c4ae2a5e12aa6f1ed6d61`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:38.360092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-454d79dd-90b9-4a23-b4b9-98725b770887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:38.381229 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:38.442394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 736/1474] 10.222.0.42 () {58 vars in 1063 bytes} [Mon Aug 1 11:57:38 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 11:57:38.450077 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59fd17-1899-43b7-94c1-ae9b973f3cbe None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:38.451607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4c59fd17-1899-43b7-94c1-ae9b973f3cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:38.557511 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c59fd17-1899-43b7-94c1-ae9b973f3cbe None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:38.631815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ed549-f811-48e8-b09d-9dbc31685e1d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c358a2d9539c4ae2a5e12aa6f1ed6d61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:38.632435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ed549-f811-48e8-b09d-9dbc31685e1d service glance] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:38.632713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ed549-f811-48e8-b09d-9dbc31685e1d service glance] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:38.632982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ed549-f811-48e8-b09d-9dbc31685e1d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:38.634637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-506ed549-f811-48e8-b09d-9dbc31685e1d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:38.691510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:38.750407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ed549-f811-48e8-b09d-9dbc31685e1d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:38.751920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ed549-f811-48e8-b09d-9dbc31685e1d service glance] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:38.770057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 739/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:40.828334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14e357-6f8f-47c8-9b4e-c01e2332acfe None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:40.828906 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14e357-6f8f-47c8-9b4e-c01e2332acfe None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:40.828906 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14e357-6f8f-47c8-9b4e-c01e2332acfe None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:40.830371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 737/1476] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:40.836237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30773c-20d9-4d39-9d79-f0a2dce09fa5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:40.836688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30773c-20d9-4d39-9d79-f0a2dce09fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:40.836795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30773c-20d9-4d39-9d79-f0a2dce09fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:40.900530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ff30773c-20d9-4d39-9d79-f0a2dce09fa5 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:40.901758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ff30773c-20d9-4d39-9d79-f0a2dce09fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:40.997775 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 740/1477] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:57:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:57:41.020778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14e357-6f8f-47c8-9b4e-c01e2332acfe None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:41.022428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ce14e357-6f8f-47c8-9b4e-c01e2332acfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:41.150913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14e357-6f8f-47c8-9b4e-c01e2332acfe None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:41.199293 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:41.245494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d42791f-dc69-499c-8771-46353788baeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:41.246107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42791f-dc69-499c-8771-46353788baeb admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:41.246391 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42791f-dc69-499c-8771-46353788baeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:41.246659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d42791f-dc69-499c-8771-46353788baeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:41.247351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42791f-dc69-499c-8771-46353788baeb admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:41.249143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-1d42791f-dc69-499c-8771-46353788baeb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 11:57:41.249143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 11:57:41.249143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: Aug 01 11:57:41.250360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d42791f-dc69-499c-8771-46353788baeb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:41.269157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 738/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Mon Aug 1 11:57:41 2022] GET /identity/v3/projects => generated 2553 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 11:57:43.304399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7349bcc-4f8a-4e27-ae53-2add436ad0b8 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:43.304845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7349bcc-4f8a-4e27-ae53-2add436ad0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:43.304951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7349bcc-4f8a-4e27-ae53-2add436ad0b8 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:43.306362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 741/1479] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:43.311560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d18c0-67e5-4b2b-acc7-952f9daa5241 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:43.311977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d18c0-67e5-4b2b-acc7-952f9daa5241 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:43.312106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606d18c0-67e5-4b2b-acc7-952f9daa5241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:43.377674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-606d18c0-67e5-4b2b-acc7-952f9daa5241 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:43.378893 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-606d18c0-67e5-4b2b-acc7-952f9daa5241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:43.474327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 739/1480] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:57:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:57:43.518953 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7349bcc-4f8a-4e27-ae53-2add436ad0b8 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:43.520548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e7349bcc-4f8a-4e27-ae53-2add436ad0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:43.530472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:43.664942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7349bcc-4f8a-4e27-ae53-2add436ad0b8 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:43.743773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:43.776376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561fc9f2-8645-4352-bd9f-d0faa1a573fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:43.776986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fc9f2-8645-4352-bd9f-d0faa1a573fc service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:43.777262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fc9f2-8645-4352-bd9f-d0faa1a573fc service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:43.777566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561fc9f2-8645-4352-bd9f-d0faa1a573fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:43.779165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-561fc9f2-8645-4352-bd9f-d0faa1a573fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:43.869475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fc9f2-8645-4352-bd9f-d0faa1a573fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:43.871069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561fc9f2-8645-4352-bd9f-d0faa1a573fc service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:43.888769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 742/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:46.084912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd04098-e0a6-4255-ac4e-2c3ec017dacf None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:46.085480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd04098-e0a6-4255-ac4e-2c3ec017dacf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:46.085480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd04098-e0a6-4255-ac4e-2c3ec017dacf None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:46.087380 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 740/1482] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:57:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:46.092584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db03e2-0625-46a2-9781-fc2a65582ca2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:46.092971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db03e2-0625-46a2-9781-fc2a65582ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:46.093139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db03e2-0625-46a2-9781-fc2a65582ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:46.158016 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c3db03e2-0625-46a2-9781-fc2a65582ca2 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:46.159232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c3db03e2-0625-46a2-9781-fc2a65582ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:46.204233 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:46.254842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 743/1483] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:57:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 11:57:46.292120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd04098-e0a6-4255-ac4e-2c3ec017dacf None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:46.293761 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1bd04098-e0a6-4255-ac4e-2c3ec017dacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:46.317276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:46.397358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd04098-e0a6-4255-ac4e-2c3ec017dacf None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:46.469706 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb2c245-3b75-4d84-8163-efbd42fffd88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:46.470323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2c245-3b75-4d84-8163-efbd42fffd88 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:46.470602 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2c245-3b75-4d84-8163-efbd42fffd88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:46.470870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb2c245-3b75-4d84-8163-efbd42fffd88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:46.472489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8bb2c245-3b75-4d84-8163-efbd42fffd88 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:46.546058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:46.581765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2c245-3b75-4d84-8163-efbd42fffd88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:46.583237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb2c245-3b75-4d84-8163-efbd42fffd88 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:46.604343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 741/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:48.670310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da54f9-dfda-49de-a7fa-b16596bc2f9b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:48.670729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da54f9-dfda-49de-a7fa-b16596bc2f9b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:48.670859 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37da54f9-dfda-49de-a7fa-b16596bc2f9b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:48.672221 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 744/1485] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:48.677351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5124-1781-4130-91b1-c26f1bfd43f6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:48.677780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5124-1781-4130-91b1-c26f1bfd43f6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:48.677905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b5124-1781-4130-91b1-c26f1bfd43f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:48.742747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-850b5124-1781-4130-91b1-c26f1bfd43f6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:48.743986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-850b5124-1781-4130-91b1-c26f1bfd43f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:48.840663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 742/1486] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:57:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:57:48.878021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da54f9-dfda-49de-a7fa-b16596bc2f9b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:48.879543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-37da54f9-dfda-49de-a7fa-b16596bc2f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:48.982781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37da54f9-dfda-49de-a7fa-b16596bc2f9b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:49.055521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:49.057511 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a3b4c-881e-424a-8801-af1a437d265b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:49.058335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a3b4c-881e-424a-8801-af1a437d265b service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:49.058782 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a3b4c-881e-424a-8801-af1a437d265b service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:49.059240 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a3b4c-881e-424a-8801-af1a437d265b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:49.060862 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-948a3b4c-881e-424a-8801-af1a437d265b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:49.168130 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a3b4c-881e-424a-8801-af1a437d265b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:49.169587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a3b4c-881e-424a-8801-af1a437d265b service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:49.188380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 745/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:51.357144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5cae2-163c-4ba1-95fc-35e10130d9be None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:51.357724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5cae2-163c-4ba1-95fc-35e10130d9be None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:51.357724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed5cae2-163c-4ba1-95fc-35e10130d9be None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:51.359112 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 743/1488] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:51.364192 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86e98d-34a9-4a62-959d-93df377fee3e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:51.364606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86e98d-34a9-4a62-959d-93df377fee3e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:51.364734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb86e98d-34a9-4a62-959d-93df377fee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:51.430257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-cb86e98d-34a9-4a62-959d-93df377fee3e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:51.431467 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cb86e98d-34a9-4a62-959d-93df377fee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:51.483010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:51.531959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 746/1489] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:57:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:57:51.572664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5cae2-163c-4ba1-95fc-35e10130d9be None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:51.574261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-eed5cae2-163c-4ba1-95fc-35e10130d9be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:51.610414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:51.677471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed5cae2-163c-4ba1-95fc-35e10130d9be None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:51.750128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dad9016-4583-4c1f-ba58-d28e1037c143 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:51.750742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad9016-4583-4c1f-ba58-d28e1037c143 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:51.751375 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad9016-4583-4c1f-ba58-d28e1037c143 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:51.751650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dad9016-4583-4c1f-ba58-d28e1037c143 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:51.753251 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1dad9016-4583-4c1f-ba58-d28e1037c143 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:51.842921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:51.876360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad9016-4583-4c1f-ba58-d28e1037c143 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:51.877854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dad9016-4583-4c1f-ba58-d28e1037c143 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:51.897947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 744/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:57:54.103606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede994f-7478-404c-b769-cfdc280148ee None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:54.104144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede994f-7478-404c-b769-cfdc280148ee None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:54.104144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede994f-7478-404c-b769-cfdc280148ee None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:54.105864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 747/1491] 10.222.0.42 () {54 vars in 926 bytes} [Mon Aug 1 11:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:57:54.111011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd97f1-fbd3-4efc-b44e-6f9601e93fdc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:54.111439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd97f1-fbd3-4efc-b44e-6f9601e93fdc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:54.111547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edd97f1-fbd3-4efc-b44e-6f9601e93fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:54.176780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5edd97f1-fbd3-4efc-b44e-6f9601e93fdc None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:57:54.177990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5edd97f1-fbd3-4efc-b44e-6f9601e93fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:54.273722 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 745/1492] 10.222.0.42 () {58 vars in 1023 bytes} [Mon Aug 1 11:57:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:57:54.312645 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede994f-7478-404c-b769-cfdc280148ee None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:57:54.314225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2ede994f-7478-404c-b769-cfdc280148ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:54.416558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede994f-7478-404c-b769-cfdc280148ee None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:57:54.487508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29fe41b-16ec-498f-84a7-3170d1daee5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:57:54.488142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fe41b-16ec-498f-84a7-3170d1daee5c service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:57:54.488417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fe41b-16ec-498f-84a7-3170d1daee5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:57:54.488685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29fe41b-16ec-498f-84a7-3170d1daee5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:57:54.490321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e29fe41b-16ec-498f-84a7-3170d1daee5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:57:54.499864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:57:54.596861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fe41b-16ec-498f-84a7-3170d1daee5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:57:54.598237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29fe41b-16ec-498f-84a7-3170d1daee5c service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:57:54.616806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 748/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:57:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:58:04.271876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=82 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:58:04.614338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=50 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:59:22.246667 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bf49e-a667-45af-990a-ead8b1239808 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:22.247317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bf49e-a667-45af-990a-ead8b1239808 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:22.247317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94bf49e-a667-45af-990a-ead8b1239808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:22.324285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c94bf49e-a667-45af-990a-ead8b1239808 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:59:22.325537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c94bf49e-a667-45af-990a-ead8b1239808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:22.423141 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 746/1494] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 11:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:59:22.431984 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b46ce-2150-4390-8241-98113e1df44a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:22.432506 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b46ce-2150-4390-8241-98113e1df44a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:22.432609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b46ce-2150-4390-8241-98113e1df44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:22.508277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-982b46ce-2150-4390-8241-98113e1df44a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:59:22.509481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-982b46ce-2150-4390-8241-98113e1df44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:22.602089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 749/1495] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 11:59:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:59:22.608163 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bf49e-a667-45af-990a-ead8b1239808 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:59:22.610182 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c94bf49e-a667-45af-990a-ead8b1239808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:22.623168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94bf49e-a667-45af-990a-ead8b1239808 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:59:22.683417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:59:22.716586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba456415-a5ea-4db8-8a66-ccacb5b8af16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:59:22.717203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba456415-a5ea-4db8-8a66-ccacb5b8af16 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:22.717581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba456415-a5ea-4db8-8a66-ccacb5b8af16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:22.717853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba456415-a5ea-4db8-8a66-ccacb5b8af16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:22.718538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba456415-a5ea-4db8-8a66-ccacb5b8af16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 11:59:22.718837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba456415-a5ea-4db8-8a66-ccacb5b8af16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:59:22.719856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-ba456415-a5ea-4db8-8a66-ccacb5b8af16 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 11:59:22.719856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 11:59:22.719856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: Aug 01 11:59:22.720745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba456415-a5ea-4db8-8a66-ccacb5b8af16 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:59:22.732223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 747/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 11:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 11:59:22.741189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b46ce-2150-4390-8241-98113e1df44a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:59:22.750961 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b46ce-2150-4390-8241-98113e1df44a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:59:22.814768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:59:22.849520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf484ae7-b609-4126-a860-bec2e453a4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:59:22.850143 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484ae7-b609-4126-a860-bec2e453a4bb admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:22.850424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484ae7-b609-4126-a860-bec2e453a4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:22.850695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf484ae7-b609-4126-a860-bec2e453a4bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:22.851368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf484ae7-b609-4126-a860-bec2e453a4bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:59:22.853695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-bf484ae7-b609-4126-a860-bec2e453a4bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 11:59:22.853695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 11:59:22.853695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: Aug 01 11:59:22.854891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf484ae7-b609-4126-a860-bec2e453a4bb admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:59:22.909833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 750/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 11:59:22 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:59:22.913957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba456415-a5ea-4db8-8a66-ccacb5b8af16 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:59:22.916125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ba456415-a5ea-4db8-8a66-ccacb5b8af16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:22.949979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba456415-a5ea-4db8-8a66-ccacb5b8af16 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:59:23.046312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218649b7-ad79-4252-9f2f-1ad0e07edbe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:59:23.046924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218649b7-ad79-4252-9f2f-1ad0e07edbe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:23.047200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218649b7-ad79-4252-9f2f-1ad0e07edbe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:23.047471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218649b7-ad79-4252-9f2f-1ad0e07edbe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:23.048138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218649b7-ad79-4252-9f2f-1ad0e07edbe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:59:23.049151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-218649b7-ad79-4252-9f2f-1ad0e07edbe8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 11:59:23.049151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 11:59:23.049151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: Aug 01 11:59:23.050396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218649b7-ad79-4252-9f2f-1ad0e07edbe8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:59:23.091693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 748/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 11:59:22 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 11:59:23.095877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf484ae7-b609-4126-a860-bec2e453a4bb admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:59:23.097406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bf484ae7-b609-4126-a860-bec2e453a4bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:23.158975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf484ae7-b609-4126-a860-bec2e453a4bb admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:59:23.242084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:59:23.253377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ead05-09bc-4d82-80a7-99d653790f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:59:23.254004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ead05-09bc-4d82-80a7-99d653790f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:23.254285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ead05-09bc-4d82-80a7-99d653790f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:23.254557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ead05-09bc-4d82-80a7-99d653790f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:23.255251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ead05-09bc-4d82-80a7-99d653790f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:59:23.256262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-163ead05-09bc-4d82-80a7-99d653790f5e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 11:59:23.256262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 11:59:23.256262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: Aug 01 11:59:23.257148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ead05-09bc-4d82-80a7-99d653790f5e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:59:23.270088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 751/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 11:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 11:59:23.274087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218649b7-ad79-4252-9f2f-1ad0e07edbe8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:59:23.276223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-218649b7-ad79-4252-9f2f-1ad0e07edbe8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:23.287702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218649b7-ad79-4252-9f2f-1ad0e07edbe8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:59:23.312235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:59:23.380351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bbd13-8f9b-4731-988d-d0bca1020558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:59:23.380888 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bbd13-8f9b-4731-988d-d0bca1020558 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:23.381158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bbd13-8f9b-4731-988d-d0bca1020558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:23.381449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bbd13-8f9b-4731-988d-d0bca1020558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:23.382130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bbd13-8f9b-4731-988d-d0bca1020558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:59:23.383143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-3f4bbd13-8f9b-4731-988d-d0bca1020558 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 11:59:23.383143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 11:59:23.383143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: Aug 01 11:59:23.384544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bbd13-8f9b-4731-988d-d0bca1020558 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:59:23.396454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 749/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 11:59:23 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 11:59:23.401374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ead05-09bc-4d82-80a7-99d653790f5e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:59:23.402943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-163ead05-09bc-4d82-80a7-99d653790f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:23.435628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ead05-09bc-4d82-80a7-99d653790f5e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:59:23.528995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033bb7f2-b03c-4a6c-9942-211fa70f80e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:59:23.529680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb7f2-b03c-4a6c-9942-211fa70f80e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:23.529958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb7f2-b03c-4a6c-9942-211fa70f80e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:23.530227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb7f2-b03c-4a6c-9942-211fa70f80e1 admin admin] PATH_INFO: `/v3/projects/368e48f065414d09b86b40bb4d3ed8ad/users/123c09e5209e4573b2f4a9cb01e5b02b/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:23.551535 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bb7f2-b03c-4a6c-9942-211fa70f80e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=368e48f065414d09b86b40bb4d3ed8ad, user_id=123c09e5209e4573b2f4a9cb01e5b02b, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:59:23.552561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-033bb7f2-b03c-4a6c-9942-211fa70f80e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 11:59:23.552561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 11:59:23.552561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: Aug 01 11:59:23.554575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033bb7f2-b03c-4a6c-9942-211fa70f80e1 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:59:23.579570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 752/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 11:59:23 2022] PUT /identity/v3/projects/368e48f065414d09b86b40bb4d3ed8ad/users/123c09e5209e4573b2f4a9cb01e5b02b/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 11:59:23.591647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7594ec-4942-45da-b00e-a48cc0cb6483 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:23.591933 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7594ec-4942-45da-b00e-a48cc0cb6483 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:23.592208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7594ec-4942-45da-b00e-a48cc0cb6483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:23.650343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9c7594ec-4942-45da-b00e-a48cc0cb6483 None None] MFA Rules not processed for user `123c09e5209e4573b2f4a9cb01e5b02b`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:59:23.651463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9c7594ec-4942-45da-b00e-a48cc0cb6483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:23.726532 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 750/1502] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 11:59:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:59:23.739808 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dd1b6-47c0-4083-8b7a-61c757fd77a4 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:23.740096 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dd1b6-47c0-4083-8b7a-61c757fd77a4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:23.740371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2dd1b6-47c0-4083-8b7a-61c757fd77a4 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:23.741764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 753/1503] 10.222.0.42 () {54 vars in 964 bytes} [Mon Aug 1 11:59:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:59:23.747015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66721a-aeba-4c2b-810f-00732b34b5b4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:23.747299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66721a-aeba-4c2b-810f-00732b34b5b4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:23.747591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66721a-aeba-4c2b-810f-00732b34b5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:23.778816 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:59:23.823803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0a66721a-aeba-4c2b-810f-00732b34b5b4 None None] MFA Rules not processed for user `00d506205722431ba2995956c7981735`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:59:23.825006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0a66721a-aeba-4c2b-810f-00732b34b5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:23.900816 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 751/1504] 10.222.0.42 () {58 vars in 1061 bytes} [Mon Aug 1 11:59:23 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:59:23.908918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dd1b6-47c0-4083-8b7a-61c757fd77a4 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:59:23.910470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ce2dd1b6-47c0-4083-8b7a-61c757fd77a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:23.960891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:59:24.014827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2dd1b6-47c0-4083-8b7a-61c757fd77a4 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:59:24.087663 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a77e2-0ed2-4f63-b67a-2d21fe7d1dc1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:59:24.088320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a77e2-0ed2-4f63-b67a-2d21fe7d1dc1 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:24.088603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a77e2-0ed2-4f63-b67a-2d21fe7d1dc1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:24.088879 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a77e2-0ed2-4f63-b67a-2d21fe7d1dc1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:24.090605 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a62a77e2-0ed2-4f63-b67a-2d21fe7d1dc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:24.187515 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a77e2-0ed2-4f63-b67a-2d21fe7d1dc1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:59:24.188870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a77e2-0ed2-4f63-b67a-2d21fe7d1dc1 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:59:24.192400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:59:24.211526 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 754/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:59:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:59:24.259841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52b1cc-c443-4db1-8b1c-8884b97c6094 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:24.260131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52b1cc-c443-4db1-8b1c-8884b97c6094 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:24.260408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae52b1cc-c443-4db1-8b1c-8884b97c6094 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:24.261717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 752/1506] 10.222.0.42 () {52 vars in 830 bytes} [Mon Aug 1 11:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 11:59:24.265336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a77e2-0ed2-4f63-b67a-2d21fe7d1dc1 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:59:24.266545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a62a77e2-0ed2-4f63-b67a-2d21fe7d1dc1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:24.365844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a77e2-0ed2-4f63-b67a-2d21fe7d1dc1 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:59:24.457185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:59:24.457867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:24.458064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:24.458339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] PATH_INFO: `/v3/users/123c09e5209e4573b2f4a9cb01e5b02b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:24.470983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=123c09e5209e4573b2f4a9cb01e5b02b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:59:24.472004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 11:59:24.472004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 11:59:24.472004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: Aug 01 11:59:24.473216 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:59:24.483639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:59:24.541252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123c09e5209e4573b2f4a9cb01e5b02b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 11:59:24.566056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123c09e5209e4573b2f4a9cb01e5b02b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 11:59:24.597021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123c09e5209e4573b2f4a9cb01e5b02b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 11:59:24.597810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123c09e5209e4573b2f4a9cb01e5b02b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 11:59:24.614065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123c09e5209e4573b2f4a9cb01e5b02b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 11:59:24.620860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 755/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 11:59:24 2022] DELETE /identity/v3/users/123c09e5209e4573b2f4a9cb01e5b02b => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:59:24.625242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54e8c-04d9-49f9-a6a1-4be7df69a04e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:24.625761 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54e8c-04d9-49f9-a6a1-4be7df69a04e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:24.625861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac54e8c-04d9-49f9-a6a1-4be7df69a04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:24.802383 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1ac54e8c-04d9-49f9-a6a1-4be7df69a04e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 11:59:24.803575 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1ac54e8c-04d9-49f9-a6a1-4be7df69a04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:24.877210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:59:24.890408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 753/1508] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 11:59:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 11:59:24.902575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:59:24.903856 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:25.007831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ad669-b654-4151-a73d-b4e4919c3e60 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:59:25.061541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:59:25.082087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e6ecde-74bb-440f-9399-8e187056710a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:59:25.082708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6ecde-74bb-440f-9399-8e187056710a service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:25.082984 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6ecde-74bb-440f-9399-8e187056710a service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:25.083253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e6ecde-74bb-440f-9399-8e187056710a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:25.084858 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-74e6ecde-74bb-440f-9399-8e187056710a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:25.189308 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6ecde-74bb-440f-9399-8e187056710a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:59:25.190747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e6ecde-74bb-440f-9399-8e187056710a service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:59:25.209051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 756/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 11:59:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 11:59:25.545099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac54e8c-04d9-49f9-a6a1-4be7df69a04e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 11:59:25.546385 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1ac54e8c-04d9-49f9-a6a1-4be7df69a04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 11:59:25.558277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac54e8c-04d9-49f9-a6a1-4be7df69a04e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 11:59:25.658506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 11:59:25.659177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 11:59:25.659413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 11:59:25.659684 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] PATH_INFO: `/v3/projects/368e48f065414d09b86b40bb4d3ed8ad` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 11:59:25.670397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] RBAC: Authorizing `identity:delete_project(project_id=368e48f065414d09b86b40bb4d3ed8ad)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 11:59:25.671429 dv-cinder-850320-2-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 11:59:25.671429 dv-cinder-850320-2-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 11:59:25.671429 dv-cinder-850320-2-smb devstack@keystone.service[80141]: Aug 01 11:59:25.672642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 11:59:25.728765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '368e48f065414d09b86b40bb4d3ed8ad', 'request_id': 'req-444738e5-3da7-4760-ab68-8a90344b963b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 11:59:25.735169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '368e48f065414d09b86b40bb4d3ed8ad', 'request_id': 'req-444738e5-3da7-4760-ab68-8a90344b963b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 11:59:25.743255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '368e48f065414d09b86b40bb4d3ed8ad', 'request_id': 'req-444738e5-3da7-4760-ab68-8a90344b963b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 11:59:25.774071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] The token cache is being invalidate because project 368e48f065414d09b86b40bb4d3ed8ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 11:59:25.774370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 11:59:25.775401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-444738e5-3da7-4760-ab68-8a90344b963b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 11:59:25.776691 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 754/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 11:59:25 2022] DELETE /identity/v3/projects/368e48f065414d09b86b40bb4d3ed8ad => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 11:59:35.206821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=62 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 11:59:35.772140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:01:10.837158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa024e61-03fc-439a-8b07-0b4b7e6d9804 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:10.837793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa024e61-03fc-439a-8b07-0b4b7e6d9804 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:10.837793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa024e61-03fc-439a-8b07-0b4b7e6d9804 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:10.839146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 12:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:01:10.843968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a4c79-3614-4c18-a18f-29ed20f36ed8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:10.844425 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a4c79-3614-4c18-a18f-29ed20f36ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:10.844537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79a4c79-3614-4c18-a18f-29ed20f36ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:10.925696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e79a4c79-3614-4c18-a18f-29ed20f36ed8 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:01:10.927030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e79a4c79-3614-4c18-a18f-29ed20f36ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:11.028816 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 12:01:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:01:11.185140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa024e61-03fc-439a-8b07-0b4b7e6d9804 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:01:11.187289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fa024e61-03fc-439a-8b07-0b4b7e6d9804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:11.305858 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa024e61-03fc-439a-8b07-0b4b7e6d9804 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:01:11.312963 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65962a69-c64c-40d0-9499-2301541690aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:01:11.313625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65962a69-c64c-40d0-9499-2301541690aa service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:11.313917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65962a69-c64c-40d0-9499-2301541690aa service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:11.314194 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65962a69-c64c-40d0-9499-2301541690aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:11.322620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65962a69-c64c-40d0-9499-2301541690aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:01:11.324217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65962a69-c64c-40d0-9499-2301541690aa service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:01:11.336453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 758/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:01:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:01:12.161385 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f79899-e4d4-4e0e-8a3a-7a269746f33c None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:12.161974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f79899-e4d4-4e0e-8a3a-7a269746f33c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:12.161974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f79899-e4d4-4e0e-8a3a-7a269746f33c None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:12.163278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 12:01:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:01:12.168175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17506ef-9d21-4c9b-a7da-65e9fd0a196c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:12.168605 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17506ef-9d21-4c9b-a7da-65e9fd0a196c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:12.169407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17506ef-9d21-4c9b-a7da-65e9fd0a196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:12.188433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c17506ef-9d21-4c9b-a7da-65e9fd0a196c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:01:12.189673 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c17506ef-9d21-4c9b-a7da-65e9fd0a196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:12.197593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 12:01:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:01:12.348787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f79899-e4d4-4e0e-8a3a-7a269746f33c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:01:12.364692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f79899-e4d4-4e0e-8a3a-7a269746f33c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:01:12.370415 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd62db88-6d09-4586-9f1e-913de5885bdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:01:12.371042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62db88-6d09-4586-9f1e-913de5885bdd service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:12.371321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62db88-6d09-4586-9f1e-913de5885bdd service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:12.371595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd62db88-6d09-4586-9f1e-913de5885bdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:12.380767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62db88-6d09-4586-9f1e-913de5885bdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:01:12.382408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd62db88-6d09-4586-9f1e-913de5885bdd service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:01:12.392358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 757/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:01:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:01:12.693633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28acafa-7e2c-4373-9218-fb71c12643a4 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:12.693857 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28acafa-7e2c-4373-9218-fb71c12643a4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:12.694103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28acafa-7e2c-4373-9218-fb71c12643a4 None None] PATH_INFO: `/v3` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:12.695442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 760/1517] 10.222.0.36 () {54 vars in 925 bytes} [Mon Aug 1 12:01:12 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:01:12.703069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f408f17-fec0-436e-949e-0f594878f3b9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:12.703351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f408f17-fec0-436e-949e-0f594878f3b9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:12.703623 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f408f17-fec0-436e-949e-0f594878f3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:12.763662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6f408f17-fec0-436e-949e-0f594878f3b9 None None] MFA Rules not processed for user `35b5e545d75d40d0abb9c8d996e3b4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:01:12.764869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6f408f17-fec0-436e-949e-0f594878f3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:12.782204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:01:12.836119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 758/1518] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Aug 1 12:01:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:01:22.111186 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312ea68-11a4-41ae-b4cd-986c76ec95be None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:22.111713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312ea68-11a4-41ae-b4cd-986c76ec95be None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:22.111713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312ea68-11a4-41ae-b4cd-986c76ec95be None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:22.113006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 761/1519] 10.222.0.42 () {54 vars in 961 bytes} [Mon Aug 1 12:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:01:22.117931 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830b910-169f-4051-9b67-36cbc80d40df None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:22.118351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830b910-169f-4051-9b67-36cbc80d40df None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:22.118459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830b910-169f-4051-9b67-36cbc80d40df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:22.137308 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7830b910-169f-4051-9b67-36cbc80d40df None None] MFA Rules not processed for user `35b5e545d75d40d0abb9c8d996e3b4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:01:22.138516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7830b910-169f-4051-9b67-36cbc80d40df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:22.146889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 759/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Mon Aug 1 12:01:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:01:22.154736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312ea68-11a4-41ae-b4cd-986c76ec95be None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:01:22.167847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312ea68-11a4-41ae-b4cd-986c76ec95be None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:01:22.173480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee19bc6-ba31-46a4-a953-192fc0ae805f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:01:22.174073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee19bc6-ba31-46a4-a953-192fc0ae805f service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:22.174352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee19bc6-ba31-46a4-a953-192fc0ae805f service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:22.174626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee19bc6-ba31-46a4-a953-192fc0ae805f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:22.182816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee19bc6-ba31-46a4-a953-192fc0ae805f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:01:22.184426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee19bc6-ba31-46a4-a953-192fc0ae805f service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:01:22.194267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 762/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:01:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:01:23.612701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72999-a3ec-40f1-8175-61d0251c7424 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:23.613230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72999-a3ec-40f1-8175-61d0251c7424 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:23.613230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b72999-a3ec-40f1-8175-61d0251c7424 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:23.614547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 12:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:01:23.619349 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7dc86-7839-4051-b577-df614e09ef30 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:23.619778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7dc86-7839-4051-b577-df614e09ef30 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:23.619884 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e7dc86-7839-4051-b577-df614e09ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:23.638894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c6e7dc86-7839-4051-b577-df614e09ef30 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:01:23.640087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c6e7dc86-7839-4051-b577-df614e09ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:23.647862 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 12:01:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:01:23.803618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b72999-a3ec-40f1-8175-61d0251c7424 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:01:23.817986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b72999-a3ec-40f1-8175-61d0251c7424 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:01:23.823465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cdf8fa-15d1-48bb-9ee1-445c0de4fd52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:01:23.824060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdf8fa-15d1-48bb-9ee1-445c0de4fd52 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:23.824331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdf8fa-15d1-48bb-9ee1-445c0de4fd52 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:23.825131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cdf8fa-15d1-48bb-9ee1-445c0de4fd52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:23.833468 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdf8fa-15d1-48bb-9ee1-445c0de4fd52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:01:23.835043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cdf8fa-15d1-48bb-9ee1-445c0de4fd52 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:01:23.845963 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 761/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:01:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:01:24.662538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dcf7e-a950-448f-b566-69f964106166 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:24.663160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dcf7e-a950-448f-b566-69f964106166 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:24.663160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3dcf7e-a950-448f-b566-69f964106166 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:24.664344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 12:01:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:01:24.669551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ae4a6-8f49-4b0b-9440-40b6d647daa6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:24.670014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ae4a6-8f49-4b0b-9440-40b6d647daa6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:24.670119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ae4a6-8f49-4b0b-9440-40b6d647daa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:24.689500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-df0ae4a6-8f49-4b0b-9440-40b6d647daa6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:01:24.690696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-df0ae4a6-8f49-4b0b-9440-40b6d647daa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:24.698436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 12:01:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:01:24.849383 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dcf7e-a950-448f-b566-69f964106166 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:01:24.864872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3dcf7e-a950-448f-b566-69f964106166 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:01:24.870338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a7f6ae-9dde-4d1d-936a-6f70c67d9002 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:01:24.870939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7f6ae-9dde-4d1d-936a-6f70c67d9002 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:24.871219 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7f6ae-9dde-4d1d-936a-6f70c67d9002 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:24.872125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7f6ae-9dde-4d1d-936a-6f70c67d9002 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:24.880211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7f6ae-9dde-4d1d-936a-6f70c67d9002 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:01:24.881818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a7f6ae-9dde-4d1d-936a-6f70c67d9002 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:01:24.891113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 765/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:01:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:01:28.742462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfaa7c-710e-440a-881e-7552cd00d302 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:28.742979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfaa7c-710e-440a-881e-7552cd00d302 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:28.742979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdfaa7c-710e-440a-881e-7552cd00d302 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:28.744281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 12:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:01:28.750823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eaf11-ce80-4418-9e58-4fd188fa537c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:28.751276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eaf11-ce80-4418-9e58-4fd188fa537c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:28.751401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657eaf11-ce80-4418-9e58-4fd188fa537c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:28.772413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-657eaf11-ce80-4418-9e58-4fd188fa537c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:01:28.773661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-657eaf11-ce80-4418-9e58-4fd188fa537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:28.781497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 12:01:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:01:28.854117 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfaa7c-710e-440a-881e-7552cd00d302 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:01:28.855841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0bdfaa7c-710e-440a-881e-7552cd00d302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:28.934757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdfaa7c-710e-440a-881e-7552cd00d302 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:01:28.938335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432de0b4-7f25-4934-8e18-fc6e92022127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:01:28.938943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432de0b4-7f25-4934-8e18-fc6e92022127 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:28.939220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432de0b4-7f25-4934-8e18-fc6e92022127 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:28.939486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432de0b4-7f25-4934-8e18-fc6e92022127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:28.948254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432de0b4-7f25-4934-8e18-fc6e92022127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:01:28.950289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432de0b4-7f25-4934-8e18-fc6e92022127 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:01:28.959854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 764/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:01:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:01:30.968298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50785e39-2881-4229-bec8-86071b2e6ce4 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:30.968867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50785e39-2881-4229-bec8-86071b2e6ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:30.968867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50785e39-2881-4229-bec8-86071b2e6ce4 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:30.970245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 12:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:01:30.975375 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d7065-f2a0-4cf3-9c63-b8059ad92879 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:30.975777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d7065-f2a0-4cf3-9c63-b8059ad92879 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:30.975923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d7065-f2a0-4cf3-9c63-b8059ad92879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:30.995108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5d2d7065-f2a0-4cf3-9c63-b8059ad92879 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:01:30.996776 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5d2d7065-f2a0-4cf3-9c63-b8059ad92879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:31.004509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 12:01:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:01:31.041159 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50785e39-2881-4229-bec8-86071b2e6ce4 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:01:31.042896 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-50785e39-2881-4229-bec8-86071b2e6ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:31.055804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50785e39-2881-4229-bec8-86071b2e6ce4 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:01:31.059870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07baf11c-25bd-48e1-a831-02e23b290f87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:01:31.060470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baf11c-25bd-48e1-a831-02e23b290f87 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:31.060754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baf11c-25bd-48e1-a831-02e23b290f87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:31.061028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07baf11c-25bd-48e1-a831-02e23b290f87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:31.069827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07baf11c-25bd-48e1-a831-02e23b290f87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:01:31.071249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07baf11c-25bd-48e1-a831-02e23b290f87 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:01:31.081488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 768/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:01:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:01:34.819816 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0de5d-26bb-4d76-a5ec-4a333b1e29ad None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:34.820397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0de5d-26bb-4d76-a5ec-4a333b1e29ad None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:34.820397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a0de5d-26bb-4d76-a5ec-4a333b1e29ad None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:34.821746 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 12:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:01:34.827105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567a08d-2a79-4c9e-9662-f37d5557c104 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:34.827527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567a08d-2a79-4c9e-9662-f37d5557c104 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:34.827646 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e567a08d-2a79-4c9e-9662-f37d5557c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:34.847406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e567a08d-2a79-4c9e-9662-f37d5557c104 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:01:34.848617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e567a08d-2a79-4c9e-9662-f37d5557c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:34.857236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 12:01:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:01:35.161978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0de5d-26bb-4d76-a5ec-4a333b1e29ad None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:01:35.163667 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-20a0de5d-26bb-4d76-a5ec-4a333b1e29ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:35.227638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:01:35.241796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a0de5d-26bb-4d76-a5ec-4a333b1e29ad None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:01:35.245418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fdf88-2774-4936-8bc8-af0575980b65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:01:35.246028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fdf88-2774-4936-8bc8-af0575980b65 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:35.246309 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fdf88-2774-4936-8bc8-af0575980b65 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:35.246581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fdf88-2774-4936-8bc8-af0575980b65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:35.255346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fdf88-2774-4936-8bc8-af0575980b65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:01:35.256776 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fdf88-2774-4936-8bc8-af0575980b65 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:01:35.266711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 767/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:01:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:01:37.271365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa911a80-4bd3-4234-9d49-997fedac967d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:37.271910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa911a80-4bd3-4234-9d49-997fedac967d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:37.271910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa911a80-4bd3-4234-9d49-997fedac967d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:37.273265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 12:01:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:01:37.278897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be561ff-f02f-4b3a-8c29-1dfd7c5be3f7 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:37.279311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be561ff-f02f-4b3a-8c29-1dfd7c5be3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:37.279433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be561ff-f02f-4b3a-8c29-1dfd7c5be3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:37.298421 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9be561ff-f02f-4b3a-8c29-1dfd7c5be3f7 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:01:37.299607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9be561ff-f02f-4b3a-8c29-1dfd7c5be3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:37.307503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 12:01:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:01:37.611462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa911a80-4bd3-4234-9d49-997fedac967d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:01:37.613176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fa911a80-4bd3-4234-9d49-997fedac967d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:01:37.620806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=84 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:01:37.627821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa911a80-4bd3-4234-9d49-997fedac967d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:01:37.631370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054d13c-38a5-44dd-8cd1-b2973531aec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:01:37.631974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054d13c-38a5-44dd-8cd1-b2973531aec5 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:01:37.632254 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054d13c-38a5-44dd-8cd1-b2973531aec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:01:37.632529 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054d13c-38a5-44dd-8cd1-b2973531aec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:01:37.641320 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054d13c-38a5-44dd-8cd1-b2973531aec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:01:37.642742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054d13c-38a5-44dd-8cd1-b2973531aec5 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:01:37.652926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 771/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:01:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:01:47.293690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=11 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:01:47.648326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:18.153065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0157d51-57b6-4305-8a9e-952e0be96968 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.153777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0157d51-57b6-4305-8a9e-952e0be96968 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.153777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0157d51-57b6-4305-8a9e-952e0be96968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.177677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b0157d51-57b6-4305-8a9e-952e0be96968 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.178909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b0157d51-57b6-4305-8a9e-952e0be96968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.188965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746801d1-1cd0-4989-b7f5-966dd3019372 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.189615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746801d1-1cd0-4989-b7f5-966dd3019372 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.189994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746801d1-1cd0-4989-b7f5-966dd3019372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.192249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 769/1540] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.202812 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f850bf2-2937-4f99-9782-610090c27eaf None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.203179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f850bf2-2937-4f99-9782-610090c27eaf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.203370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f850bf2-2937-4f99-9782-610090c27eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.246461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-746801d1-1cd0-4989-b7f5-966dd3019372 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.248324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-746801d1-1cd0-4989-b7f5-966dd3019372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.250330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4f850bf2-2937-4f99-9782-610090c27eaf None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.251513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4f850bf2-2937-4f99-9782-610090c27eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.272751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 772/1541] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.274735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 770/1542] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.280577 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746801d1-1cd0-4989-b7f5-966dd3019372 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.281711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3beb2-7236-4b28-a4d3-b7dbb3bc6522 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.281998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3beb2-7236-4b28-a4d3-b7dbb3bc6522 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.282271 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3beb2-7236-4b28-a4d3-b7dbb3bc6522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.302327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746801d1-1cd0-4989-b7f5-966dd3019372 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:18.317535 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-11f3beb2-7236-4b28-a4d3-b7dbb3bc6522 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.320104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-11f3beb2-7236-4b28-a4d3-b7dbb3bc6522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.327834 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a535b92-084d-4487-b415-e91bb252f610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:18.328823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a535b92-084d-4487-b415-e91bb252f610 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.329380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a535b92-084d-4487-b415-e91bb252f610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.330033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a535b92-084d-4487-b415-e91bb252f610 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.332213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a535b92-084d-4487-b415-e91bb252f610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:18.332865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a535b92-084d-4487-b415-e91bb252f610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:18.338249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-4a535b92-084d-4487-b415-e91bb252f610 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 12:03:18.338249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 12:03:18.338249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: Aug 01 12:03:18.339884 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a535b92-084d-4487-b415-e91bb252f610 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:18.340808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 771/1543] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:03:18.344516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b67a-e7a7-40e9-b2c8-90b6df36925a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.344799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b67a-e7a7-40e9-b2c8-90b6df36925a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.345072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f93b67a-e7a7-40e9-b2c8-90b6df36925a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.364372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 773/1544] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:18.365633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a535b92-084d-4487-b415-e91bb252f610 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.385879 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a535b92-084d-4487-b415-e91bb252f610 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:18.392281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5f93b67a-e7a7-40e9-b2c8-90b6df36925a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.393717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f781e6-904a-4698-a108-33c3ddd6b9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:18.394594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f781e6-904a-4698-a108-33c3ddd6b9aa admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.395106 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f781e6-904a-4698-a108-33c3ddd6b9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.395605 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f781e6-904a-4698-a108-33c3ddd6b9aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.396540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f781e6-904a-4698-a108-33c3ddd6b9aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:18.397069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f781e6-904a-4698-a108-33c3ddd6b9aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:18.401393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5f93b67a-e7a7-40e9-b2c8-90b6df36925a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.404109 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f781e6-904a-4698-a108-33c3ddd6b9aa admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:18.426994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 772/1545] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.427832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b67a-e7a7-40e9-b2c8-90b6df36925a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.430981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 774/1546] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:18.440492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f781e6-904a-4698-a108-33c3ddd6b9aa admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.442921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f93b67a-e7a7-40e9-b2c8-90b6df36925a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:18.451438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a70cb13-e95a-4371-8fe3-4663b9181bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:18.452071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70cb13-e95a-4371-8fe3-4663b9181bd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.452347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70cb13-e95a-4371-8fe3-4663b9181bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.452614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a70cb13-e95a-4371-8fe3-4663b9181bd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.453278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70cb13-e95a-4371-8fe3-4663b9181bd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:18.454351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-5a70cb13-e95a-4371-8fe3-4663b9181bd0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 12:03:18.454351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 12:03:18.454351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: Aug 01 12:03:18.457328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a70cb13-e95a-4371-8fe3-4663b9181bd0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:18.460026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f781e6-904a-4698-a108-33c3ddd6b9aa admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:18.468005 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c6f59-c0c2-4286-85a2-ca0e087963f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:18.468965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c6f59-c0c2-4286-85a2-ca0e087963f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.469517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c6f59-c0c2-4286-85a2-ca0e087963f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.470021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c6f59-c0c2-4286-85a2-ca0e087963f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.470894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c6f59-c0c2-4286-85a2-ca0e087963f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:18.473036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c6f59-c0c2-4286-85a2-ca0e087963f2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:18.531275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 773/1547] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/projects => generated 371 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:18.532558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dea80-7fc5-4756-a5c3-39b07908cef0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.532889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dea80-7fc5-4756-a5c3-39b07908cef0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.533161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7dea80-7fc5-4756-a5c3-39b07908cef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.562968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 775/1548] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:03:18.564291 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb9ce7-eecf-4e62-ba83-24ae4449089d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.564980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb9ce7-eecf-4e62-ba83-24ae4449089d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.565269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb9ce7-eecf-4e62-ba83-24ae4449089d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.571178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ae7dea80-7fc5-4756-a5c3-39b07908cef0 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.573619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ae7dea80-7fc5-4756-a5c3-39b07908cef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.601700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0bfb9ce7-eecf-4e62-ba83-24ae4449089d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.602926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0bfb9ce7-eecf-4e62-ba83-24ae4449089d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.652075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 774/1549] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.652886 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dea80-7fc5-4756-a5c3-39b07908cef0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.662498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7dea80-7fc5-4756-a5c3-39b07908cef0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:18.666987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0224a-ddf8-4650-8e4e-2f0cf3f6aa3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:18.667637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0224a-ddf8-4650-8e4e-2f0cf3f6aa3c admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.667916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0224a-ddf8-4650-8e4e-2f0cf3f6aa3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.668185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d0224a-ddf8-4650-8e4e-2f0cf3f6aa3c admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.669325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 776/1550] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.669623 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0224a-ddf8-4650-8e4e-2f0cf3f6aa3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:18.670459 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acc3e7-ac6b-44f6-90fe-5ee5205f4bb8 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.670750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acc3e7-ac6b-44f6-90fe-5ee5205f4bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.671025 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33acc3e7-ac6b-44f6-90fe-5ee5205f4bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.671627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d0224a-ddf8-4650-8e4e-2f0cf3f6aa3c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:18.692176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-33acc3e7-ac6b-44f6-90fe-5ee5205f4bb8 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.693529 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-33acc3e7-ac6b-44f6-90fe-5ee5205f4bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.698909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 775/1551] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/users => generated 286 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:18.701852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 777/1552] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.703057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0224a-ddf8-4650-8e4e-2f0cf3f6aa3c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.703758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ec921-fc34-4cfc-9793-bca4d94f572f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.704128 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ec921-fc34-4cfc-9793-bca4d94f572f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.704478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1ec921-fc34-4cfc-9793-bca4d94f572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.717816 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d0224a-ddf8-4650-8e4e-2f0cf3f6aa3c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:18.722688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bebb41-e9ab-47e7-af35-286b71381dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:18.723297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bebb41-e9ab-47e7-af35-286b71381dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.723573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bebb41-e9ab-47e7-af35-286b71381dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.723839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bebb41-e9ab-47e7-af35-286b71381dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.724071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-dc1ec921-fc34-4cfc-9793-bca4d94f572f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.724488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bebb41-e9ab-47e7-af35-286b71381dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:18.725263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dc1ec921-fc34-4cfc-9793-bca4d94f572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.726444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bebb41-e9ab-47e7-af35-286b71381dc3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:18.733843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 778/1553] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.735106 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ecd11-5be5-4fdd-abec-8e8840220a3b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.735399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ecd11-5be5-4fdd-abec-8e8840220a3b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.735672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ecd11-5be5-4fdd-abec-8e8840220a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.758105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 776/1554] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/users => generated 289 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:18.758586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8b6ecd11-5be5-4fdd-abec-8e8840220a3b None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.759257 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bebb41-e9ab-47e7-af35-286b71381dc3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.759794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8b6ecd11-5be5-4fdd-abec-8e8840220a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.768282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 779/1555] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.769357 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cf0c1-16e7-4a26-9a01-0d44392d1761 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.769648 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cf0c1-16e7-4a26-9a01-0d44392d1761 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.769923 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032cf0c1-16e7-4a26-9a01-0d44392d1761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.772147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bebb41-e9ab-47e7-af35-286b71381dc3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:18.777549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed91d41-3d68-42ed-9413-09b564cb6296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:18.778228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed91d41-3d68-42ed-9413-09b564cb6296 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.778885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed91d41-3d68-42ed-9413-09b564cb6296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.779160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed91d41-3d68-42ed-9413-09b564cb6296 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.780291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed91d41-3d68-42ed-9413-09b564cb6296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:18.780291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed91d41-3d68-42ed-9413-09b564cb6296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:18.784891 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed91d41-3d68-42ed-9413-09b564cb6296 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:18.791043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-032cf0c1-16e7-4a26-9a01-0d44392d1761 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.792253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-032cf0c1-16e7-4a26-9a01-0d44392d1761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.797004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 777/1556] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:18.797858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed91d41-3d68-42ed-9413-09b564cb6296 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.807468 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed91d41-3d68-42ed-9413-09b564cb6296 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:18.808413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 780/1557] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.810182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c97da-80d4-4d95-bd7e-bef0b111762d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.810464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c97da-80d4-4d95-bd7e-bef0b111762d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.810736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97c97da-80d4-4d95-bd7e-bef0b111762d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.816291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a334c-a7ca-4b89-a8a6-6126f510ab12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:18.816885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a334c-a7ca-4b89-a8a6-6126f510ab12 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.817171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a334c-a7ca-4b89-a8a6-6126f510ab12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.817480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a334c-a7ca-4b89-a8a6-6126f510ab12 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.818170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a334c-a7ca-4b89-a8a6-6126f510ab12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:18.819810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a334c-a7ca-4b89-a8a6-6126f510ab12 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:18.829558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b97c97da-80d4-4d95-bd7e-bef0b111762d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.829844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 778/1558] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:18.830795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b97c97da-80d4-4d95-bd7e-bef0b111762d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.831036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae328de-07ee-43d1-af15-030d520ea2fd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.831325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae328de-07ee-43d1-af15-030d520ea2fd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.831643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae328de-07ee-43d1-af15-030d520ea2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.838672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 781/1559] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.839448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c97da-80d4-4d95-bd7e-bef0b111762d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.849856 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97c97da-80d4-4d95-bd7e-bef0b111762d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:18.852676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2ae328de-07ee-43d1-af15-030d520ea2fd None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.854491 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2ae328de-07ee-43d1-af15-030d520ea2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.854619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75435462-326a-4278-b45e-a2d7d4dd3dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:18.855138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75435462-326a-4278-b45e-a2d7d4dd3dca admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.855416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75435462-326a-4278-b45e-a2d7d4dd3dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.855690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75435462-326a-4278-b45e-a2d7d4dd3dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.856949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75435462-326a-4278-b45e-a2d7d4dd3dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:18.858590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75435462-326a-4278-b45e-a2d7d4dd3dca admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:18.866847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 779/1560] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.866847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdff68-0a08-4ef8-bcd5-37f9735f0cd0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.866847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdff68-0a08-4ef8-bcd5-37f9735f0cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.866847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdff68-0a08-4ef8-bcd5-37f9735f0cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.875222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 782/1561] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:18.875222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a484065-4372-40c6-8fe0-e9609719edce None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.875222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a484065-4372-40c6-8fe0-e9609719edce None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.875222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a484065-4372-40c6-8fe0-e9609719edce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.886427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c9bdff68-0a08-4ef8-bcd5-37f9735f0cd0 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.887640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c9bdff68-0a08-4ef8-bcd5-37f9735f0cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.892673 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1a484065-4372-40c6-8fe0-e9609719edce None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:18.893871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1a484065-4372-40c6-8fe0-e9609719edce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:18.895304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 780/1562] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.896103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdff68-0a08-4ef8-bcd5-37f9735f0cd0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.907795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 783/1563] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:18.907795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a484065-4372-40c6-8fe0-e9609719edce None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.911763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdff68-0a08-4ef8-bcd5-37f9735f0cd0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:18.912668 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a484065-4372-40c6-8fe0-e9609719edce None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:18.916499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583104bc-a4bc-40b9-8ac4-08adfcfea88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:18.917101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583104bc-a4bc-40b9-8ac4-08adfcfea88c admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.917266 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d583d-7823-48f5-a833-e349af94f88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:18.917411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583104bc-a4bc-40b9-8ac4-08adfcfea88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.917673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583104bc-a4bc-40b9-8ac4-08adfcfea88c admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.917891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d583d-7823-48f5-a833-e349af94f88c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.918173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d583d-7823-48f5-a833-e349af94f88c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.918361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583104bc-a4bc-40b9-8ac4-08adfcfea88c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:18.918465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d583d-7823-48f5-a833-e349af94f88c admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.919758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d583d-7823-48f5-a833-e349af94f88c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:18.920066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d583d-7823-48f5-a833-e349af94f88c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:18.920972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583104bc-a4bc-40b9-8ac4-08adfcfea88c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:18.921682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d583d-7823-48f5-a833-e349af94f88c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:18.933499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 784/1564] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:18.934159 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d583d-7823-48f5-a833-e349af94f88c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.943685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d583d-7823-48f5-a833-e349af94f88c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:18.949048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3f011-2fca-4d15-ba06-69b0b3aa2f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:18.949676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3f011-2fca-4d15-ba06-69b0b3aa2f64 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:18.949983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3f011-2fca-4d15-ba06-69b0b3aa2f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:18.950264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a3f011-2fca-4d15-ba06-69b0b3aa2f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:18.950981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3f011-2fca-4d15-ba06-69b0b3aa2f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:18.952583 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a3f011-2fca-4d15-ba06-69b0b3aa2f64 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:18.956175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 781/1565] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:18 2022] POST /identity/v3/projects => generated 377 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:18.956175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583104bc-a4bc-40b9-8ac4-08adfcfea88c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.963756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 785/1566] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:18.964606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3f011-2fca-4d15-ba06-69b0b3aa2f64 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:18.967658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:18.977716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a3f011-2fca-4d15-ba06-69b0b3aa2f64 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.006624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:19.020203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583104bc-a4bc-40b9-8ac4-08adfcfea88c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.026069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b7e7e-b198-4d3e-8c53-0cb3d136a064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.026683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b7e7e-b198-4d3e-8c53-0cb3d136a064 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.026965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b7e7e-b198-4d3e-8c53-0cb3d136a064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.027228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b7e7e-b198-4d3e-8c53-0cb3d136a064 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.027904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b7e7e-b198-4d3e-8c53-0cb3d136a064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:19.028713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b7e7e-b198-4d3e-8c53-0cb3d136a064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.030387 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b7e7e-b198-4d3e-8c53-0cb3d136a064 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.035998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065a3b0-a924-4d3a-94ed-aa98f1219cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.036611 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065a3b0-a924-4d3a-94ed-aa98f1219cbe admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.036890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065a3b0-a924-4d3a-94ed-aa98f1219cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.037160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065a3b0-a924-4d3a-94ed-aa98f1219cbe admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.037948 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065a3b0-a924-4d3a-94ed-aa98f1219cbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:19.038252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065a3b0-a924-4d3a-94ed-aa98f1219cbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.039927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3065a3b0-a924-4d3a-94ed-aa98f1219cbe admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.041939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 782/1567] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:19.043035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b7e7e-b198-4d3e-8c53-0cb3d136a064 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.052776 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b7e7e-b198-4d3e-8c53-0cb3d136a064 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.059926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 786/1568] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:19.059926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065a3b0-a924-4d3a-94ed-aa98f1219cbe admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.060190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75cc2a5-6cb2-4ac9-98e9-6ef46d7ef69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.060190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cc2a5-6cb2-4ac9-98e9-6ef46d7ef69e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.060190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cc2a5-6cb2-4ac9-98e9-6ef46d7ef69e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.060190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75cc2a5-6cb2-4ac9-98e9-6ef46d7ef69e admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.060499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cc2a5-6cb2-4ac9-98e9-6ef46d7ef69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.060927 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75cc2a5-6cb2-4ac9-98e9-6ef46d7ef69e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.065562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065a3b0-a924-4d3a-94ed-aa98f1219cbe admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.070146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28533e2-0a79-4f41-b272-f11fb96b22ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.070742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28533e2-0a79-4f41-b272-f11fb96b22ea admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.071021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28533e2-0a79-4f41-b272-f11fb96b22ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.071295 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28533e2-0a79-4f41-b272-f11fb96b22ea admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.071399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 783/1569] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:19.072114 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28533e2-0a79-4f41-b272-f11fb96b22ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:19.072433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28533e2-0a79-4f41-b272-f11fb96b22ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.072614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2126af-6e0e-4e8e-ae00-d07539149901 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.072899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2126af-6e0e-4e8e-ae00-d07539149901 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.073168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2126af-6e0e-4e8e-ae00-d07539149901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.074127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28533e2-0a79-4f41-b272-f11fb96b22ea admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.093921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 787/1570] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:19.093921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28533e2-0a79-4f41-b272-f11fb96b22ea admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.097392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28533e2-0a79-4f41-b272-f11fb96b22ea admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.098321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0c2126af-6e0e-4e8e-ae00-d07539149901 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:19.099506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0c2126af-6e0e-4e8e-ae00-d07539149901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:19.101944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea909e-daf5-440a-acaf-37effe1f2ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.102537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea909e-daf5-440a-acaf-37effe1f2ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.102817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea909e-daf5-440a-acaf-37effe1f2ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.103091 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea909e-daf5-440a-acaf-37effe1f2ca3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.103746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea909e-daf5-440a-acaf-37effe1f2ca3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.105670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ea909e-daf5-440a-acaf-37effe1f2ca3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.108382 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 784/1571] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:19.109364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2126af-6e0e-4e8e-ae00-d07539149901 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.120169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2126af-6e0e-4e8e-ae00-d07539149901 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.125082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd16f-e855-4a9e-8679-7bb74e030dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.125763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd16f-e855-4a9e-8679-7bb74e030dd9 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.126077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd16f-e855-4a9e-8679-7bb74e030dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.126348 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffd16f-e855-4a9e-8679-7bb74e030dd9 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.127023 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd16f-e855-4a9e-8679-7bb74e030dd9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.129039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffd16f-e855-4a9e-8679-7bb74e030dd9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.134185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 788/1572] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/projects => generated 391 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:19.135047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea909e-daf5-440a-acaf-37effe1f2ca3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.152386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 785/1573] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/users => generated 289 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:19.152386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd16f-e855-4a9e-8679-7bb74e030dd9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.160291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffd16f-e855-4a9e-8679-7bb74e030dd9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.201343 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea909e-daf5-440a-acaf-37effe1f2ca3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.205974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5363cc9-df83-4d74-b788-fdb8c21d63f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.206639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5363cc9-df83-4d74-b788-fdb8c21d63f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.206922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5363cc9-df83-4d74-b788-fdb8c21d63f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.207198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5363cc9-df83-4d74-b788-fdb8c21d63f4 admin admin] PATH_INFO: `/v3/projects/c081f9dfc25d4dccb23ec466daae4963/users/033780f29c5e407181cdda86ddffe59e/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.217339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e949b-e35c-4463-a465-0b67fa8894c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.217951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e949b-e35c-4463-a465-0b67fa8894c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.218227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e949b-e35c-4463-a465-0b67fa8894c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.218495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e949b-e35c-4463-a465-0b67fa8894c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.219143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e949b-e35c-4463-a465-0b67fa8894c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.221076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28e949b-e35c-4463-a465-0b67fa8894c0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.222024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5363cc9-df83-4d74-b788-fdb8c21d63f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c081f9dfc25d4dccb23ec466daae4963, user_id=033780f29c5e407181cdda86ddffe59e, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.224694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5363cc9-df83-4d74-b788-fdb8c21d63f4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.238623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 789/1574] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:19 2022] PUT /identity/v3/projects/c081f9dfc25d4dccb23ec466daae4963/users/033780f29c5e407181cdda86ddffe59e/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:19.248755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5363cc9-df83-4d74-b788-fdb8c21d63f4 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.250914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 786/1575] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:19.252007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e949b-e35c-4463-a465-0b67fa8894c0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.306712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:19.312106 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5363cc9-df83-4d74-b788-fdb8c21d63f4 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.317151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f8d15-147e-40e5-86c0-4102c5dbae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.317793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f8d15-147e-40e5-86c0-4102c5dbae08 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.318076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f8d15-147e-40e5-86c0-4102c5dbae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.318220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28e949b-e35c-4463-a465-0b67fa8894c0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.318352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f8d15-147e-40e5-86c0-4102c5dbae08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.319015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f8d15-147e-40e5-86c0-4102c5dbae08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.320906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f8d15-147e-40e5-86c0-4102c5dbae08 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.322837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2d2d4-e39a-4667-a0bd-3b22f01ea1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.323499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2d2d4-e39a-4667-a0bd-3b22f01ea1b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.323777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2d2d4-e39a-4667-a0bd-3b22f01ea1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.324048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2d2d4-e39a-4667-a0bd-3b22f01ea1b9 admin admin] PATH_INFO: `/v3/projects/a07a9298c7534180a341c2b4b4c9c47e/users/f3cc3768b87844298b2b21ba8dc61662/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.338890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2d2d4-e39a-4667-a0bd-3b22f01ea1b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a07a9298c7534180a341c2b4b4c9c47e, user_id=f3cc3768b87844298b2b21ba8dc61662, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.339964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-f2c2d2d4-e39a-4667-a0bd-3b22f01ea1b9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 12:03:19.339964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 12:03:19.339964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: Aug 01 12:03:19.342250 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:19.342573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2d2d4-e39a-4667-a0bd-3b22f01ea1b9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.351616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 790/1576] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:19.352606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f8d15-147e-40e5-86c0-4102c5dbae08 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.355360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 787/1577] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:19 2022] PUT /identity/v3/projects/a07a9298c7534180a341c2b4b4c9c47e/users/f3cc3768b87844298b2b21ba8dc61662/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:19.356377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2d2d4-e39a-4667-a0bd-3b22f01ea1b9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.420531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f8d15-147e-40e5-86c0-4102c5dbae08 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.420775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2d2d4-e39a-4667-a0bd-3b22f01ea1b9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.425037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9604501-b4f4-4814-a94f-a25066043063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.425329 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5f6f-c742-44f9-94f4-95e9a020a967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.425682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9604501-b4f4-4814-a94f-a25066043063 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.425934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5f6f-c742-44f9-94f4-95e9a020a967 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.426044 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9604501-b4f4-4814-a94f-a25066043063 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.426212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5f6f-c742-44f9-94f4-95e9a020a967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.426317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9604501-b4f4-4814-a94f-a25066043063 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.426482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5f6f-c742-44f9-94f4-95e9a020a967 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.426866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9604501-b4f4-4814-a94f-a25066043063 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.427167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d5f6f-c742-44f9-94f4-95e9a020a967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:19.427470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d5f6f-c742-44f9-94f4-95e9a020a967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.428749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9604501-b4f4-4814-a94f-a25066043063 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.429062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d5f6f-c742-44f9-94f4-95e9a020a967 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.440512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 788/1578] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:19.441324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5f6f-c742-44f9-94f4-95e9a020a967 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.451682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5f6f-c742-44f9-94f4-95e9a020a967 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.456240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97e7bdb-4766-43e1-a306-a2f538daeb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.457100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7bdb-4766-43e1-a306-a2f538daeb20 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.457453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7bdb-4766-43e1-a306-a2f538daeb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.457727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97e7bdb-4766-43e1-a306-a2f538daeb20 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.458036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 791/1579] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:19.459246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9604501-b4f4-4814-a94f-a25066043063 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.461809 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e7bdb-4766-43e1-a306-a2f538daeb20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.463762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97e7bdb-4766-43e1-a306-a2f538daeb20 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.485905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 789/1580] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/users => generated 296 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:19.487197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ebf89-713d-42f5-8516-a717c7f69d61 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.487484 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ebf89-713d-42f5-8516-a717c7f69d61 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.488008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ebf89-713d-42f5-8516-a717c7f69d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.516271 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e35ebf89-713d-42f5-8516-a717c7f69d61 None None] MFA Rules not processed for user `033780f29c5e407181cdda86ddffe59e`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:19.517539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e35ebf89-713d-42f5-8516-a717c7f69d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:19.525845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9604501-b4f4-4814-a94f-a25066043063 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.531024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a849c-c83d-44c8-83c7-9a57d2333bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.531643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a849c-c83d-44c8-83c7-9a57d2333bf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.531922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a849c-c83d-44c8-83c7-9a57d2333bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.532199 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5a849c-c83d-44c8-83c7-9a57d2333bf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.532888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a849c-c83d-44c8-83c7-9a57d2333bf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.534524 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5a849c-c83d-44c8-83c7-9a57d2333bf3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.544310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 792/1581] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:19.546200 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a849c-c83d-44c8-83c7-9a57d2333bf3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.555727 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5a849c-c83d-44c8-83c7-9a57d2333bf3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.561271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d28d4a1-84d1-4dd0-8805-072278c6535d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.561987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28d4a1-84d1-4dd0-8805-072278c6535d admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.562266 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28d4a1-84d1-4dd0-8805-072278c6535d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.562534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d28d4a1-84d1-4dd0-8805-072278c6535d admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.563178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28d4a1-84d1-4dd0-8805-072278c6535d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.564173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-9d28d4a1-84d1-4dd0-8805-072278c6535d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 12:03:19.564173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 12:03:19.564173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: Aug 01 12:03:19.565382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d28d4a1-84d1-4dd0-8805-072278c6535d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.586806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 790/1582] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:19.587875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ebf89-713d-42f5-8516-a717c7f69d61 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.594446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 793/1583] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:19.595745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98161c-23b1-48f9-94b8-82ca11721363 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.596000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98161c-23b1-48f9-94b8-82ca11721363 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.596273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98161c-23b1-48f9-94b8-82ca11721363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.602180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ebf89-713d-42f5-8516-a717c7f69d61 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.608726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efe477-33ed-4f75-a0fb-410bb2b994e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.609260 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efe477-33ed-4f75-a0fb-410bb2b994e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.610033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efe477-33ed-4f75-a0fb-410bb2b994e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.610375 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7efe477-33ed-4f75-a0fb-410bb2b994e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.611063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efe477-33ed-4f75-a0fb-410bb2b994e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.614000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7efe477-33ed-4f75-a0fb-410bb2b994e4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.615070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1d98161c-23b1-48f9-94b8-82ca11721363 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:19.616270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1d98161c-23b1-48f9-94b8-82ca11721363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:19.626419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 794/1584] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:19.630960 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98161c-23b1-48f9-94b8-82ca11721363 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.643204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98161c-23b1-48f9-94b8-82ca11721363 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.643421 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 791/1585] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/users => generated 294 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:19.644204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efe477-33ed-4f75-a0fb-410bb2b994e4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.647826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae76b4-4377-4bb4-b196-65bc0853ca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.648449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae76b4-4377-4bb4-b196-65bc0853ca39 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.648730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae76b4-4377-4bb4-b196-65bc0853ca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.649012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ae76b4-4377-4bb4-b196-65bc0853ca39 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.649705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae76b4-4377-4bb4-b196-65bc0853ca39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.651976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ae76b4-4377-4bb4-b196-65bc0853ca39 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.654172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7efe477-33ed-4f75-a0fb-410bb2b994e4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.659235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e19c71-428e-414b-bae1-2e374a7718ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.659840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e19c71-428e-414b-bae1-2e374a7718ae admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.660115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e19c71-428e-414b-bae1-2e374a7718ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.660382 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e19c71-428e-414b-bae1-2e374a7718ae admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.661030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e19c71-428e-414b-bae1-2e374a7718ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.663861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e19c71-428e-414b-bae1-2e374a7718ae admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.680056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 795/1586] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/projects => generated 367 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:19.680886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae76b4-4377-4bb4-b196-65bc0853ca39 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.689793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 792/1587] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/users => generated 293 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:19.690952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e19c71-428e-414b-bae1-2e374a7718ae admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.701343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e19c71-428e-414b-bae1-2e374a7718ae admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.704920 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:19.716619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:19.745078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ae76b4-4377-4bb4-b196-65bc0853ca39 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.750529 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd25fa-265e-4167-9af2-e276d0694f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.751142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd25fa-265e-4167-9af2-e276d0694f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.751420 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd25fa-265e-4167-9af2-e276d0694f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.751690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd25fa-265e-4167-9af2-e276d0694f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.752404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd25fa-265e-4167-9af2-e276d0694f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.754049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd25fa-265e-4167-9af2-e276d0694f6b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.760817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbc0927-355c-4f64-85e3-c1888c848dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.761477 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc0927-355c-4f64-85e3-c1888c848dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.761761 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc0927-355c-4f64-85e3-c1888c848dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.762094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbc0927-355c-4f64-85e3-c1888c848dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.763671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc0927-355c-4f64-85e3-c1888c848dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.764884 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 796/1588] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:19.765282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbc0927-355c-4f64-85e3-c1888c848dd4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.765730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd25fa-265e-4167-9af2-e276d0694f6b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.779739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 793/1589] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:19.779920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd25fa-265e-4167-9af2-e276d0694f6b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.780030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172342c-0f6f-4fd3-a4f9-f44ae47735d2 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.780030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172342c-0f6f-4fd3-a4f9-f44ae47735d2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.780030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f172342c-0f6f-4fd3-a4f9-f44ae47735d2 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.780030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 794/1590] 10.222.0.42 () {54 vars in 962 bytes} [Mon Aug 1 12:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:03:19.780665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172342c-0f6f-4fd3-a4f9-f44ae47735d2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.783902 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d76aa3-117f-40ad-a9d7-a0607c68d5b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.784521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d76aa3-117f-40ad-a9d7-a0607c68d5b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.784921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d76aa3-117f-40ad-a9d7-a0607c68d5b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.785408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d76aa3-117f-40ad-a9d7-a0607c68d5b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.786101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d76aa3-117f-40ad-a9d7-a0607c68d5b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.788247 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d76aa3-117f-40ad-a9d7-a0607c68d5b7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.798938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 797/1591] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:19.802260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d76aa3-117f-40ad-a9d7-a0607c68d5b7 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.812276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d76aa3-117f-40ad-a9d7-a0607c68d5b7 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.817182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93575786-20fc-47b5-856d-cab371bb21a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.817801 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93575786-20fc-47b5-856d-cab371bb21a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.818079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93575786-20fc-47b5-856d-cab371bb21a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.818347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93575786-20fc-47b5-856d-cab371bb21a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.819024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93575786-20fc-47b5-856d-cab371bb21a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.820609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93575786-20fc-47b5-856d-cab371bb21a0 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.834359 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 798/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:19.834359 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93575786-20fc-47b5-856d-cab371bb21a0 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.838282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f172342c-0f6f-4fd3-a4f9-f44ae47735d2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.841839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93575786-20fc-47b5-856d-cab371bb21a0 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.842001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdf82c-d22b-4cec-a7b3-6af61d9dc697 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.842548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdf82c-d22b-4cec-a7b3-6af61d9dc697 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.842827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdf82c-d22b-4cec-a7b3-6af61d9dc697 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.843097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bdf82c-d22b-4cec-a7b3-6af61d9dc697 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.846510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac772b-1250-46db-9c11-65f2b8c44037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.847152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac772b-1250-46db-9c11-65f2b8c44037 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.847429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac772b-1250-46db-9c11-65f2b8c44037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.847695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac772b-1250-46db-9c11-65f2b8c44037 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.848366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac772b-1250-46db-9c11-65f2b8c44037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.850289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac772b-1250-46db-9c11-65f2b8c44037 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.852381 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdf82c-d22b-4cec-a7b3-6af61d9dc697 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.853862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bdf82c-d22b-4cec-a7b3-6af61d9dc697 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.864671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 795/1593] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:19.865789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdf82c-d22b-4cec-a7b3-6af61d9dc697 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.871700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 799/1594] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/users => generated 284 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:19.873159 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac772b-1250-46db-9c11-65f2b8c44037 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.876885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bdf82c-d22b-4cec-a7b3-6af61d9dc697 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.882950 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac772b-1250-46db-9c11-65f2b8c44037 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.883100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba682e2a-423d-45aa-a106-ef1d4d5c5698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.883703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba682e2a-423d-45aa-a106-ef1d4d5c5698 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.884024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba682e2a-423d-45aa-a106-ef1d4d5c5698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.884299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba682e2a-423d-45aa-a106-ef1d4d5c5698 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.885210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba682e2a-423d-45aa-a106-ef1d4d5c5698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.886859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba682e2a-423d-45aa-a106-ef1d4d5c5698 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.890084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856618c5-28e8-4583-b67c-49f782e67814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.890642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856618c5-28e8-4583-b67c-49f782e67814 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.890985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856618c5-28e8-4583-b67c-49f782e67814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.891291 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856618c5-28e8-4583-b67c-49f782e67814 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.892091 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856618c5-28e8-4583-b67c-49f782e67814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.894144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856618c5-28e8-4583-b67c-49f782e67814 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.899399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 796/1595] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:19.900258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba682e2a-423d-45aa-a106-ef1d4d5c5698 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:19.905316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 800/1596] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:19.906620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412b3f3-14b8-4629-9e84-ee42e9e64ec0 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.906913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412b3f3-14b8-4629-9e84-ee42e9e64ec0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.907183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412b3f3-14b8-4629-9e84-ee42e9e64ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.913432 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba682e2a-423d-45aa-a106-ef1d4d5c5698 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:19.919228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da015f51-a383-47e7-a76f-4785d51a7e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:19.919986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da015f51-a383-47e7-a76f-4785d51a7e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:19.920327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da015f51-a383-47e7-a76f-4785d51a7e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:19.920670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da015f51-a383-47e7-a76f-4785d51a7e01 admin admin] PATH_INFO: `/v3/projects/ba2711f8cc5d4892849cc10272ec5edf/users/99e51f3319eb483f8ac05bdfe68d3695/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:19.936789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da015f51-a383-47e7-a76f-4785d51a7e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba2711f8cc5d4892849cc10272ec5edf, user_id=99e51f3319eb483f8ac05bdfe68d3695, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:19.939622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da015f51-a383-47e7-a76f-4785d51a7e01 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:19.947861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c412b3f3-14b8-4629-9e84-ee42e9e64ec0 None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:19.949429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c412b3f3-14b8-4629-9e84-ee42e9e64ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:19.959645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 797/1597] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:19 2022] PUT /identity/v3/projects/ba2711f8cc5d4892849cc10272ec5edf/users/99e51f3319eb483f8ac05bdfe68d3695/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:19.959645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da015f51-a383-47e7-a76f-4785d51a7e01 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.029611 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da015f51-a383-47e7-a76f-4785d51a7e01 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.034862 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 801/1598] 10.222.0.42 () {58 vars in 1059 bytes} [Mon Aug 1 12:03:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:20.035214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12348bc-255e-437a-b605-88a4e7114462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.035925 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412b3f3-14b8-4629-9e84-ee42e9e64ec0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.036046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12348bc-255e-437a-b605-88a4e7114462 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.036482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12348bc-255e-437a-b605-88a4e7114462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.036778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12348bc-255e-437a-b605-88a4e7114462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.037507 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12348bc-255e-437a-b605-88a4e7114462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.039252 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12348bc-255e-437a-b605-88a4e7114462 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.047406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412b3f3-14b8-4629-9e84-ee42e9e64ec0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.054666 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 798/1599] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:20.054666 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12348bc-255e-437a-b605-88a4e7114462 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.060791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f15604-464a-416d-ae24-aa746ebf7bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.061636 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15604-464a-416d-ae24-aa746ebf7bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.062073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15604-464a-416d-ae24-aa746ebf7bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.062659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f15604-464a-416d-ae24-aa746ebf7bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.063705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f15604-464a-416d-ae24-aa746ebf7bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.065703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f15604-464a-416d-ae24-aa746ebf7bb8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.072902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12348bc-255e-437a-b605-88a4e7114462 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.079058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b9072-cacf-40ae-8a36-93a6d75c1ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.079905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b9072-cacf-40ae-8a36-93a6d75c1ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.080324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b9072-cacf-40ae-8a36-93a6d75c1ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.080725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b9072-cacf-40ae-8a36-93a6d75c1ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.081652 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b9072-cacf-40ae-8a36-93a6d75c1ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.082110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 802/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:20.083182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f15604-464a-416d-ae24-aa746ebf7bb8 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.086518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b9072-cacf-40ae-8a36-93a6d75c1ef8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.088274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:20.093902 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f15604-464a-416d-ae24-aa746ebf7bb8 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.100257 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 799/1601] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:20.101213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b9072-cacf-40ae-8a36-93a6d75c1ef8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.105594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cea83-fff0-4614-a45b-689e13eb81dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.106752 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cea83-fff0-4614-a45b-689e13eb81dd admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.107178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cea83-fff0-4614-a45b-689e13eb81dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.107457 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cea83-fff0-4614-a45b-689e13eb81dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.108593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cea83-fff0-4614-a45b-689e13eb81dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.109809 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cea83-fff0-4614-a45b-689e13eb81dd admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.113339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b9072-cacf-40ae-8a36-93a6d75c1ef8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.118680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd4983-a1ca-490a-9553-7b3edea1500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.119251 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd4983-a1ca-490a-9553-7b3edea1500f admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.119618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd4983-a1ca-490a-9553-7b3edea1500f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.120006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd4983-a1ca-490a-9553-7b3edea1500f admin admin] PATH_INFO: `/v3/projects/3e89187fec5a40298d863d417a4a20f5/users/10f497bc876d4aa7b4ff9119d618b25a/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.120563 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 803/1602] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:20.122404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424774d5-705d-40b0-8d1d-a3e1ebaca7b4 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.122690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424774d5-705d-40b0-8d1d-a3e1ebaca7b4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.122967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424774d5-705d-40b0-8d1d-a3e1ebaca7b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.140453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd4983-a1ca-490a-9553-7b3edea1500f admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e89187fec5a40298d863d417a4a20f5, user_id=10f497bc876d4aa7b4ff9119d618b25a, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.143133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-424774d5-705d-40b0-8d1d-a3e1ebaca7b4 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:20.143909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd4983-a1ca-490a-9553-7b3edea1500f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.144340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-424774d5-705d-40b0-8d1d-a3e1ebaca7b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:20.153782 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 804/1603] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:20.154654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424774d5-705d-40b0-8d1d-a3e1ebaca7b4 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.165849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 800/1604] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:20 2022] PUT /identity/v3/projects/3e89187fec5a40298d863d417a4a20f5/users/10f497bc876d4aa7b4ff9119d618b25a/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:20.165849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd4983-a1ca-490a-9553-7b3edea1500f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.175036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424774d5-705d-40b0-8d1d-a3e1ebaca7b4 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.204851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:20.234996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd4983-a1ca-490a-9553-7b3edea1500f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.239977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a8403-3cda-4114-8ac3-22a03c3b3376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.240764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a8403-3cda-4114-8ac3-22a03c3b3376 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.241191 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a8403-3cda-4114-8ac3-22a03c3b3376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.241513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324a8403-3cda-4114-8ac3-22a03c3b3376 admin admin] PATH_INFO: `/v3/projects/cb077f1e4d644e5ba1b56d8e206bec61/users/06d8f61d9cdc4312b5bc217b24c77a15/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.253571 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b301c-bdee-4770-9cd3-0dd90130ea14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.254352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b301c-bdee-4770-9cd3-0dd90130ea14 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.254735 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b301c-bdee-4770-9cd3-0dd90130ea14 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.255125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b301c-bdee-4770-9cd3-0dd90130ea14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.260736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a8403-3cda-4114-8ac3-22a03c3b3376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb077f1e4d644e5ba1b56d8e206bec61, user_id=06d8f61d9cdc4312b5bc217b24c77a15, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.264310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324a8403-3cda-4114-8ac3-22a03c3b3376 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.285812 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 801/1605] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:20 2022] PUT /identity/v3/projects/cb077f1e4d644e5ba1b56d8e206bec61/users/06d8f61d9cdc4312b5bc217b24c77a15/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:20.286683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a8403-3cda-4114-8ac3-22a03c3b3376 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.330187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b301c-bdee-4770-9cd3-0dd90130ea14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.332059 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89b301c-bdee-4770-9cd3-0dd90130ea14 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.344384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 805/1606] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:20.347317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b301c-bdee-4770-9cd3-0dd90130ea14 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.363312 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b301c-bdee-4770-9cd3-0dd90130ea14 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.379144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324a8403-3cda-4114-8ac3-22a03c3b3376 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.390247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88281c-a5b9-4fbe-97d2-489f7652c6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.391611 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88281c-a5b9-4fbe-97d2-489f7652c6dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.392171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88281c-a5b9-4fbe-97d2-489f7652c6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.392799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88281c-a5b9-4fbe-97d2-489f7652c6dd admin admin] PATH_INFO: `/v3/projects/eaff8fd2efa7454dbf4df0109c383011/users/ea32636c7dbc4cb586e8b9021218b8d8/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.414993 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88281c-a5b9-4fbe-97d2-489f7652c6dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaff8fd2efa7454dbf4df0109c383011, user_id=ea32636c7dbc4cb586e8b9021218b8d8, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.418150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d88281c-a5b9-4fbe-97d2-489f7652c6dd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.436582 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 802/1607] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:20 2022] PUT /identity/v3/projects/eaff8fd2efa7454dbf4df0109c383011/users/ea32636c7dbc4cb586e8b9021218b8d8/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:20.437865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88281c-a5b9-4fbe-97d2-489f7652c6dd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.446466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc9e4af-e38e-4d83-8ecf-729c46156e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.447346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9e4af-e38e-4d83-8ecf-729c46156e11 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.447838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9e4af-e38e-4d83-8ecf-729c46156e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.448632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc9e4af-e38e-4d83-8ecf-729c46156e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.454085 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9e4af-e38e-4d83-8ecf-729c46156e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.456702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc9e4af-e38e-4d83-8ecf-729c46156e11 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.478164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 806/1608] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:20.478164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b39dba-9ea3-4b32-9317-b2760d15ed73 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.478164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b39dba-9ea3-4b32-9317-b2760d15ed73 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.478164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b39dba-9ea3-4b32-9317-b2760d15ed73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.505282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b1b39dba-9ea3-4b32-9317-b2760d15ed73 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:20.507140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b1b39dba-9ea3-4b32-9317-b2760d15ed73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:20.514344 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:20.557105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88281c-a5b9-4fbe-97d2-489f7652c6dd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.566618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b5238-aec4-4d34-81b6-2153ebdef0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.567720 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b5238-aec4-4d34-81b6-2153ebdef0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.567915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b5238-aec4-4d34-81b6-2153ebdef0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.568177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b5238-aec4-4d34-81b6-2153ebdef0a2 admin admin] PATH_INFO: `/v3/projects/d41c393db9364771bee2706bfc50729e/users/37f55d28e6014a7aa3d594745f585a2e/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.595401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b5238-aec4-4d34-81b6-2153ebdef0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41c393db9364771bee2706bfc50729e, user_id=37f55d28e6014a7aa3d594745f585a2e, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.596484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 807/1609] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:20.602909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b5238-aec4-4d34-81b6-2153ebdef0a2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.606971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b39dba-9ea3-4b32-9317-b2760d15ed73 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.612411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:20.629072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 803/1610] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:20 2022] PUT /identity/v3/projects/d41c393db9364771bee2706bfc50729e/users/37f55d28e6014a7aa3d594745f585a2e/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:20.632152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b826920-db35-49e5-b91e-9bbec62c4ecb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.632784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b826920-db35-49e5-b91e-9bbec62c4ecb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.633226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b826920-db35-49e5-b91e-9bbec62c4ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.673096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4b826920-db35-49e5-b91e-9bbec62c4ecb None None] MFA Rules not processed for user `06d8f61d9cdc4312b5bc217b24c77a15`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:20.674342 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4b826920-db35-49e5-b91e-9bbec62c4ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:20.682450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b39dba-9ea3-4b32-9317-b2760d15ed73 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.754821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 804/1611] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:20.756495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b86d90-63bd-4c01-a560-d52cf1c54a59 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.756696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b86d90-63bd-4c01-a560-d52cf1c54a59 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.756965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b86d90-63bd-4c01-a560-d52cf1c54a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.777110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade60ca1-7293-4088-934a-2649b10bda84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.778809 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade60ca1-7293-4088-934a-2649b10bda84 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.779386 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade60ca1-7293-4088-934a-2649b10bda84 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.779758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade60ca1-7293-4088-934a-2649b10bda84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.781735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-70b86d90-63bd-4c01-a560-d52cf1c54a59 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:20.783795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-70b86d90-63bd-4c01-a560-d52cf1c54a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:20.868553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 805/1612] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:20.869195 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade60ca1-7293-4088-934a-2649b10bda84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.871252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade60ca1-7293-4088-934a-2649b10bda84 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.873700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b86d90-63bd-4c01-a560-d52cf1c54a59 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.884776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 808/1613] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:20.885836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade60ca1-7293-4088-934a-2649b10bda84 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.886923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b86d90-63bd-4c01-a560-d52cf1c54a59 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.894773 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8708801-0006-42a3-9ab0-a3785c505d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.896632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8708801-0006-42a3-9ab0-a3785c505d0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.897020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8708801-0006-42a3-9ab0-a3785c505d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.897847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8708801-0006-42a3-9ab0-a3785c505d0b admin admin] PATH_INFO: `/v3/projects/4086584c8f774ef3b6c2c50830712fd4/users/c3f30b1b5b384de2adda399e25500fbf/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.899456 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade60ca1-7293-4088-934a-2649b10bda84 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:20.904944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1f6b7-a11f-47ee-9147-c0fd0c513597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:20.905616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1f6b7-a11f-47ee-9147-c0fd0c513597 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.906017 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1f6b7-a11f-47ee-9147-c0fd0c513597 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.906297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1f6b7-a11f-47ee-9147-c0fd0c513597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.917636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8708801-0006-42a3-9ab0-a3785c505d0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4086584c8f774ef3b6c2c50830712fd4, user_id=c3f30b1b5b384de2adda399e25500fbf, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.917985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1f6b7-a11f-47ee-9147-c0fd0c513597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:20.919542 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c1f6b7-a11f-47ee-9147-c0fd0c513597 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.920943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8708801-0006-42a3-9ab0-a3785c505d0b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:20.932552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 809/1614] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:20.934439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b874-3f57-4cf6-af9a-b89011f9f523 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.934794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b874-3f57-4cf6-af9a-b89011f9f523 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.935126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b874-3f57-4cf6-af9a-b89011f9f523 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.937212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 810/1615] 10.222.0.42 () {54 vars in 912 bytes} [Mon Aug 1 12:03:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:03:20.938659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036cf13-fd06-4290-ad0d-96c850aeff9e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:20.938946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036cf13-fd06-4290-ad0d-96c850aeff9e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:20.939223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036cf13-fd06-4290-ad0d-96c850aeff9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:20.957445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 806/1616] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:20 2022] PUT /identity/v3/projects/4086584c8f774ef3b6c2c50830712fd4/users/c3f30b1b5b384de2adda399e25500fbf/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:20.957445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8708801-0006-42a3-9ab0-a3785c505d0b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:20.974628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0036cf13-fd06-4290-ad0d-96c850aeff9e None None] MFA Rules not processed for user `37f55d28e6014a7aa3d594745f585a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:20.975987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0036cf13-fd06-4290-ad0d-96c850aeff9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:20.988818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:21.046937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:21.050693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8708801-0006-42a3-9ab0-a3785c505d0b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:21.057495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d2481-2b70-488d-b3cf-eac4cf5ed959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:21.058778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d2481-2b70-488d-b3cf-eac4cf5ed959 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:21.059076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d2481-2b70-488d-b3cf-eac4cf5ed959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:21.059890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d2481-2b70-488d-b3cf-eac4cf5ed959 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:21.061334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d2481-2b70-488d-b3cf-eac4cf5ed959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:21.063324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d2481-2b70-488d-b3cf-eac4cf5ed959 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:21.094587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 807/1617] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:20 2022] POST /identity/v3/projects => generated 393 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:21.095085 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 811/1618] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:21.096082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d2481-2b70-488d-b3cf-eac4cf5ed959 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:21.096372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265d7e0-3220-455c-a777-81a005d7f77a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:21.096659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265d7e0-3220-455c-a777-81a005d7f77a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:21.096931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7265d7e0-3220-455c-a777-81a005d7f77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:21.145887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7265d7e0-3220-455c-a777-81a005d7f77a None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:21.149033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7265d7e0-3220-455c-a777-81a005d7f77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:21.206084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d2481-2b70-488d-b3cf-eac4cf5ed959 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:21.211513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4734bbd-951f-45a3-88cd-d69a57cd5416 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:21.212181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4734bbd-951f-45a3-88cd-d69a57cd5416 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:21.212464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4734bbd-951f-45a3-88cd-d69a57cd5416 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:21.212738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4734bbd-951f-45a3-88cd-d69a57cd5416 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:21.280752 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 812/1619] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:03:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:21.282504 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6ccc-41c3-4418-8031-49988e2614a8 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:21.282901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6ccc-41c3-4418-8031-49988e2614a8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:21.283298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c6ccc-41c3-4418-8031-49988e2614a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:21.340224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4734bbd-951f-45a3-88cd-d69a57cd5416 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:21.342210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4734bbd-951f-45a3-88cd-d69a57cd5416 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:21.347466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8c2c6ccc-41c3-4418-8031-49988e2614a8 None None] MFA Rules not processed for user `c3f30b1b5b384de2adda399e25500fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:21.350158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8c2c6ccc-41c3-4418-8031-49988e2614a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:21.361502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 808/1620] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:21.377663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4734bbd-951f-45a3-88cd-d69a57cd5416 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:21.415783 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4734bbd-951f-45a3-88cd-d69a57cd5416 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:21.432140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02fd9a-7d4c-43f2-a999-42322ddf2991 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:21.434901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02fd9a-7d4c-43f2-a999-42322ddf2991 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:21.436183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02fd9a-7d4c-43f2-a999-42322ddf2991 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:21.437146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f02fd9a-7d4c-43f2-a999-42322ddf2991 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:21.439087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02fd9a-7d4c-43f2-a999-42322ddf2991 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:21.442723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f02fd9a-7d4c-43f2-a999-42322ddf2991 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:21.468578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 813/1621] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:21 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:21.471021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8446627-e91e-4c51-a3de-2f5918ec20cd None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:21.471634 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8446627-e91e-4c51-a3de-2f5918ec20cd None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:21.472971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8446627-e91e-4c51-a3de-2f5918ec20cd None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:21.478190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 814/1622] 10.222.0.42 () {54 vars in 962 bytes} [Mon Aug 1 12:03:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:03:21.479268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8446627-e91e-4c51-a3de-2f5918ec20cd None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:21.500207 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 809/1623] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:21 2022] POST /identity/v3/users => generated 303 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:21.503488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02fd9a-7d4c-43f2-a999-42322ddf2991 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:21.614471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:21.627109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f02fd9a-7d4c-43f2-a999-42322ddf2991 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:21.627714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8446627-e91e-4c51-a3de-2f5918ec20cd None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:21.632134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423567d6-fb42-4dbb-956a-7f5522719ddd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:21.632934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423567d6-fb42-4dbb-956a-7f5522719ddd service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:21.633341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423567d6-fb42-4dbb-956a-7f5522719ddd service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:21.633724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423567d6-fb42-4dbb-956a-7f5522719ddd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:21.637544 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d272ab9-601b-4193-9d4e-48e17715becc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:21.638304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d272ab9-601b-4193-9d4e-48e17715becc service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:21.638619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d272ab9-601b-4193-9d4e-48e17715becc service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:21.639158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d272ab9-601b-4193-9d4e-48e17715becc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:21.645451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423567d6-fb42-4dbb-956a-7f5522719ddd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:21.648027 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423567d6-fb42-4dbb-956a-7f5522719ddd service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:21.663876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d272ab9-601b-4193-9d4e-48e17715becc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:21.663876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d272ab9-601b-4193-9d4e-48e17715becc service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:21.664187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 810/1624] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:21 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:21.664187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7120315-385a-4693-b2bf-1d5f2d54a9ad None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:21.664187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7120315-385a-4693-b2bf-1d5f2d54a9ad None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:21.664187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7120315-385a-4693-b2bf-1d5f2d54a9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:21.688445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f7120315-385a-4693-b2bf-1d5f2d54a9ad None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:21.690064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f7120315-385a-4693-b2bf-1d5f2d54a9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:21.701279 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 815/1625] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:21.702126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 811/1626] 10.222.0.42 () {58 vars in 1059 bytes} [Mon Aug 1 12:03:21 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:21.703230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d272ab9-601b-4193-9d4e-48e17715becc service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:21.721004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7120315-385a-4693-b2bf-1d5f2d54a9ad None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:21.728080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d272ab9-601b-4193-9d4e-48e17715becc service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:21.735436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8bf13-d713-4ed3-99cd-a0ea4ad5b08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:21.736070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8bf13-d713-4ed3-99cd-a0ea4ad5b08e admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:21.736445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8bf13-d713-4ed3-99cd-a0ea4ad5b08e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:21.738341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc8bf13-d713-4ed3-99cd-a0ea4ad5b08e admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:21.739159 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8bf13-d713-4ed3-99cd-a0ea4ad5b08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:21.739294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7120315-385a-4693-b2bf-1d5f2d54a9ad None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:21.741272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc8bf13-d713-4ed3-99cd-a0ea4ad5b08e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:21.744258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:21.756841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2189c3-143b-416b-ae8a-f552eb73718a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:21.759033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2189c3-143b-416b-ae8a-f552eb73718a service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:21.760818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2189c3-143b-416b-ae8a-f552eb73718a service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:21.761252 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2189c3-143b-416b-ae8a-f552eb73718a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:21.763906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 816/1627] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:21.769684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8bf13-d713-4ed3-99cd-a0ea4ad5b08e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:21.787720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc8bf13-d713-4ed3-99cd-a0ea4ad5b08e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:21.815941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce22fe9-85ec-43ea-92d9-a5d63dcf2bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:21.817197 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22fe9-85ec-43ea-92d9-a5d63dcf2bf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:21.817567 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22fe9-85ec-43ea-92d9-a5d63dcf2bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:21.817887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce22fe9-85ec-43ea-92d9-a5d63dcf2bf5 admin admin] PATH_INFO: `/v3/projects/f65d0038329742f69239f5605ec00ca3/users/714929afa3e2495fa669d4180edf7730/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:21.934280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce22fe9-85ec-43ea-92d9-a5d63dcf2bf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65d0038329742f69239f5605ec00ca3, user_id=714929afa3e2495fa669d4180edf7730, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:21.934280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce22fe9-85ec-43ea-92d9-a5d63dcf2bf5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:21.934280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 817/1628] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:21 2022] PUT /identity/v3/projects/f65d0038329742f69239f5605ec00ca3/users/714929afa3e2495fa669d4180edf7730/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:21.934280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce22fe9-85ec-43ea-92d9-a5d63dcf2bf5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:21.947164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2189c3-143b-416b-ae8a-f552eb73718a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:21.949242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2189c3-143b-416b-ae8a-f552eb73718a service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:21.979000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 812/1629] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:22.068816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce22fe9-85ec-43ea-92d9-a5d63dcf2bf5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:22.080709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab8db1-9c48-469a-b182-c7755e84319a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:22.081795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8db1-9c48-469a-b182-c7755e84319a admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:22.082235 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8db1-9c48-469a-b182-c7755e84319a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:22.082683 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab8db1-9c48-469a-b182-c7755e84319a admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:22.083549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab8db1-9c48-469a-b182-c7755e84319a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:22.085486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab8db1-9c48-469a-b182-c7755e84319a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:22.100137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 818/1630] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:22.104603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2189c3-143b-416b-ae8a-f552eb73718a service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:22.121444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2189c3-143b-416b-ae8a-f552eb73718a service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:22.133141 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69de10f-a89c-41e7-a313-136cb34c533a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:22.133886 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69de10f-a89c-41e7-a313-136cb34c533a admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:22.134125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69de10f-a89c-41e7-a313-136cb34c533a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:22.134404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69de10f-a89c-41e7-a313-136cb34c533a admin admin] PATH_INFO: `/v3/projects/f65d0038329742f69239f5605ec00ca3/users/714929afa3e2495fa669d4180edf7730/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:22.138170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69de10f-a89c-41e7-a313-136cb34c533a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f65d0038329742f69239f5605ec00ca3, user_id=714929afa3e2495fa669d4180edf7730, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:22.146710 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69de10f-a89c-41e7-a313-136cb34c533a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:22.169644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 813/1631] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:22 2022] PUT /identity/v3/projects/f65d0038329742f69239f5605ec00ca3/users/714929afa3e2495fa669d4180edf7730/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:03:22.181156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f59e5e-282f-446a-b796-f1b8b9331d2f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:22.181831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f59e5e-282f-446a-b796-f1b8b9331d2f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:22.182314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f59e5e-282f-446a-b796-f1b8b9331d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:22.227452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-53f59e5e-282f-446a-b796-f1b8b9331d2f None None] MFA Rules not processed for user `714929afa3e2495fa669d4180edf7730`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:22.229748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-53f59e5e-282f-446a-b796-f1b8b9331d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:22.331240 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 819/1632] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:22.411376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f36b-84a8-488c-9840-b85397406ffd None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:22.411988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f36b-84a8-488c-9840-b85397406ffd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:22.411988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a195f36b-84a8-488c-9840-b85397406ffd None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:22.413892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 814/1633] 10.222.0.42 () {54 vars in 912 bytes} [Mon Aug 1 12:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:03:22.419464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9030fa-615f-44a0-a867-efc4ccfa200a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:22.419758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9030fa-615f-44a0-a867-efc4ccfa200a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:22.420034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9030fa-615f-44a0-a867-efc4ccfa200a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:22.459191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6b9030fa-615f-44a0-a867-efc4ccfa200a None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:22.461415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6b9030fa-615f-44a0-a867-efc4ccfa200a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:22.528071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f36b-84a8-488c-9840-b85397406ffd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:22.535997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:22.587901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 820/1634] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:03:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:03:22.628066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a195f36b-84a8-488c-9840-b85397406ffd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:22.632554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde1cf5-ad65-4c02-9ea1-3869a7b8f92e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:22.633189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde1cf5-ad65-4c02-9ea1-3869a7b8f92e service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:22.633587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde1cf5-ad65-4c02-9ea1-3869a7b8f92e service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:22.633864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde1cf5-ad65-4c02-9ea1-3869a7b8f92e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:22.649749 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde1cf5-ad65-4c02-9ea1-3869a7b8f92e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:22.651537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde1cf5-ad65-4c02-9ea1-3869a7b8f92e service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:22.665115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 815/1635] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:03:22.794576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9030fa-615f-44a0-a867-efc4ccfa200a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:22.808823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9030fa-615f-44a0-a867-efc4ccfa200a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:22.817335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dee9b-1784-453c-a578-d768b8a026f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:22.818352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dee9b-1784-453c-a578-d768b8a026f9 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:22.818559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dee9b-1784-453c-a578-d768b8a026f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:22.818907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483dee9b-1784-453c-a578-d768b8a026f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:22.845637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dee9b-1784-453c-a578-d768b8a026f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:22.849906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483dee9b-1784-453c-a578-d768b8a026f9 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:22.870418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 821/1636] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:23.304397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde1cf5-ad65-4c02-9ea1-3869a7b8f92e service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:23.315338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde1cf5-ad65-4c02-9ea1-3869a7b8f92e service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:23.326084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4461169-9563-4588-a597-9b9bbd25c808 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:23.326642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4461169-9563-4588-a597-9b9bbd25c808 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:23.326925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4461169-9563-4588-a597-9b9bbd25c808 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:23.327206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4461169-9563-4588-a597-9b9bbd25c808 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:23.441007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4461169-9563-4588-a597-9b9bbd25c808 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:23.442704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4461169-9563-4588-a597-9b9bbd25c808 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:23.455105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 816/1637] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:23 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:25.678800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dee9b-1784-453c-a578-d768b8a026f9 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:25.831397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483dee9b-1784-453c-a578-d768b8a026f9 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:25.839065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:25.840273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:25.841032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:25.841338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] PATH_INFO: `/v3/users/033780f29c5e407181cdda86ddffe59e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:25.843168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=033780f29c5e407181cdda86ddffe59e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:25.846839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:25.944282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '033780f29c5e407181cdda86ddffe59e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:25.961729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '033780f29c5e407181cdda86ddffe59e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:25.985922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '033780f29c5e407181cdda86ddffe59e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:25.986893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '033780f29c5e407181cdda86ddffe59e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:26.003026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '033780f29c5e407181cdda86ddffe59e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:26.017556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 822/1638] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:25 2022] DELETE /identity/v3/users/033780f29c5e407181cdda86ddffe59e => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:26.023016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2d8e0-2160-42fe-aa07-67f3d3c911fc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:26.023545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2d8e0-2160-42fe-aa07-67f3d3c911fc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:26.023945 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d2d8e0-2160-42fe-aa07-67f3d3c911fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:26.053540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:26.080148 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a2d2d8e0-2160-42fe-aa07-67f3d3c911fc None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:26.081438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a2d2d8e0-2160-42fe-aa07-67f3d3c911fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:26.221643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 817/1639] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:26.252737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:26.255104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:26.436309 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d3acb-8cfe-4bd6-9d61-32db2f30ae53 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:26.452141 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f056ded2-f696-4fc1-95b1-5bc1fb59de45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:26.453371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056ded2-f696-4fc1-95b1-5bc1fb59de45 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:26.453901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056ded2-f696-4fc1-95b1-5bc1fb59de45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:26.454280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f056ded2-f696-4fc1-95b1-5bc1fb59de45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:26.473856 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:26.482120 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056ded2-f696-4fc1-95b1-5bc1fb59de45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:26.485338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f056ded2-f696-4fc1-95b1-5bc1fb59de45 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:26.517398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 823/1640] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:28.511987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2d8e0-2160-42fe-aa07-67f3d3c911fc None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:28.513957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a2d2d8e0-2160-42fe-aa07-67f3d3c911fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:28.568487 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d2d8e0-2160-42fe-aa07-67f3d3c911fc None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:28.589669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:28.590368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:28.596398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:28.598250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] PATH_INFO: `/v3/users/37f55d28e6014a7aa3d594745f585a2e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:28.612127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f55d28e6014a7aa3d594745f585a2e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:28.613599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 12:03:28.613599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 12:03:28.613599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: Aug 01 12:03:28.619755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:28.857591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f55d28e6014a7aa3d594745f585a2e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:28.858925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f55d28e6014a7aa3d594745f585a2e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:28.923134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f55d28e6014a7aa3d594745f585a2e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:28.957136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f55d28e6014a7aa3d594745f585a2e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:28.976667 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f55d28e6014a7aa3d594745f585a2e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:28.986885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 818/1641] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:28 2022] DELETE /identity/v3/users/37f55d28e6014a7aa3d594745f585a2e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:28.988692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27970af9-8131-4322-976d-e650471319eb None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:28.989160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27970af9-8131-4322-976d-e650471319eb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:28.989561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27970af9-8131-4322-976d-e650471319eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:29.013138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-27970af9-8131-4322-976d-e650471319eb None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:29.014714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-27970af9-8131-4322-976d-e650471319eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:29.155095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 824/1642] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:29.196552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:29.198683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:29.263869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27970af9-8131-4322-976d-e650471319eb None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:29.264609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-27970af9-8131-4322-976d-e650471319eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:29.303114 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27970af9-8131-4322-976d-e650471319eb None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:29.324755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b0beb-cf82-4f88-955e-160ab6e49fa0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:29.327193 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:29.327866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:29.328147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:29.328414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] PATH_INFO: `/v3/projects/c081f9dfc25d4dccb23ec466daae4963` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:29.330218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e03a-4f4d-4897-ad48-486b87cab734 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:29.331092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e03a-4f4d-4897-ad48-486b87cab734 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:29.331467 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c081f9dfc25d4dccb23ec466daae4963)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:29.331797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e03a-4f4d-4897-ad48-486b87cab734 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:29.332260 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e03a-4f4d-4897-ad48-486b87cab734 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:29.332498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 12:03:29.332498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 12:03:29.332498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: Aug 01 12:03:29.334428 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:29.344807 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e03a-4f4d-4897-ad48-486b87cab734 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:29.347015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c651e03a-4f4d-4897-ad48-486b87cab734 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:29.361108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 819/1643] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:29.499462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c081f9dfc25d4dccb23ec466daae4963', 'request_id': 'req-46f62944-07f6-4c1d-af38-cea673780df3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:29.514986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c081f9dfc25d4dccb23ec466daae4963', 'request_id': 'req-46f62944-07f6-4c1d-af38-cea673780df3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:29.585033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c081f9dfc25d4dccb23ec466daae4963', 'request_id': 'req-46f62944-07f6-4c1d-af38-cea673780df3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:29.628717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] The token cache is being invalidate because project c081f9dfc25d4dccb23ec466daae4963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:03:29.629151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:29.631345 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-46f62944-07f6-4c1d-af38-cea673780df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:29.635577 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 825/1644] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:03:29 2022] DELETE /identity/v3/projects/c081f9dfc25d4dccb23ec466daae4963 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:29.640511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cabd6-799d-488e-aac5-6e4c2aaccc29 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:29.641634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cabd6-799d-488e-aac5-6e4c2aaccc29 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:29.642055 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26cabd6-799d-488e-aac5-6e4c2aaccc29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:29.695831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d26cabd6-799d-488e-aac5-6e4c2aaccc29 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:29.697089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d26cabd6-799d-488e-aac5-6e4c2aaccc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:29.755828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:29.878678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 820/1645] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:29.881052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230f46b-0d8c-46ca-8010-6a10fe112054 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:29.881052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230f46b-0d8c-46ca-8010-6a10fe112054 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:29.881514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e230f46b-0d8c-46ca-8010-6a10fe112054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:29.906401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cabd6-799d-488e-aac5-6e4c2aaccc29 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:29.907826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d26cabd6-799d-488e-aac5-6e4c2aaccc29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:29.930188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e230f46b-0d8c-46ca-8010-6a10fe112054 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:29.930835 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26cabd6-799d-488e-aac5-6e4c2aaccc29 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:29.931838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e230f46b-0d8c-46ca-8010-6a10fe112054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:29.937378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e52f2-9df2-4df8-b715-fd3acfff405a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:29.938314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e52f2-9df2-4df8-b715-fd3acfff405a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:29.938833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e52f2-9df2-4df8-b715-fd3acfff405a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:29.939246 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e52f2-9df2-4df8-b715-fd3acfff405a admin admin] PATH_INFO: `/v3/users/06d8f61d9cdc4312b5bc217b24c77a15` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:29.940664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e52f2-9df2-4df8-b715-fd3acfff405a admin admin] RBAC: Authorizing `identity:delete_user(user_id=06d8f61d9cdc4312b5bc217b24c77a15)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:29.942884 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e52f2-9df2-4df8-b715-fd3acfff405a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:29.945671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 826/1646] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:29.950575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230f46b-0d8c-46ca-8010-6a10fe112054 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:29.960621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e230f46b-0d8c-46ca-8010-6a10fe112054 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:29.981533 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ce070-e2f0-474d-ac7d-8609ebc8562a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:29.982529 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ce070-e2f0-474d-ac7d-8609ebc8562a admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:29.983936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ce070-e2f0-474d-ac7d-8609ebc8562a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:29.985408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-505ce070-e2f0-474d-ac7d-8609ebc8562a admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:29.986969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ce070-e2f0-474d-ac7d-8609ebc8562a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:29.988935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ce070-e2f0-474d-ac7d-8609ebc8562a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:29.994158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-505ce070-e2f0-474d-ac7d-8609ebc8562a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:30.022403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 827/1647] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:30.025919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ce070-e2f0-474d-ac7d-8609ebc8562a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:30.053539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-505ce070-e2f0-474d-ac7d-8609ebc8562a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:30.060605 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f41e52f2-9df2-4df8-b715-fd3acfff405a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06d8f61d9cdc4312b5bc217b24c77a15'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:30.062193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f41e52f2-9df2-4df8-b715-fd3acfff405a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06d8f61d9cdc4312b5bc217b24c77a15'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:30.070175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d869a3c-c587-4cff-9074-20aceb150aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:30.071891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d869a3c-c587-4cff-9074-20aceb150aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:30.073075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d869a3c-c587-4cff-9074-20aceb150aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:30.073710 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d869a3c-c587-4cff-9074-20aceb150aa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:30.077639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d869a3c-c587-4cff-9074-20aceb150aa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:30.082087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d869a3c-c587-4cff-9074-20aceb150aa6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:30.101016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f41e52f2-9df2-4df8-b715-fd3acfff405a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06d8f61d9cdc4312b5bc217b24c77a15'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:30.115999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f41e52f2-9df2-4df8-b715-fd3acfff405a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06d8f61d9cdc4312b5bc217b24c77a15'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:30.134790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f41e52f2-9df2-4df8-b715-fd3acfff405a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06d8f61d9cdc4312b5bc217b24c77a15'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:30.152431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 821/1648] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:29 2022] DELETE /identity/v3/users/06d8f61d9cdc4312b5bc217b24c77a15 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:30.155660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 828/1649] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:30 2022] POST /identity/v3/projects => generated 401 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:30.156866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d869a3c-c587-4cff-9074-20aceb150aa6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:30.162287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b1ef4-19b6-4201-a6cd-06038e139273 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:30.162875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b1ef4-19b6-4201-a6cd-06038e139273 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:30.163741 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b1ef4-19b6-4201-a6cd-06038e139273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:30.168366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9d869a3c-c587-4cff-9074-20aceb150aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:30.213684 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0e0b1ef4-19b6-4201-a6cd-06038e139273 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:30.217583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0e0b1ef4-19b6-4201-a6cd-06038e139273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:30.331739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:30.382925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 822/1650] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:30.404747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d869a3c-c587-4cff-9074-20aceb150aa6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:30.416809 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83618262-182b-49f8-b577-c2a1130f5bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:30.417919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83618262-182b-49f8-b577-c2a1130f5bac admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:30.418304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83618262-182b-49f8-b577-c2a1130f5bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:30.419202 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83618262-182b-49f8-b577-c2a1130f5bac admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:30.419979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83618262-182b-49f8-b577-c2a1130f5bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:30.422550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83618262-182b-49f8-b577-c2a1130f5bac admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:30.428729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b1ef4-19b6-4201-a6cd-06038e139273 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:30.430285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0e0b1ef4-19b6-4201-a6cd-06038e139273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:30.482244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 829/1651] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:30 2022] POST /identity/v3/users => generated 301 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:30.483873 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83618262-182b-49f8-b577-c2a1130f5bac admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:30.511354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83618262-182b-49f8-b577-c2a1130f5bac admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:30.526437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5bb5e-1cc2-412d-b14a-54fa54642bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:30.529967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5bb5e-1cc2-412d-b14a-54fa54642bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:30.532887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5bb5e-1cc2-412d-b14a-54fa54642bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:30.533415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c5bb5e-1cc2-412d-b14a-54fa54642bb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:30.535646 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5bb5e-1cc2-412d-b14a-54fa54642bb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:30.540499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:30.542003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c5bb5e-1cc2-412d-b14a-54fa54642bb9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:30.577947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 830/1652] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:30.578945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5bb5e-1cc2-412d-b14a-54fa54642bb9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:30.580227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b1ef4-19b6-4201-a6cd-06038e139273 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:30.589863 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f45f0d6-5a12-460f-a8b0-755c002d09ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:30.590680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45f0d6-5a12-460f-a8b0-755c002d09ad service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:30.590872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45f0d6-5a12-460f-a8b0-755c002d09ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:30.591095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f45f0d6-5a12-460f-a8b0-755c002d09ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:30.591275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c5bb5e-1cc2-412d-b14a-54fa54642bb9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:30.596271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214cfb1-fdf3-42dc-916d-0c2f5bb2b9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:30.597179 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214cfb1-fdf3-42dc-916d-0c2f5bb2b9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:30.597514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214cfb1-fdf3-42dc-916d-0c2f5bb2b9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:30.597836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1214cfb1-fdf3-42dc-916d-0c2f5bb2b9c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:30.598704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214cfb1-fdf3-42dc-916d-0c2f5bb2b9c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:30.600420 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1214cfb1-fdf3-42dc-916d-0c2f5bb2b9c9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:30.627475 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45f0d6-5a12-460f-a8b0-755c002d09ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:30.629136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f45f0d6-5a12-460f-a8b0-755c002d09ad service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:30.643832 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 831/1653] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:30.648332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214cfb1-fdf3-42dc-916d-0c2f5bb2b9c9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:30.650416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 823/1654] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:30.664499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1214cfb1-fdf3-42dc-916d-0c2f5bb2b9c9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:30.680181 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7eb2c-da8d-4f6e-b8fa-0054a270f064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:30.680881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7eb2c-da8d-4f6e-b8fa-0054a270f064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:30.681159 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7eb2c-da8d-4f6e-b8fa-0054a270f064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:30.681459 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7eb2c-da8d-4f6e-b8fa-0054a270f064 admin admin] PATH_INFO: `/v3/projects/12c4ef4ef2734d5f8e59729ca2085a07/users/6d97b06fdffd4acdb24184b6568df4bb/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:30.716197 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7eb2c-da8d-4f6e-b8fa-0054a270f064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12c4ef4ef2734d5f8e59729ca2085a07, user_id=6d97b06fdffd4acdb24184b6568df4bb, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:30.724164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7eb2c-da8d-4f6e-b8fa-0054a270f064 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:30.763372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 832/1655] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:30 2022] PUT /identity/v3/projects/12c4ef4ef2734d5f8e59729ca2085a07/users/6d97b06fdffd4acdb24184b6568df4bb/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:30.763998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd73d3-a5ad-4cd7-a0a4-002ab7d44645 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:30.764541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd73d3-a5ad-4cd7-a0a4-002ab7d44645 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:30.764842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd73d3-a5ad-4cd7-a0a4-002ab7d44645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:30.849054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-96bd73d3-a5ad-4cd7-a0a4-002ab7d44645 None None] MFA Rules not processed for user `6d97b06fdffd4acdb24184b6568df4bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:30.850444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-96bd73d3-a5ad-4cd7-a0a4-002ab7d44645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:31.027185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 824/1656] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:31.032559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7eb2c-da8d-4f6e-b8fa-0054a270f064 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:31.249092 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7eb2c-da8d-4f6e-b8fa-0054a270f064 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:31.254400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15066d8-5ad8-413a-bd0b-46ee280d1afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:31.255056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15066d8-5ad8-413a-bd0b-46ee280d1afd admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:31.255338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15066d8-5ad8-413a-bd0b-46ee280d1afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:31.255610 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15066d8-5ad8-413a-bd0b-46ee280d1afd admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:31.256294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15066d8-5ad8-413a-bd0b-46ee280d1afd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:31.263516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15066d8-5ad8-413a-bd0b-46ee280d1afd admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:31.347662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd73d3-a5ad-4cd7-a0a4-002ab7d44645 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:31.354792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 833/1657] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:31 2022] POST /identity/v3/projects => generated 405 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:31.376618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd73d3-a5ad-4cd7-a0a4-002ab7d44645 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:31.518394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb699d75-bcda-47a1-947a-008622599e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:31.519097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb699d75-bcda-47a1-947a-008622599e2a admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:31.519585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb699d75-bcda-47a1-947a-008622599e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:31.519869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb699d75-bcda-47a1-947a-008622599e2a admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:31.520636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb699d75-bcda-47a1-947a-008622599e2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:31.522780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb699d75-bcda-47a1-947a-008622599e2a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:31.583609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 825/1658] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:31 2022] POST /identity/v3/users => generated 309 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:31.588280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15066d8-5ad8-413a-bd0b-46ee280d1afd admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:31.607430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15066d8-5ad8-413a-bd0b-46ee280d1afd admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:31.612483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cc1e1-d25d-4004-8cb8-5fe902fe3234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:31.613259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cc1e1-d25d-4004-8cb8-5fe902fe3234 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:31.613549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cc1e1-d25d-4004-8cb8-5fe902fe3234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:31.613824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721cc1e1-d25d-4004-8cb8-5fe902fe3234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:31.614537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cc1e1-d25d-4004-8cb8-5fe902fe3234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:31.616152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721cc1e1-d25d-4004-8cb8-5fe902fe3234 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:31.627302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb699d75-bcda-47a1-947a-008622599e2a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:31.629064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cb699d75-bcda-47a1-947a-008622599e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:31.650964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb699d75-bcda-47a1-947a-008622599e2a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:31.651528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 834/1659] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:31.652370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cc1e1-d25d-4004-8cb8-5fe902fe3234 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:31.669508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:31.670355 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:31.670737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:31.671114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a admin admin] PATH_INFO: `/v3/projects/d41c393db9364771bee2706bfc50729e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:31.673370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41c393db9364771bee2706bfc50729e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:31.675854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721cc1e1-d25d-4004-8cb8-5fe902fe3234 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:31.678503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:31.690213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3852334-98fd-4aef-a511-9c9c6d40df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:31.691375 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3852334-98fd-4aef-a511-9c9c6d40df1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:31.691838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3852334-98fd-4aef-a511-9c9c6d40df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:31.692338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3852334-98fd-4aef-a511-9c9c6d40df1c admin admin] PATH_INFO: `/v3/projects/e1bfd38b3391448aa5fed64831280afa/users/33d3fa22dc0d4da1b3236b10442f0b59/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:31.732333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3852334-98fd-4aef-a511-9c9c6d40df1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bfd38b3391448aa5fed64831280afa, user_id=33d3fa22dc0d4da1b3236b10442f0b59, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:31.735075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3852334-98fd-4aef-a511-9c9c6d40df1c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:31.769833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 835/1660] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:31 2022] PUT /identity/v3/projects/e1bfd38b3391448aa5fed64831280afa/users/33d3fa22dc0d4da1b3236b10442f0b59/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:31.773263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3852334-98fd-4aef-a511-9c9c6d40df1c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:31.799975 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41c393db9364771bee2706bfc50729e', 'request_id': 'req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:31.804352 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:31.811268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41c393db9364771bee2706bfc50729e', 'request_id': 'req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:31.828638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41c393db9364771bee2706bfc50729e', 'request_id': 'req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:31.856144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a admin admin] The token cache is being invalidate because project d41c393db9364771bee2706bfc50729e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:03:31.856685 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:31.857615 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ac0f9ec7-ae4b-4256-8f9c-c123b33f257a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:31.863058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:31.871299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 826/1661] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:03:31 2022] DELETE /identity/v3/projects/d41c393db9364771bee2706bfc50729e => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:31.876602 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9ac37-419c-4f6d-be78-8b0a4af0444c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:31.877360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9ac37-419c-4f6d-be78-8b0a4af0444c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:31.877846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9ac37-419c-4f6d-be78-8b0a4af0444c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:31.923188 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-aee9ac37-419c-4f6d-be78-8b0a4af0444c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:31.924878 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-aee9ac37-419c-4f6d-be78-8b0a4af0444c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:31.924996 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3852334-98fd-4aef-a511-9c9c6d40df1c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:32.030859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 827/1662] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:32.040325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7131bec-1a5c-47f6-9444-ebfd9e520b01 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.040781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7131bec-1a5c-47f6-9444-ebfd9e520b01 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.041167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7131bec-1a5c-47f6-9444-ebfd9e520b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:32.074199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d7131bec-1a5c-47f6-9444-ebfd9e520b01 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:32.076607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d7131bec-1a5c-47f6-9444-ebfd9e520b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:32.081573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae133590-69f0-40dd-a656-a0dd653cac3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:32.082216 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae133590-69f0-40dd-a656-a0dd653cac3f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.082495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae133590-69f0-40dd-a656-a0dd653cac3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.082768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae133590-69f0-40dd-a656-a0dd653cac3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:32.083474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae133590-69f0-40dd-a656-a0dd653cac3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:32.085091 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae133590-69f0-40dd-a656-a0dd653cac3f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:32.090401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 828/1663] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:32.095434 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7131bec-1a5c-47f6-9444-ebfd9e520b01 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:32.108816 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7131bec-1a5c-47f6-9444-ebfd9e520b01 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:32.118245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1664a-82df-4ab5-8478-daf2a81ced45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:32.119256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1664a-82df-4ab5-8478-daf2a81ced45 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.119731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1664a-82df-4ab5-8478-daf2a81ced45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.120183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1664a-82df-4ab5-8478-daf2a81ced45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:32.120432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 836/1664] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:31 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:32.121237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1664a-82df-4ab5-8478-daf2a81ced45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:32.121403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae133590-69f0-40dd-a656-a0dd653cac3f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:32.123144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1664a-82df-4ab5-8478-daf2a81ced45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:32.125891 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba1664a-82df-4ab5-8478-daf2a81ced45 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:32.126885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ae133590-69f0-40dd-a656-a0dd653cac3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:32.152896 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae133590-69f0-40dd-a656-a0dd653cac3f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:32.157845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 829/1665] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:32.178278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1664a-82df-4ab5-8478-daf2a81ced45 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:32.182839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d816e-79aa-47ab-af30-4e45c394f280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:32.183976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d816e-79aa-47ab-af30-4e45c394f280 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.184793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d816e-79aa-47ab-af30-4e45c394f280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.185598 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d816e-79aa-47ab-af30-4e45c394f280 admin admin] PATH_INFO: `/v3/projects/e1bfd38b3391448aa5fed64831280afa/users/33d3fa22dc0d4da1b3236b10442f0b59/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:32.191829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d816e-79aa-47ab-af30-4e45c394f280 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bfd38b3391448aa5fed64831280afa, user_id=33d3fa22dc0d4da1b3236b10442f0b59, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:32.198811 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d816e-79aa-47ab-af30-4e45c394f280 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:32.212818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1664a-82df-4ab5-8478-daf2a81ced45 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:32.220072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ac390-cce3-4a6f-84b1-027096ca5c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:32.221185 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ac390-cce3-4a6f-84b1-027096ca5c5b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.221828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ac390-cce3-4a6f-84b1-027096ca5c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.222329 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ac390-cce3-4a6f-84b1-027096ca5c5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:32.223841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ac390-cce3-4a6f-84b1-027096ca5c5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:32.227789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ac390-cce3-4a6f-84b1-027096ca5c5b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:32.255296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 837/1666] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:32 2022] PUT /identity/v3/projects/e1bfd38b3391448aa5fed64831280afa/users/33d3fa22dc0d4da1b3236b10442f0b59/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:32.257038 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9c7c5-dcbc-457f-b414-0d1269cca22a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.265882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9c7c5-dcbc-457f-b414-0d1269cca22a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.267433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9c7c5-dcbc-457f-b414-0d1269cca22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:32.293137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 830/1667] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:32 2022] POST /identity/v3/projects => generated 355 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:32.293137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ac390-cce3-4a6f-84b1-027096ca5c5b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:32.360531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-acc9c7c5-dcbc-457f-b414-0d1269cca22a None None] MFA Rules not processed for user `33d3fa22dc0d4da1b3236b10442f0b59`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:32.362217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-acc9c7c5-dcbc-457f-b414-0d1269cca22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:32.507046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ac390-cce3-4a6f-84b1-027096ca5c5b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:32.514683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e5d78-31a1-4abd-bd0c-4ba743b7df9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:32.515320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5d78-31a1-4abd-bd0c-4ba743b7df9a admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.515766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5d78-31a1-4abd-bd0c-4ba743b7df9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.516172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25e5d78-31a1-4abd-bd0c-4ba743b7df9a admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:32.516928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e5d78-31a1-4abd-bd0c-4ba743b7df9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:32.520041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25e5d78-31a1-4abd-bd0c-4ba743b7df9a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:32.525070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 838/1668] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:32 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:32.534635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9c7c5-dcbc-457f-b414-0d1269cca22a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:32.538840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-acc9c7c5-dcbc-457f-b414-0d1269cca22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:32.562389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 831/1669] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:32 2022] POST /identity/v3/users => generated 278 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:32.564515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e5d78-31a1-4abd-bd0c-4ba743b7df9a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:32.594585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25e5d78-31a1-4abd-bd0c-4ba743b7df9a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:32.609470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5e989-bd8b-4bbf-9ef4-3b437b3b3409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:32.610467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5e989-bd8b-4bbf-9ef4-3b437b3b3409 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.612254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5e989-bd8b-4bbf-9ef4-3b437b3b3409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.612561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c5e989-bd8b-4bbf-9ef4-3b437b3b3409 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:32.614904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5e989-bd8b-4bbf-9ef4-3b437b3b3409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:32.619088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c5e989-bd8b-4bbf-9ef4-3b437b3b3409 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:32.657704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 832/1670] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:32.660082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5e989-bd8b-4bbf-9ef4-3b437b3b3409 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:32.686003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:32.688719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c5e989-bd8b-4bbf-9ef4-3b437b3b3409 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:32.702485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9c7c5-dcbc-457f-b414-0d1269cca22a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:32.706878 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a60e6a1-5bec-4994-a9d1-3e3b112f6e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:32.710459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e6a1-5bec-4994-a9d1-3e3b112f6e48 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.711068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e6a1-5bec-4994-a9d1-3e3b112f6e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.723834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a60e6a1-5bec-4994-a9d1-3e3b112f6e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:32.726369 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60e6a1-5bec-4994-a9d1-3e3b112f6e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:32.726909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9952-37c6-4bd7-90e3-06da899be32a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:32.727574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9952-37c6-4bd7-90e3-06da899be32a service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.728585 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9952-37c6-4bd7-90e3-06da899be32a service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.728866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050a9952-37c6-4bd7-90e3-06da899be32a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:32.730213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a60e6a1-5bec-4994-a9d1-3e3b112f6e48 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:32.753327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 833/1671] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:32.755437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a9952-37c6-4bd7-90e3-06da899be32a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:32.757943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050a9952-37c6-4bd7-90e3-06da899be32a service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:32.761252 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271699e-22f8-4c8f-8f97-7d99c1fdc6b8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.761585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271699e-22f8-4c8f-8f97-7d99c1fdc6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.761880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9271699e-22f8-4c8f-8f97-7d99c1fdc6b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:32.807652 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 839/1672] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:32 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:32.810199 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9952-37c6-4bd7-90e3-06da899be32a service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:32.823733 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:32.859029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050a9952-37c6-4bd7-90e3-06da899be32a service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:32.868236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b95f9c8-6265-431a-8313-1b12d54f443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:32.869179 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95f9c8-6265-431a-8313-1b12d54f443c admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.871614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95f9c8-6265-431a-8313-1b12d54f443c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.872643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b95f9c8-6265-431a-8313-1b12d54f443c admin admin] PATH_INFO: `/v3/projects/ed6b402f2cfa4215851abb44a38e9abf/users/052c38b716104f34b7b71cecef1c3bcd/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:32.880450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9271699e-22f8-4c8f-8f97-7d99c1fdc6b8 None None] MFA Rules not processed for user `f3cc3768b87844298b2b21ba8dc61662`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:32.881717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9271699e-22f8-4c8f-8f97-7d99c1fdc6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:32.895047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95f9c8-6265-431a-8313-1b12d54f443c admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed6b402f2cfa4215851abb44a38e9abf, user_id=052c38b716104f34b7b71cecef1c3bcd, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:32.899991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b95f9c8-6265-431a-8313-1b12d54f443c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:32.939422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 840/1673] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:32 2022] PUT /identity/v3/projects/ed6b402f2cfa4215851abb44a38e9abf/users/052c38b716104f34b7b71cecef1c3bcd/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:32.951939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033caa5-3676-44e5-adc8-86e441405e30 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:32.952698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033caa5-3676-44e5-adc8-86e441405e30 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:32.952698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033caa5-3676-44e5-adc8-86e441405e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:33.038946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6033caa5-3676-44e5-adc8-86e441405e30 None None] MFA Rules not processed for user `052c38b716104f34b7b71cecef1c3bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:33.044587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6033caa5-3676-44e5-adc8-86e441405e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:33.087873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 834/1674] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:32 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:33.095094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271699e-22f8-4c8f-8f97-7d99c1fdc6b8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:33.101742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9271699e-22f8-4c8f-8f97-7d99c1fdc6b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:33.290346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 841/1675] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:32 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:03:33.291768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033caa5-3676-44e5-adc8-86e441405e30 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:33.345557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9271699e-22f8-4c8f-8f97-7d99c1fdc6b8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:33.495832 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033caa5-3676-44e5-adc8-86e441405e30 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:33.517471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4409ff8-2486-469f-bf20-a5cade8977f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:33.518649 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4409ff8-2486-469f-bf20-a5cade8977f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:33.519759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4409ff8-2486-469f-bf20-a5cade8977f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:33.520763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4409ff8-2486-469f-bf20-a5cade8977f3 admin admin] PATH_INFO: `/v3/users/6d97b06fdffd4acdb24184b6568df4bb` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:33.523600 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4409ff8-2486-469f-bf20-a5cade8977f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d97b06fdffd4acdb24184b6568df4bb)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:33.527357 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2dd76-1104-43ae-bb82-e00ba4559ca0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:33.528673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2dd76-1104-43ae-bb82-e00ba4559ca0 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:33.528977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2dd76-1104-43ae-bb82-e00ba4559ca0 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:33.529250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea2dd76-1104-43ae-bb82-e00ba4559ca0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:33.531947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4409ff8-2486-469f-bf20-a5cade8977f3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:33.610875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:33.651175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a4409ff8-2486-469f-bf20-a5cade8977f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d97b06fdffd4acdb24184b6568df4bb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:33.671838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a4409ff8-2486-469f-bf20-a5cade8977f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d97b06fdffd4acdb24184b6568df4bb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:33.674685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:33.690047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2dd76-1104-43ae-bb82-e00ba4559ca0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:33.691763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a4409ff8-2486-469f-bf20-a5cade8977f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d97b06fdffd4acdb24184b6568df4bb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:33.692987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a4409ff8-2486-469f-bf20-a5cade8977f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d97b06fdffd4acdb24184b6568df4bb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:33.694544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea2dd76-1104-43ae-bb82-e00ba4559ca0 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:33.714350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a4409ff8-2486-469f-bf20-a5cade8977f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d97b06fdffd4acdb24184b6568df4bb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:33.724966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 835/1676] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:33 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:03:33.727421 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2dd76-1104-43ae-bb82-e00ba4559ca0 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:33.730171 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 842/1677] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:33 2022] DELETE /identity/v3/users/6d97b06fdffd4acdb24184b6568df4bb => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:33.736215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366a297-3799-4f62-b02e-1c3086d57ae8 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:33.736643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366a297-3799-4f62-b02e-1c3086d57ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:33.738575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c366a297-3799-4f62-b02e-1c3086d57ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:33.756546 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea2dd76-1104-43ae-bb82-e00ba4559ca0 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:33.799252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c366a297-3799-4f62-b02e-1c3086d57ae8 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:33.800815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c366a297-3799-4f62-b02e-1c3086d57ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:33.869084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af2c1d-f69f-4d03-b362-b1902b54d9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:33.871335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2c1d-f69f-4d03-b362-b1902b54d9f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:33.872061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2c1d-f69f-4d03-b362-b1902b54d9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:33.873713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1af2c1d-f69f-4d03-b362-b1902b54d9f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:33.876358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af2c1d-f69f-4d03-b362-b1902b54d9f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:33.878356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1af2c1d-f69f-4d03-b362-b1902b54d9f4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:33.886323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 843/1678] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:33.920744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366a297-3799-4f62-b02e-1c3086d57ae8 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:33.922847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c366a297-3799-4f62-b02e-1c3086d57ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:33.932142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 836/1679] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:33 2022] POST /identity/v3/projects => generated 357 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:33.937439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af2c1d-f69f-4d03-b362-b1902b54d9f4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:33.939805 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b1af2c1d-f69f-4d03-b362-b1902b54d9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:34.045424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1af2c1d-f69f-4d03-b362-b1902b54d9f4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:34.053136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481346bb-61e4-41d6-994b-0119b0b61584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:34.054321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481346bb-61e4-41d6-994b-0119b0b61584 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:34.054821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481346bb-61e4-41d6-994b-0119b0b61584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:34.055292 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481346bb-61e4-41d6-994b-0119b0b61584 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:34.056279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481346bb-61e4-41d6-994b-0119b0b61584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:34.060364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481346bb-61e4-41d6-994b-0119b0b61584 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:34.068208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c366a297-3799-4f62-b02e-1c3086d57ae8 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:34.097689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 837/1680] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:33 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:34.102936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481346bb-61e4-41d6-994b-0119b0b61584 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:34.133137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481346bb-61e4-41d6-994b-0119b0b61584 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:34.151869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427c26-82eb-40d4-b988-6bf4205323e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:34.152513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427c26-82eb-40d4-b988-6bf4205323e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:34.153941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427c26-82eb-40d4-b988-6bf4205323e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:34.154218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a427c26-82eb-40d4-b988-6bf4205323e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:34.156175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a427c26-82eb-40d4-b988-6bf4205323e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:34.162531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a427c26-82eb-40d4-b988-6bf4205323e8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:34.195071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f1afb-ae9e-4e12-b0d5-b10e8fbfb21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:34.200952 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f1afb-ae9e-4e12-b0d5-b10e8fbfb21d service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:34.201514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f1afb-ae9e-4e12-b0d5-b10e8fbfb21d service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:34.202208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f1afb-ae9e-4e12-b0d5-b10e8fbfb21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:34.203389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 838/1681] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:34.207306 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427c26-82eb-40d4-b988-6bf4205323e8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:34.255881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f1afb-ae9e-4e12-b0d5-b10e8fbfb21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:34.265282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5f1afb-ae9e-4e12-b0d5-b10e8fbfb21d service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:34.269729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a427c26-82eb-40d4-b988-6bf4205323e8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:34.291935 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3739c8-b133-4a24-9201-19a7aec9a53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:34.292803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3739c8-b133-4a24-9201-19a7aec9a53b admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:34.295194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3739c8-b133-4a24-9201-19a7aec9a53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:34.296235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3739c8-b133-4a24-9201-19a7aec9a53b admin admin] PATH_INFO: `/v3/projects/6f84d86867f545cdba56964bcab57712/users/afdcc0ac2744460e859b27088c8d41ee/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:34.301647 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 844/1682] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:03:34.302538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f1afb-ae9e-4e12-b0d5-b10e8fbfb21d service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:34.312020 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6d5f1afb-ae9e-4e12-b0d5-b10e8fbfb21d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:34.327843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5f1afb-ae9e-4e12-b0d5-b10e8fbfb21d service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:34.333558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:34.334224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:34.334554 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:34.334877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] PATH_INFO: `/v3/projects/cb077f1e4d644e5ba1b56d8e206bec61` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:34.336272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb077f1e4d644e5ba1b56d8e206bec61)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:34.338706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:34.348848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3739c8-b133-4a24-9201-19a7aec9a53b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f84d86867f545cdba56964bcab57712, user_id=afdcc0ac2744460e859b27088c8d41ee, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:34.351262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3739c8-b133-4a24-9201-19a7aec9a53b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:34.381412 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 839/1683] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:34 2022] PUT /identity/v3/projects/6f84d86867f545cdba56964bcab57712/users/afdcc0ac2744460e859b27088c8d41ee/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:34.385502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3739c8-b133-4a24-9201-19a7aec9a53b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:34.416531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:34.442755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:34.499473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb077f1e4d644e5ba1b56d8e206bec61', 'request_id': 'req-5e364fb1-4d83-4ee6-88aa-463ca589d80e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:34.516000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb077f1e4d644e5ba1b56d8e206bec61', 'request_id': 'req-5e364fb1-4d83-4ee6-88aa-463ca589d80e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:34.532329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb077f1e4d644e5ba1b56d8e206bec61', 'request_id': 'req-5e364fb1-4d83-4ee6-88aa-463ca589d80e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:34.554732 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3739c8-b133-4a24-9201-19a7aec9a53b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:34.575830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] The token cache is being invalidate because project cb077f1e4d644e5ba1b56d8e206bec61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:03:34.575830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:34.575830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:34.591961 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 845/1684] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:03:34 2022] DELETE /identity/v3/projects/cb077f1e4d644e5ba1b56d8e206bec61 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:34.594418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:34.598780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:34.701066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0af99c-5ef9-47a5-afe8-fcf5d9566058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:34.704087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0af99c-5ef9-47a5-afe8-fcf5d9566058 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:34.704377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0af99c-5ef9-47a5-afe8-fcf5d9566058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:34.704658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0af99c-5ef9-47a5-afe8-fcf5d9566058 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:34.710031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0af99c-5ef9-47a5-afe8-fcf5d9566058 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:34.711754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0af99c-5ef9-47a5-afe8-fcf5d9566058 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:34.734811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 840/1685] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:34.737754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0af99c-5ef9-47a5-afe8-fcf5d9566058 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:34.744290 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ac0af99c-5ef9-47a5-afe8-fcf5d9566058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:34.774680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0af99c-5ef9-47a5-afe8-fcf5d9566058 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:34.783250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0b6107-077a-465c-82c5-34c327890ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:34.784338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b6107-077a-465c-82c5-34c327890ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:34.785160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b6107-077a-465c-82c5-34c327890ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:34.785160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0b6107-077a-465c-82c5-34c327890ec7 admin admin] PATH_INFO: `/v3/projects/6f84d86867f545cdba56964bcab57712/users/afdcc0ac2744460e859b27088c8d41ee/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:34.788703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b6107-077a-465c-82c5-34c327890ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f84d86867f545cdba56964bcab57712, user_id=afdcc0ac2744460e859b27088c8d41ee, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:34.792753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0b6107-077a-465c-82c5-34c327890ec7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:34.831586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 841/1686] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:34 2022] PUT /identity/v3/projects/6f84d86867f545cdba56964bcab57712/users/afdcc0ac2744460e859b27088c8d41ee/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:34.845172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d749c-3019-4acc-884d-8544779f8d6d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:34.845600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d749c-3019-4acc-884d-8544779f8d6d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:34.845884 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d749c-3019-4acc-884d-8544779f8d6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:34.852836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e364fb1-4d83-4ee6-88aa-463ca589d80e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:34.926788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5a9d749c-3019-4acc-884d-8544779f8d6d None None] MFA Rules not processed for user `afdcc0ac2744460e859b27088c8d41ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:34.928341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5a9d749c-3019-4acc-884d-8544779f8d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:35.050855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:35.051983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:35.052557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:35.053030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] PATH_INFO: `/v3/users/714929afa3e2495fa669d4180edf7730` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:35.054721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=714929afa3e2495fa669d4180edf7730)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:35.057082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:35.104681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 842/1687] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:34 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:35.119997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d749c-3019-4acc-884d-8544779f8d6d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:35.123298 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5a9d749c-3019-4acc-884d-8544779f8d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:35.193219 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '714929afa3e2495fa669d4180edf7730'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:35.214879 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '714929afa3e2495fa669d4180edf7730'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:35.237701 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:35.250670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:35.255795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '714929afa3e2495fa669d4180edf7730'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:35.259434 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '714929afa3e2495fa669d4180edf7730'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:35.283510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '714929afa3e2495fa669d4180edf7730'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:35.303437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 846/1688] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:34 2022] DELETE /identity/v3/users/714929afa3e2495fa669d4180edf7730 => generated 0 bytes in 709 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:35.344678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d749c-3019-4acc-884d-8544779f8d6d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:35.461013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e67e0-6044-4b29-ba99-3f32df34d25d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:35.462665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e67e0-6044-4b29-ba99-3f32df34d25d service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:35.463022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e67e0-6044-4b29-ba99-3f32df34d25d service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:35.463368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e67e0-6044-4b29-ba99-3f32df34d25d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:35.466365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6a8e67e0-6044-4b29-ba99-3f32df34d25d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:35.620196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:35.622029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:35.678210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e67e0-6044-4b29-ba99-3f32df34d25d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:35.680073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e67e0-6044-4b29-ba99-3f32df34d25d service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:35.716183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 843/1689] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:35 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:35.829453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10665ae9-499f-40a2-8b59-d82c213ead47 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:35.841585 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68efca4-792e-4f6f-9c07-c881268fdac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:35.843040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68efca4-792e-4f6f-9c07-c881268fdac5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:35.845199 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68efca4-792e-4f6f-9c07-c881268fdac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:35.846489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68efca4-792e-4f6f-9c07-c881268fdac5 admin admin] PATH_INFO: `/v3/users/c3f30b1b5b384de2adda399e25500fbf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:35.851032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68efca4-792e-4f6f-9c07-c881268fdac5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3f30b1b5b384de2adda399e25500fbf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:35.857907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68efca4-792e-4f6f-9c07-c881268fdac5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:35.937127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e67e0-6044-4b29-ba99-3f32df34d25d service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:35.939979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6a8e67e0-6044-4b29-ba99-3f32df34d25d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:35.970265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e67e0-6044-4b29-ba99-3f32df34d25d service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:35.980690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85037f1e-4395-461d-82d7-b334f5b535da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:35.982988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85037f1e-4395-461d-82d7-b334f5b535da service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:35.983271 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85037f1e-4395-461d-82d7-b334f5b535da service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:35.983656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85037f1e-4395-461d-82d7-b334f5b535da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:35.985956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-85037f1e-4395-461d-82d7-b334f5b535da service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:35.989061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d68efca4-792e-4f6f-9c07-c881268fdac5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3f30b1b5b384de2adda399e25500fbf'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:36.022740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d68efca4-792e-4f6f-9c07-c881268fdac5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3f30b1b5b384de2adda399e25500fbf'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:36.044341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d68efca4-792e-4f6f-9c07-c881268fdac5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3f30b1b5b384de2adda399e25500fbf'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:36.045700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d68efca4-792e-4f6f-9c07-c881268fdac5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3f30b1b5b384de2adda399e25500fbf'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:36.056110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d68efca4-792e-4f6f-9c07-c881268fdac5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3f30b1b5b384de2adda399e25500fbf'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:36.069222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 847/1690] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:35 2022] DELETE /identity/v3/users/c3f30b1b5b384de2adda399e25500fbf => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:36.076180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6f8c-b3dc-4484-ab4b-c882ba6dd621 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:36.076692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6f8c-b3dc-4484-ab4b-c882ba6dd621 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:36.077106 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812f6f8c-b3dc-4484-ab4b-c882ba6dd621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:36.125693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-812f6f8c-b3dc-4484-ab4b-c882ba6dd621 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:36.128818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-812f6f8c-b3dc-4484-ab4b-c882ba6dd621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:36.176115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85037f1e-4395-461d-82d7-b334f5b535da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:36.183681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85037f1e-4395-461d-82d7-b334f5b535da service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:36.218346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 844/1691] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:35 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:03:36.220148 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a8ffe-ec11-454b-a940-deae8750d1e6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:36.223092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a8ffe-ec11-454b-a940-deae8750d1e6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:36.223683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58a8ffe-ec11-454b-a940-deae8750d1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:36.247752 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 848/1692] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:03:36.270105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f6f8c-b3dc-4484-ab4b-c882ba6dd621 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:36.271939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-812f6f8c-b3dc-4484-ab4b-c882ba6dd621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:36.287033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:36.307824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e58a8ffe-ec11-454b-a940-deae8750d1e6 None None] MFA Rules not processed for user `ea32636c7dbc4cb586e8b9021218b8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:36.309987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e58a8ffe-ec11-454b-a940-deae8750d1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:36.359823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:36.452513 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812f6f8c-b3dc-4484-ab4b-c882ba6dd621 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:36.471791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 845/1693] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:36.478089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0c8f4-8ce6-45f6-beff-3638b053f772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:36.480758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0c8f4-8ce6-45f6-beff-3638b053f772 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:36.482465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0c8f4-8ce6-45f6-beff-3638b053f772 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:36.482952 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a0c8f4-8ce6-45f6-beff-3638b053f772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:36.494580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a8ffe-ec11-454b-a940-deae8750d1e6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:36.499911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e58a8ffe-ec11-454b-a940-deae8750d1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:36.511913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0c8f4-8ce6-45f6-beff-3638b053f772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:36.514441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a0c8f4-8ce6-45f6-beff-3638b053f772 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:36.553065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 849/1694] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:03:36.725025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58a8ffe-ec11-454b-a940-deae8750d1e6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:36.737810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18b303-a12b-45a8-a791-94eb089c1fc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:36.738853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18b303-a12b-45a8-a791-94eb089c1fc4 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:36.739115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18b303-a12b-45a8-a791-94eb089c1fc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:36.739394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb18b303-a12b-45a8-a791-94eb089c1fc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:36.758996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18b303-a12b-45a8-a791-94eb089c1fc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:36.760820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb18b303-a12b-45a8-a791-94eb089c1fc4 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:36.773408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 846/1695] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:37.311270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0c8f4-8ce6-45f6-beff-3638b053f772 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:37.317546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-57a0c8f4-8ce6-45f6-beff-3638b053f772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:37.357518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a0c8f4-8ce6-45f6-beff-3638b053f772 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:37.377760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:37.378747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:37.379166 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:37.380427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] PATH_INFO: `/v3/projects/12c4ef4ef2734d5f8e59729ca2085a07` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:37.384215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12c4ef4ef2734d5f8e59729ca2085a07)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:37.389464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:37.512428 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12c4ef4ef2734d5f8e59729ca2085a07', 'request_id': 'req-a64c298b-e374-4291-b0ae-3e4d005ebd77'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:37.522273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12c4ef4ef2734d5f8e59729ca2085a07', 'request_id': 'req-a64c298b-e374-4291-b0ae-3e4d005ebd77'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:37.537079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12c4ef4ef2734d5f8e59729ca2085a07', 'request_id': 'req-a64c298b-e374-4291-b0ae-3e4d005ebd77'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:37.563817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] The token cache is being invalidate because project 12c4ef4ef2734d5f8e59729ca2085a07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:03:37.564232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:37.567083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:37.569709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 850/1696] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:03:37 2022] DELETE /identity/v3/projects/12c4ef4ef2734d5f8e59729ca2085a07 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:37.573908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18b303-a12b-45a8-a791-94eb089c1fc4 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:37.585468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:37.587802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:37.589021 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb18b303-a12b-45a8-a791-94eb089c1fc4 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:37.707043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c298b-e374-4291-b0ae-3e4d005ebd77 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:37.718724 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901daa0-0da2-4eca-bb46-358bed208ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:37.720042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901daa0-0da2-4eca-bb46-358bed208ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:37.720542 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901daa0-0da2-4eca-bb46-358bed208ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:37.720982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901daa0-0da2-4eca-bb46-358bed208ddd admin admin] PATH_INFO: `/v3/projects/4086584c8f774ef3b6c2c50830712fd4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:37.735457 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901daa0-0da2-4eca-bb46-358bed208ddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4086584c8f774ef3b6c2c50830712fd4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:37.737641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901daa0-0da2-4eca-bb46-358bed208ddd admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:37.779174 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbb325-9192-4f76-90cf-0991c123d94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:37.779897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbb325-9192-4f76-90cf-0991c123d94a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:37.780186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbb325-9192-4f76-90cf-0991c123d94a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:37.780790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbb325-9192-4f76-90cf-0991c123d94a admin admin] PATH_INFO: `/v3/users/33d3fa22dc0d4da1b3236b10442f0b59` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:37.782995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbb325-9192-4f76-90cf-0991c123d94a admin admin] RBAC: Authorizing `identity:delete_user(user_id=33d3fa22dc0d4da1b3236b10442f0b59)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:37.788909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbb325-9192-4f76-90cf-0991c123d94a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:37.830210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:37.857286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2901daa0-0da2-4eca-bb46-358bed208ddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4086584c8f774ef3b6c2c50830712fd4', 'request_id': 'req-2901daa0-0da2-4eca-bb46-358bed208ddd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:37.866992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2901daa0-0da2-4eca-bb46-358bed208ddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4086584c8f774ef3b6c2c50830712fd4', 'request_id': 'req-2901daa0-0da2-4eca-bb46-358bed208ddd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:37.889852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2901daa0-0da2-4eca-bb46-358bed208ddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4086584c8f774ef3b6c2c50830712fd4', 'request_id': 'req-2901daa0-0da2-4eca-bb46-358bed208ddd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:37.932875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2901daa0-0da2-4eca-bb46-358bed208ddd admin admin] The token cache is being invalidate because project 4086584c8f774ef3b6c2c50830712fd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:03:37.933170 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2901daa0-0da2-4eca-bb46-358bed208ddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:37.934077 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2901daa0-0da2-4eca-bb46-358bed208ddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:37.935966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-79fbb325-9192-4f76-90cf-0991c123d94a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33d3fa22dc0d4da1b3236b10442f0b59'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:37.938121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-79fbb325-9192-4f76-90cf-0991c123d94a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33d3fa22dc0d4da1b3236b10442f0b59'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:37.940807 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:37.942769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 851/1697] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:03:37 2022] DELETE /identity/v3/projects/4086584c8f774ef3b6c2c50830712fd4 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:37.949349 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94b94-6d7d-4c03-86d6-07d9d39daefe None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:37.951205 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94b94-6d7d-4c03-86d6-07d9d39daefe None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:37.952476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae94b94-6d7d-4c03-86d6-07d9d39daefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:37.972595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-79fbb325-9192-4f76-90cf-0991c123d94a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33d3fa22dc0d4da1b3236b10442f0b59'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:38.003808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-79fbb325-9192-4f76-90cf-0991c123d94a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33d3fa22dc0d4da1b3236b10442f0b59'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:38.013841 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2ae94b94-6d7d-4c03-86d6-07d9d39daefe None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:38.016912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2ae94b94-6d7d-4c03-86d6-07d9d39daefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:38.027206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-79fbb325-9192-4f76-90cf-0991c123d94a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33d3fa22dc0d4da1b3236b10442f0b59'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:38.041211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 847/1698] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:37 2022] DELETE /identity/v3/users/33d3fa22dc0d4da1b3236b10442f0b59 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:38.138585 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 852/1699] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:38.146002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a4721-7c61-40a5-b43e-292387fe66af None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:38.146278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a4721-7c61-40a5-b43e-292387fe66af None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:38.146553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a4721-7c61-40a5-b43e-292387fe66af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:38.187059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-817a4721-7c61-40a5-b43e-292387fe66af None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:38.188174 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-817a4721-7c61-40a5-b43e-292387fe66af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:38.306366 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 848/1700] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:38.311479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94b94-6d7d-4c03-86d6-07d9d39daefe None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:38.332574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae94b94-6d7d-4c03-86d6-07d9d39daefe None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:38.339818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effae84-eff9-44dd-b74f-c3a0b41a9e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:38.340502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effae84-eff9-44dd-b74f-c3a0b41a9e46 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:38.340781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effae84-eff9-44dd-b74f-c3a0b41a9e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:38.341054 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6effae84-eff9-44dd-b74f-c3a0b41a9e46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:38.341829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effae84-eff9-44dd-b74f-c3a0b41a9e46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:38.342139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effae84-eff9-44dd-b74f-c3a0b41a9e46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:38.344279 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6effae84-eff9-44dd-b74f-c3a0b41a9e46 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:38.353601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a4721-7c61-40a5-b43e-292387fe66af None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:38.356215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-817a4721-7c61-40a5-b43e-292387fe66af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:38.364114 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 853/1701] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:38.368703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effae84-eff9-44dd-b74f-c3a0b41a9e46 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:38.383406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a4721-7c61-40a5-b43e-292387fe66af None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:38.383799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6effae84-eff9-44dd-b74f-c3a0b41a9e46 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:38.391068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070bd1d-1408-4b17-a656-7129e8b14043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:38.393363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:38.393913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070bd1d-1408-4b17-a656-7129e8b14043 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:38.394174 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:38.394281 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070bd1d-1408-4b17-a656-7129e8b14043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:38.394472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5070bd1d-1408-4b17-a656-7129e8b14043 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:38.394789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:38.395159 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070bd1d-1408-4b17-a656-7129e8b14043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:38.395262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe admin admin] PATH_INFO: `/v3/projects/f65d0038329742f69239f5605ec00ca3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:38.396696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=f65d0038329742f69239f5605ec00ca3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:38.399197 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5070bd1d-1408-4b17-a656-7129e8b14043 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:38.401138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:38.483202 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 854/1702] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:38 2022] POST /identity/v3/projects => generated 367 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:38.485583 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070bd1d-1408-4b17-a656-7129e8b14043 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:38.515701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f65d0038329742f69239f5605ec00ca3', 'request_id': 'req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:38.535674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f65d0038329742f69239f5605ec00ca3', 'request_id': 'req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:38.554335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f65d0038329742f69239f5605ec00ca3', 'request_id': 'req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:38.582170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe admin admin] The token cache is being invalidate because project f65d0038329742f69239f5605ec00ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:03:38.583086 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:38.585201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4e2d40db-6249-4407-a2a6-a7fa4757c7fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:38.588844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 849/1703] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:03:38 2022] DELETE /identity/v3/projects/f65d0038329742f69239f5605ec00ca3 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:03:38.596513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec5c57-27ae-4829-8b08-20629def572d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:38.597438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec5c57-27ae-4829-8b08-20629def572d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:38.598998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec5c57-27ae-4829-8b08-20629def572d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:38.648494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e7ec5c57-27ae-4829-8b08-20629def572d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:38.650561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e7ec5c57-27ae-4829-8b08-20629def572d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:38.663052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5070bd1d-1408-4b17-a656-7129e8b14043 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:38.747153 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:38.748464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:38.790624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 850/1704] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:38.792371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3ad3-5eaf-44b7-87a4-722daed2f075 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:38.792661 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3ad3-5eaf-44b7-87a4-722daed2f075 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:38.792933 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5d3ad3-5eaf-44b7-87a4-722daed2f075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:38.834686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa647c7b-1018-410b-a61e-2016c274f97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:38.835333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa647c7b-1018-410b-a61e-2016c274f97e admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:38.835613 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa647c7b-1018-410b-a61e-2016c274f97e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:38.835887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa647c7b-1018-410b-a61e-2016c274f97e admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:38.836564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa647c7b-1018-410b-a61e-2016c274f97e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:38.839427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa647c7b-1018-410b-a61e-2016c274f97e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:38.868912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fe5d3ad3-5eaf-44b7-87a4-722daed2f075 None None] MFA Rules not processed for user `99e51f3319eb483f8ac05bdfe68d3695`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:38.870821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fe5d3ad3-5eaf-44b7-87a4-722daed2f075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:38.875097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 855/1705] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:38 2022] POST /identity/v3/users => generated 284 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:38.876553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5e714-6a7f-4649-a761-51ceafb14cdd None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:38.877018 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5e714-6a7f-4649-a761-51ceafb14cdd None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:38.877671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5e714-6a7f-4649-a761-51ceafb14cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:38.908484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-abf5e714-6a7f-4649-a761-51ceafb14cdd None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:38.909845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-abf5e714-6a7f-4649-a761-51ceafb14cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:38.927031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 856/1706] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:38.929787 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5e714-6a7f-4649-a761-51ceafb14cdd None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:38.933679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-abf5e714-6a7f-4649-a761-51ceafb14cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:38.970672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5e714-6a7f-4649-a761-51ceafb14cdd None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:38.983180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13140694-3f62-40b3-9036-176acfc11912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:38.983830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13140694-3f62-40b3-9036-176acfc11912 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:38.984709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13140694-3f62-40b3-9036-176acfc11912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:38.984982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13140694-3f62-40b3-9036-176acfc11912 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:38.986870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13140694-3f62-40b3-9036-176acfc11912 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:38.992099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13140694-3f62-40b3-9036-176acfc11912 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:39.020389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 857/1707] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:39.021337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13140694-3f62-40b3-9036-176acfc11912 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:39.029894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 851/1708] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:39.045060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d3ad3-5eaf-44b7-87a4-722daed2f075 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:39.065793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13140694-3f62-40b3-9036-176acfc11912 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:39.077180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5d3ad3-5eaf-44b7-87a4-722daed2f075 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:39.092061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a11161-ab1c-4ffb-9044-bebe00781c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:39.093474 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a11161-ab1c-4ffb-9044-bebe00781c24 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:39.094968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0b66c-060e-4fe1-959d-38f07e2fdfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:39.096953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a11161-ab1c-4ffb-9044-bebe00781c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:39.097104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0b66c-060e-4fe1-959d-38f07e2fdfda admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:39.097328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a11161-ab1c-4ffb-9044-bebe00781c24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:39.097417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0b66c-060e-4fe1-959d-38f07e2fdfda admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:39.097679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe0b66c-060e-4fe1-959d-38f07e2fdfda admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:39.100192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a11161-ab1c-4ffb-9044-bebe00781c24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:39.100576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0b66c-060e-4fe1-959d-38f07e2fdfda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:39.101730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0b66c-060e-4fe1-959d-38f07e2fdfda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:39.102999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a11161-ab1c-4ffb-9044-bebe00781c24 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:39.106739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe0b66c-060e-4fe1-959d-38f07e2fdfda admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:39.131207 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 852/1709] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:39 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:39.134900 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1d83-f9e5-44ec-8393-3d12f144f293 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:39.136346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1d83-f9e5-44ec-8393-3d12f144f293 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:39.136643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81a1d83-f9e5-44ec-8393-3d12f144f293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:39.147229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 858/1710] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:39.149912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0b66c-060e-4fe1-959d-38f07e2fdfda admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:39.176271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe0b66c-060e-4fe1-959d-38f07e2fdfda admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:39.190029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f81a1d83-f9e5-44ec-8393-3d12f144f293 None None] MFA Rules not processed for user `99e51f3319eb483f8ac05bdfe68d3695`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:39.191333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f81a1d83-f9e5-44ec-8393-3d12f144f293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:39.200054 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797e55a-a422-48c1-b4e1-f258409bc658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:39.201211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797e55a-a422-48c1-b4e1-f258409bc658 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:39.201782 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797e55a-a422-48c1-b4e1-f258409bc658 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:39.202445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2797e55a-a422-48c1-b4e1-f258409bc658 admin admin] PATH_INFO: `/v3/projects/4ae5e89c0c524ce68ffbd804fbf297ae/users/6ae73353efa1463bae133d4f39b829c3/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:39.208913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 853/1711] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:39.214743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b42f9-9e5d-4912-82cf-931d50946625 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:39.232869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b42f9-9e5d-4912-82cf-931d50946625 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:39.233488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698b42f9-9e5d-4912-82cf-931d50946625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:39.258862 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797e55a-a422-48c1-b4e1-f258409bc658 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ae5e89c0c524ce68ffbd804fbf297ae, user_id=6ae73353efa1463bae133d4f39b829c3, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:39.262599 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2797e55a-a422-48c1-b4e1-f258409bc658 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:39.291199 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 859/1712] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:39 2022] PUT /identity/v3/projects/4ae5e89c0c524ce68ffbd804fbf297ae/users/6ae73353efa1463bae133d4f39b829c3/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:39.292184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797e55a-a422-48c1-b4e1-f258409bc658 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:39.341054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-698b42f9-9e5d-4912-82cf-931d50946625 None None] MFA Rules not processed for user `10f497bc876d4aa7b4ff9119d618b25a`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:39.342314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-698b42f9-9e5d-4912-82cf-931d50946625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:39.509755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2797e55a-a422-48c1-b4e1-f258409bc658 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:39.529225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16e4fe-bef4-4750-a782-7ea99ea93397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:39.529919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16e4fe-bef4-4750-a782-7ea99ea93397 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:39.530201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16e4fe-bef4-4750-a782-7ea99ea93397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:39.530476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16e4fe-bef4-4750-a782-7ea99ea93397 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:39.534706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16e4fe-bef4-4750-a782-7ea99ea93397 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:39.552043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16e4fe-bef4-4750-a782-7ea99ea93397 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:39.595979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 854/1713] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:39.598639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b42f9-9e5d-4912-82cf-931d50946625 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:39.608250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-698b42f9-9e5d-4912-82cf-931d50946625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:39.622919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 860/1714] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:39 2022] POST /identity/v3/projects => generated 387 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:39.627594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a859d4-a220-4aaf-a167-e258932b8c9b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:39.627594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a859d4-a220-4aaf-a167-e258932b8c9b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:39.627594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a859d4-a220-4aaf-a167-e258932b8c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:39.705902 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c6a859d4-a220-4aaf-a167-e258932b8c9b None None] MFA Rules not processed for user `6ae73353efa1463bae133d4f39b829c3`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:39.707488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c6a859d4-a220-4aaf-a167-e258932b8c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:39.743380 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:39.811555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698b42f9-9e5d-4912-82cf-931d50946625 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:39.822961 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:39.878475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 861/1715] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:39 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:39.886901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0e000-06a9-4700-a365-498b0ce87219 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:39.889446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0e000-06a9-4700-a365-498b0ce87219 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:39.889726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a0e000-06a9-4700-a365-498b0ce87219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:39.933771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-65a0e000-06a9-4700-a365-498b0ce87219 None None] MFA Rules not processed for user `10f497bc876d4aa7b4ff9119d618b25a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:39.935576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-65a0e000-06a9-4700-a365-498b0ce87219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:40.000968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96265d4-137e-4056-ac18-9011d430a337 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:40.002554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96265d4-137e-4056-ac18-9011d430a337 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:40.002844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96265d4-137e-4056-ac18-9011d430a337 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:40.003116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96265d4-137e-4056-ac18-9011d430a337 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:40.098445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 862/1716] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:40.106908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0e000-06a9-4700-a365-498b0ce87219 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:40.118444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-65a0e000-06a9-4700-a365-498b0ce87219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:40.191930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96265d4-137e-4056-ac18-9011d430a337 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:40.193621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96265d4-137e-4056-ac18-9011d430a337 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:40.230114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 855/1717] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:40.231875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96265d4-137e-4056-ac18-9011d430a337 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:40.441822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96265d4-137e-4056-ac18-9011d430a337 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:40.460237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a0e000-06a9-4700-a365-498b0ce87219 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:40.473218 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc18638-e194-4cc0-b36b-a7de336ae4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:40.474089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de44e3-7cfe-4fd5-9c63-5a844e82bcd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:40.476300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc18638-e194-4cc0-b36b-a7de336ae4c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:40.476611 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc18638-e194-4cc0-b36b-a7de336ae4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:40.476884 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc18638-e194-4cc0-b36b-a7de336ae4c7 admin admin] PATH_INFO: `/v3/projects/e1bfd38b3391448aa5fed64831280afa` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:40.483030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de44e3-7cfe-4fd5-9c63-5a844e82bcd2 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:40.483364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de44e3-7cfe-4fd5-9c63-5a844e82bcd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:40.483640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7de44e3-7cfe-4fd5-9c63-5a844e82bcd2 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:40.484422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de44e3-7cfe-4fd5-9c63-5a844e82bcd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:40.490624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc18638-e194-4cc0-b36b-a7de336ae4c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1bfd38b3391448aa5fed64831280afa)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:40.493538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc18638-e194-4cc0-b36b-a7de336ae4c7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:40.495479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7de44e3-7cfe-4fd5-9c63-5a844e82bcd2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:40.566520 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 856/1718] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:40 2022] POST /identity/v3/users => generated 294 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:40.568561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de44e3-7cfe-4fd5-9c63-5a844e82bcd2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:40.582662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7de44e3-7cfe-4fd5-9c63-5a844e82bcd2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:40.590913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ea144-94fc-420f-9655-c760a858ef9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:40.591959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ea144-94fc-420f-9655-c760a858ef9e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:40.592467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ea144-94fc-420f-9655-c760a858ef9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:40.593057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ea144-94fc-420f-9655-c760a858ef9e admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:40.593997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ea144-94fc-420f-9655-c760a858ef9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:40.596424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4ea144-94fc-420f-9655-c760a858ef9e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:40.617703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:40.645458 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 857/1719] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:40 2022] POST /identity/v3/projects => generated 369 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:40.648845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ea144-94fc-420f-9655-c760a858ef9e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:40.654406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cf4ea144-94fc-420f-9655-c760a858ef9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:40.674815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8bc18638-e194-4cc0-b36b-a7de336ae4c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bfd38b3391448aa5fed64831280afa', 'request_id': 'req-8bc18638-e194-4cc0-b36b-a7de336ae4c7'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:40.690794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8bc18638-e194-4cc0-b36b-a7de336ae4c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bfd38b3391448aa5fed64831280afa', 'request_id': 'req-8bc18638-e194-4cc0-b36b-a7de336ae4c7'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:40.709023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8bc18638-e194-4cc0-b36b-a7de336ae4c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bfd38b3391448aa5fed64831280afa', 'request_id': 'req-8bc18638-e194-4cc0-b36b-a7de336ae4c7'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:40.748249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8bc18638-e194-4cc0-b36b-a7de336ae4c7 admin admin] The token cache is being invalidate because project e1bfd38b3391448aa5fed64831280afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:03:40.748557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8bc18638-e194-4cc0-b36b-a7de336ae4c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:40.749809 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8bc18638-e194-4cc0-b36b-a7de336ae4c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:40.755996 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 863/1720] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:03:40 2022] DELETE /identity/v3/projects/e1bfd38b3391448aa5fed64831280afa => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:40.757587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147e41b-831a-4766-8c5e-3cfdebfcbc1f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:40.757874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147e41b-831a-4766-8c5e-3cfdebfcbc1f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:40.758148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147e41b-831a-4766-8c5e-3cfdebfcbc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:40.813038 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-5147e41b-831a-4766-8c5e-3cfdebfcbc1f None None] MFA Rules not processed for user `f3cc3768b87844298b2b21ba8dc61662`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:40.814714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5147e41b-831a-4766-8c5e-3cfdebfcbc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:40.839828 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:40.887545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ea144-94fc-420f-9655-c760a858ef9e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:40.914091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385ff94-db50-46a6-b1eb-bcc05fb69d5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:40.917983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385ff94-db50-46a6-b1eb-bcc05fb69d5c service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:40.924319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385ff94-db50-46a6-b1eb-bcc05fb69d5c service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:40.924827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6385ff94-db50-46a6-b1eb-bcc05fb69d5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:40.931170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6385ff94-db50-46a6-b1eb-bcc05fb69d5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:40.953654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 864/1721] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:40.961962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147e41b-831a-4766-8c5e-3cfdebfcbc1f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:40.969189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5147e41b-831a-4766-8c5e-3cfdebfcbc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:41.085801 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385ff94-db50-46a6-b1eb-bcc05fb69d5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:41.087833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6385ff94-db50-46a6-b1eb-bcc05fb69d5c service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:41.121556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 858/1722] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:40 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:41.122388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385ff94-db50-46a6-b1eb-bcc05fb69d5c service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:41.133104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6385ff94-db50-46a6-b1eb-bcc05fb69d5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:41.167311 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147e41b-831a-4766-8c5e-3cfdebfcbc1f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:41.175734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6385ff94-db50-46a6-b1eb-bcc05fb69d5c service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:41.189546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290f95e1-c8a0-4b02-8532-92cfa32f941f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:41.190202 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f95e1-c8a0-4b02-8532-92cfa32f941f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.190483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f95e1-c8a0-4b02-8532-92cfa32f941f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.190758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290f95e1-c8a0-4b02-8532-92cfa32f941f admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.191475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f95e1-c8a0-4b02-8532-92cfa32f941f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:41.195910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd2a8e-b176-426b-aa8d-86e2e0ed2f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:41.196565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd2a8e-b176-426b-aa8d-86e2e0ed2f65 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.196836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd2a8e-b176-426b-aa8d-86e2e0ed2f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.197096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd2a8e-b176-426b-aa8d-86e2e0ed2f65 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.200975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290f95e1-c8a0-4b02-8532-92cfa32f941f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:41.203026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd2a8e-b176-426b-aa8d-86e2e0ed2f65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:41.207437 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dd2a8e-b176-426b-aa8d-86e2e0ed2f65 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:41.247265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 865/1723] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:41.248909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f562-c53a-4741-9e0d-96ee15cde7c1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.249180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f562-c53a-4741-9e0d-96ee15cde7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.250935 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8175f562-c53a-4741-9e0d-96ee15cde7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.272725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 859/1724] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:41 2022] POST /identity/v3/users => generated 291 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:41.278330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd2a8e-b176-426b-aa8d-86e2e0ed2f65 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:41.320325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd2a8e-b176-426b-aa8d-86e2e0ed2f65 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:41.322686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8175f562-c53a-4741-9e0d-96ee15cde7c1 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:41.326977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8175f562-c53a-4741-9e0d-96ee15cde7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:41.333894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1353b572-afe8-411f-9b39-9e4f1d2ee85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:41.335204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353b572-afe8-411f-9b39-9e4f1d2ee85a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.335487 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353b572-afe8-411f-9b39-9e4f1d2ee85a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.335763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1353b572-afe8-411f-9b39-9e4f1d2ee85a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.339093 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353b572-afe8-411f-9b39-9e4f1d2ee85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:41.340802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1353b572-afe8-411f-9b39-9e4f1d2ee85a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:41.349491 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 866/1725] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:41.357718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175f562-c53a-4741-9e0d-96ee15cde7c1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:41.375161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 860/1726] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:41.380770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945129c0-051b-4387-b5b6-bd353319f8da None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.381436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945129c0-051b-4387-b5b6-bd353319f8da None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.381436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945129c0-051b-4387-b5b6-bd353319f8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.386486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8175f562-c53a-4741-9e0d-96ee15cde7c1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:41.397045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b7822-465f-455c-80cc-7d3e7d370b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:41.397723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b7822-465f-455c-80cc-7d3e7d370b2d admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.397997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b7822-465f-455c-80cc-7d3e7d370b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.398270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6b7822-465f-455c-80cc-7d3e7d370b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.399359 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b7822-465f-455c-80cc-7d3e7d370b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:41.401100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6b7822-465f-455c-80cc-7d3e7d370b2d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:41.429565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 867/1727] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:41.429900 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-945129c0-051b-4387-b5b6-bd353319f8da None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:41.430957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b7822-465f-455c-80cc-7d3e7d370b2d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:41.432959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-945129c0-051b-4387-b5b6-bd353319f8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:41.451950 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 861/1728] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:41.456647 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6b7822-465f-455c-80cc-7d3e7d370b2d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:41.458202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945129c0-051b-4387-b5b6-bd353319f8da None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:41.470840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a8d1e-10af-4055-a44e-48c3e7972633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:41.471586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a8d1e-10af-4055-a44e-48c3e7972633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.472604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a8d1e-10af-4055-a44e-48c3e7972633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.472894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304a8d1e-10af-4055-a44e-48c3e7972633 admin admin] PATH_INFO: `/v3/projects/0ff048a1cda04066920422a2bbd8ac31/users/1a0e1c08e3f945cc8a37cab8ad050fdb/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.477632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945129c0-051b-4387-b5b6-bd353319f8da None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:41.490696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91420c84-d2ed-4cbf-9c84-17bfac9dad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:41.491907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420c84-d2ed-4cbf-9c84-17bfac9dad15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.492190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420c84-d2ed-4cbf-9c84-17bfac9dad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.492630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91420c84-d2ed-4cbf-9c84-17bfac9dad15 admin admin] PATH_INFO: `/v3/projects/cf6faa143b464033b431d1ce6ab3b91b/users/a33ec004501c4c8d9e873c93e105347a/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.509131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a8d1e-10af-4055-a44e-48c3e7972633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ff048a1cda04066920422a2bbd8ac31, user_id=1a0e1c08e3f945cc8a37cab8ad050fdb, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:41.513460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304a8d1e-10af-4055-a44e-48c3e7972633 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:41.523926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420c84-d2ed-4cbf-9c84-17bfac9dad15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6faa143b464033b431d1ce6ab3b91b, user_id=a33ec004501c4c8d9e873c93e105347a, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:41.527553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91420c84-d2ed-4cbf-9c84-17bfac9dad15 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:41.551943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 868/1729] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:41 2022] PUT /identity/v3/projects/0ff048a1cda04066920422a2bbd8ac31/users/1a0e1c08e3f945cc8a37cab8ad050fdb/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:41.553233 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a8d1e-10af-4055-a44e-48c3e7972633 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:41.581503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 862/1730] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:41 2022] PUT /identity/v3/projects/cf6faa143b464033b431d1ce6ab3b91b/users/a33ec004501c4c8d9e873c93e105347a/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:41.585027 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc70ff-87e1-4272-813e-f9cc43f692e8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.585322 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc70ff-87e1-4272-813e-f9cc43f692e8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.586717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc70ff-87e1-4272-813e-f9cc43f692e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.667242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a6cc70ff-87e1-4272-813e-f9cc43f692e8 None None] MFA Rules not processed for user `1a0e1c08e3f945cc8a37cab8ad050fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:41.670011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a6cc70ff-87e1-4272-813e-f9cc43f692e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:41.706455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:41.747713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304a8d1e-10af-4055-a44e-48c3e7972633 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:41.774339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:41.856969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032124ec-a069-43d4-a87d-251e7b16402d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:41.857781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032124ec-a069-43d4-a87d-251e7b16402d admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.858270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032124ec-a069-43d4-a87d-251e7b16402d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.858623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032124ec-a069-43d4-a87d-251e7b16402d admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.859400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032124ec-a069-43d4-a87d-251e7b16402d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:41.859781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032124ec-a069-43d4-a87d-251e7b16402d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:41.864208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032124ec-a069-43d4-a87d-251e7b16402d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:41.875052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 863/1731] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:41.876210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc70ff-87e1-4272-813e-f9cc43f692e8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:41.900278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc70ff-87e1-4272-813e-f9cc43f692e8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:41.904093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 869/1732] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:41.904093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de88a4-4da8-46b6-b1b5-0e479fc009fa None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.904093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de88a4-4da8-46b6-b1b5-0e479fc009fa None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.904093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74de88a4-4da8-46b6-b1b5-0e479fc009fa None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.905844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 870/1733] 10.222.0.42 () {54 vars in 912 bytes} [Mon Aug 1 12:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:03:41.907091 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0d6cf-c377-4c01-8f5f-990e693df803 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.907443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0d6cf-c377-4c01-8f5f-990e693df803 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.907786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e0d6cf-c377-4c01-8f5f-990e693df803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.916648 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ba883-76cf-456a-b710-1ea7a409298d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:41.917518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ba883-76cf-456a-b710-1ea7a409298d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.917952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ba883-76cf-456a-b710-1ea7a409298d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.918903 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083ba883-76cf-456a-b710-1ea7a409298d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.919747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ba883-76cf-456a-b710-1ea7a409298d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:41.921701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083ba883-76cf-456a-b710-1ea7a409298d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:41.936015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 864/1734] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:41.940113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ba883-76cf-456a-b710-1ea7a409298d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:41.954697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083ba883-76cf-456a-b710-1ea7a409298d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:41.956281 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-36e0d6cf-c377-4c01-8f5f-990e693df803 None None] MFA Rules not processed for user `ea32636c7dbc4cb586e8b9021218b8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:41.957871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-36e0d6cf-c377-4c01-8f5f-990e693df803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:41.965727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3881f1-869d-4380-893e-ecf28888384e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:41.966571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3881f1-869d-4380-893e-ecf28888384e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:41.967248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3881f1-869d-4380-893e-ecf28888384e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:41.967824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3881f1-869d-4380-893e-ecf28888384e admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:41.968854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3881f1-869d-4380-893e-ecf28888384e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:41.977158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3881f1-869d-4380-893e-ecf28888384e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:42.057497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 871/1735] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:42.060305 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 865/1736] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:41 2022] POST /identity/v3/projects => generated 389 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:42.061755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0d6cf-c377-4c01-8f5f-990e693df803 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:42.062986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b097b7-c7e5-4922-9950-0a454220dcf6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:42.063969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b097b7-c7e5-4922-9950-0a454220dcf6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:42.065658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b097b7-c7e5-4922-9950-0a454220dcf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:42.089742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e0d6cf-c377-4c01-8f5f-990e693df803 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:42.145789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-66b097b7-c7e5-4922-9950-0a454220dcf6 None None] MFA Rules not processed for user `a2afb18a441549e3b853966ea1ad286e`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:42.147343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-66b097b7-c7e5-4922-9950-0a454220dcf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:42.218161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc204cb-88aa-49a7-844f-c0424e88977a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:42.218798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc204cb-88aa-49a7-844f-c0424e88977a admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:42.219404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc204cb-88aa-49a7-844f-c0424e88977a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:42.219806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc204cb-88aa-49a7-844f-c0424e88977a admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:42.220492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc204cb-88aa-49a7-844f-c0424e88977a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:42.222471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc204cb-88aa-49a7-844f-c0424e88977a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:42.265474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 872/1737] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:42 2022] POST /identity/v3/projects => generated 403 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:42.266715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc204cb-88aa-49a7-844f-c0424e88977a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:42.292079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 866/1738] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:03:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:42.294700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b097b7-c7e5-4922-9950-0a454220dcf6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:42.326379 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b097b7-c7e5-4922-9950-0a454220dcf6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:42.391521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:42.422504 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc204cb-88aa-49a7-844f-c0424e88977a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:42.431014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357a3c7-a9f2-427b-a8a4-02074927aa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:42.431914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357a3c7-a9f2-427b-a8a4-02074927aa26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:42.432345 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357a3c7-a9f2-427b-a8a4-02074927aa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:42.432808 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357a3c7-a9f2-427b-a8a4-02074927aa26 admin admin] PATH_INFO: `/v3/projects/cf6faa143b464033b431d1ce6ab3b91b/users/a33ec004501c4c8d9e873c93e105347a/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:42.437917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357a3c7-a9f2-427b-a8a4-02074927aa26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf6faa143b464033b431d1ce6ab3b91b, user_id=a33ec004501c4c8d9e873c93e105347a, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:42.441733 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5357a3c7-a9f2-427b-a8a4-02074927aa26 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:42.451122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5788f6c-fc64-45ef-bd05-4bdd60779432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:42.451768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5788f6c-fc64-45ef-bd05-4bdd60779432 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:42.452042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5788f6c-fc64-45ef-bd05-4bdd60779432 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:42.452311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5788f6c-fc64-45ef-bd05-4bdd60779432 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:42.453155 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5788f6c-fc64-45ef-bd05-4bdd60779432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:42.455828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5788f6c-fc64-45ef-bd05-4bdd60779432 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:42.458136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 873/1739] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:42 2022] PUT /identity/v3/projects/cf6faa143b464033b431d1ce6ab3b91b/users/a33ec004501c4c8d9e873c93e105347a/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:42.470087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932d123-9547-471d-9b3e-b1228be554ae None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:42.471542 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932d123-9547-471d-9b3e-b1228be554ae None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:42.471980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932d123-9547-471d-9b3e-b1228be554ae None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:42.474001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 874/1740] 10.222.0.42 () {54 vars in 912 bytes} [Mon Aug 1 12:03:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:03:42.475654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932d123-9547-471d-9b3e-b1228be554ae None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:42.484841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 867/1741] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:42 2022] POST /identity/v3/users => generated 301 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:42.484841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5788f6c-fc64-45ef-bd05-4bdd60779432 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:42.486146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d5788f6c-fc64-45ef-bd05-4bdd60779432 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:42.509051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:42.605098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932d123-9547-471d-9b3e-b1228be554ae None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:42.620823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5788f6c-fc64-45ef-bd05-4bdd60779432 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:42.642228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e656118b-c0f5-46e4-b10e-4e3d92521b64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:42.642945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656118b-c0f5-46e4-b10e-4e3d92521b64 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:42.643287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656118b-c0f5-46e4-b10e-4e3d92521b64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:42.645850 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e656118b-c0f5-46e4-b10e-4e3d92521b64 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:42.645850 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656118b-c0f5-46e4-b10e-4e3d92521b64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:42.646690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e656118b-c0f5-46e4-b10e-4e3d92521b64 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:42.706659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 875/1742] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:42 2022] POST /identity/v3/users => generated 302 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:42.708696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ab29a-0993-4173-8e41-c26f9c4acbed None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:42.709382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ab29a-0993-4173-8e41-c26f9c4acbed None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:42.710195 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ab29a-0993-4173-8e41-c26f9c4acbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:42.718366 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901acd26-8339-4912-948c-7e9a6bd2fe0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:42.719157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acd26-8339-4912-948c-7e9a6bd2fe0f service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:42.719644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acd26-8339-4912-948c-7e9a6bd2fe0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:42.720011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901acd26-8339-4912-948c-7e9a6bd2fe0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:42.730270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901acd26-8339-4912-948c-7e9a6bd2fe0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:42.732979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901acd26-8339-4912-948c-7e9a6bd2fe0f service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:42.745187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 868/1743] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:42.747078 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50deb9-a3ef-4d58-b281-e4baddbe524d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:42.747660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50deb9-a3ef-4d58-b281-e4baddbe524d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:42.747660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50deb9-a3ef-4d58-b281-e4baddbe524d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:42.770610 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f22ab29a-0993-4173-8e41-c26f9c4acbed None None] MFA Rules not processed for user `a33ec004501c4c8d9e873c93e105347a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:42.772185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f22ab29a-0993-4173-8e41-c26f9c4acbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:42.807766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ce50deb9-a3ef-4d58-b281-e4baddbe524d None None] MFA Rules not processed for user `a2afb18a441549e3b853966ea1ad286e`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:42.813706 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ce50deb9-a3ef-4d58-b281-e4baddbe524d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:42.839290 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 869/1744] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:03:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:42.841477 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50deb9-a3ef-4d58-b281-e4baddbe524d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:42.877943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce50deb9-a3ef-4d58-b281-e4baddbe524d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:42.890485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f91b6-d197-490c-8a5a-44b1ffd4de04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:42.891370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f91b6-d197-490c-8a5a-44b1ffd4de04 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:42.892895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f91b6-d197-490c-8a5a-44b1ffd4de04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:42.894676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124f91b6-d197-490c-8a5a-44b1ffd4de04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:42.896690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f91b6-d197-490c-8a5a-44b1ffd4de04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:42.903354 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124f91b6-d197-490c-8a5a-44b1ffd4de04 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:42.927269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 876/1745] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:42 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:42.928178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ab29a-0993-4173-8e41-c26f9c4acbed None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:42.932957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 870/1746] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:42.937773 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f91b6-d197-490c-8a5a-44b1ffd4de04 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:42.943868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-124f91b6-d197-490c-8a5a-44b1ffd4de04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:42.954158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22ab29a-0993-4173-8e41-c26f9c4acbed None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:42.960783 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90742686-eabd-4bb9-b484-25395660a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:42.961528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90742686-eabd-4bb9-b484-25395660a627 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:42.961951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90742686-eabd-4bb9-b484-25395660a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:42.962421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90742686-eabd-4bb9-b484-25395660a627 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:42.963895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90742686-eabd-4bb9-b484-25395660a627 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:42.970945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90742686-eabd-4bb9-b484-25395660a627 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:42.980306 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124f91b6-d197-490c-8a5a-44b1ffd4de04 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:42.995717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275109-b2af-4601-bb95-8930e260278a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:42.996454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275109-b2af-4601-bb95-8930e260278a service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:42.996727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275109-b2af-4601-bb95-8930e260278a service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:42.996999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7275109-b2af-4601-bb95-8930e260278a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:43.005482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 877/1747] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:42 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:43.010221 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90742686-eabd-4bb9-b484-25395660a627 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:43.013540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7275109-b2af-4601-bb95-8930e260278a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:43.015014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7275109-b2af-4601-bb95-8930e260278a service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:43.023927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90742686-eabd-4bb9-b484-25395660a627 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:43.032361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bfefa-ba9d-42e3-b5c8-bb36e7c75543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:43.033239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bfefa-ba9d-42e3-b5c8-bb36e7c75543 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:43.033548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bfefa-ba9d-42e3-b5c8-bb36e7c75543 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:43.034223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465bfefa-ba9d-42e3-b5c8-bb36e7c75543 admin admin] PATH_INFO: `/v3/projects/3e0cd24c8bb24851a15ca069155446b2/users/4b0742ddc87c45f8990ab01a4d1b233c/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:43.036070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 871/1748] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:43.037770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275109-b2af-4601-bb95-8930e260278a service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:43.042153 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a7275109-b2af-4601-bb95-8930e260278a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:43.052888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bfefa-ba9d-42e3-b5c8-bb36e7c75543 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0cd24c8bb24851a15ca069155446b2, user_id=4b0742ddc87c45f8990ab01a4d1b233c, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:43.055290 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465bfefa-ba9d-42e3-b5c8-bb36e7c75543 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:43.085346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 878/1749] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:43 2022] PUT /identity/v3/projects/3e0cd24c8bb24851a15ca069155446b2/users/4b0742ddc87c45f8990ab01a4d1b233c/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:43.085346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bfefa-ba9d-42e3-b5c8-bb36e7c75543 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:43.161032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:43.189728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7275109-b2af-4601-bb95-8930e260278a service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:43.268919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465bfefa-ba9d-42e3-b5c8-bb36e7c75543 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:43.283286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941965e4-ff80-4d86-b6ca-8b721cd16b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:43.285136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941965e4-ff80-4d86-b6ca-8b721cd16b13 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:43.286185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941965e4-ff80-4d86-b6ca-8b721cd16b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:43.286841 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941965e4-ff80-4d86-b6ca-8b721cd16b13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:43.289183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941965e4-ff80-4d86-b6ca-8b721cd16b13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:43.294177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941965e4-ff80-4d86-b6ca-8b721cd16b13 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:43.328193 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 879/1750] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:43.329379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941965e4-ff80-4d86-b6ca-8b721cd16b13 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:43.337412 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8e979-38fa-4328-b2a5-63c1aa1d5543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:43.338337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e979-38fa-4328-b2a5-63c1aa1d5543 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:43.338769 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e979-38fa-4328-b2a5-63c1aa1d5543 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:43.339377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8e979-38fa-4328-b2a5-63c1aa1d5543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:43.341628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941965e4-ff80-4d86-b6ca-8b721cd16b13 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:43.347076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0d721-31db-474a-985f-0a5ca3a9dff1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:43.347948 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0d721-31db-474a-985f-0a5ca3a9dff1 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:43.348323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0d721-31db-474a-985f-0a5ca3a9dff1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:43.348689 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f0d721-31db-474a-985f-0a5ca3a9dff1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:43.349669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0d721-31db-474a-985f-0a5ca3a9dff1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:43.354014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f0d721-31db-474a-985f-0a5ca3a9dff1 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:43.364781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:43.373269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 880/1751] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:43 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:43.374339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0d721-31db-474a-985f-0a5ca3a9dff1 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:43.426729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f0d721-31db-474a-985f-0a5ca3a9dff1 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:43.439026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2ab94-3f8a-4e3a-aad1-bf1b06023fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:43.440805 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2ab94-3f8a-4e3a-aad1-bf1b06023fbb admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:43.441328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2ab94-3f8a-4e3a-aad1-bf1b06023fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:43.441701 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f2ab94-3f8a-4e3a-aad1-bf1b06023fbb admin admin] PATH_INFO: `/v3/projects/d56a33789b6148499aec6df72ce24639/users/e6aaad10422c4c1798f43ae2cdda5dc4/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:43.497827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2ab94-3f8a-4e3a-aad1-bf1b06023fbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d56a33789b6148499aec6df72ce24639, user_id=e6aaad10422c4c1798f43ae2cdda5dc4, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:43.503407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f2ab94-3f8a-4e3a-aad1-bf1b06023fbb admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:43.538381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 881/1752] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:43 2022] PUT /identity/v3/projects/d56a33789b6148499aec6df72ce24639/users/e6aaad10422c4c1798f43ae2cdda5dc4/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:43.539406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8e979-38fa-4328-b2a5-63c1aa1d5543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:43.540833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2ab94-3f8a-4e3a-aad1-bf1b06023fbb admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:43.542249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8e979-38fa-4328-b2a5-63c1aa1d5543 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:43.571842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 872/1753] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 535 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:43.588210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80df5ce-0120-4312-99f7-d7126a8f98d4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:43.590403 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80df5ce-0120-4312-99f7-d7126a8f98d4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:43.591037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80df5ce-0120-4312-99f7-d7126a8f98d4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:43.597794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 873/1754] 10.222.0.42 () {54 vars in 961 bytes} [Mon Aug 1 12:03:43 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:03:43.601670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f251774-19fa-42c5-91a9-c6f759d1c47c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:43.603940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f251774-19fa-42c5-91a9-c6f759d1c47c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:43.606746 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f251774-19fa-42c5-91a9-c6f759d1c47c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:43.685015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5f251774-19fa-42c5-91a9-c6f759d1c47c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:43.686514 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5f251774-19fa-42c5-91a9-c6f759d1c47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:43.804956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f2ab94-3f8a-4e3a-aad1-bf1b06023fbb admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:43.812641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4165a5e8-a585-4bb2-8c51-0df530427315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:43.816359 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165a5e8-a585-4bb2-8c51-0df530427315 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:43.816799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165a5e8-a585-4bb2-8c51-0df530427315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:43.817267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4165a5e8-a585-4bb2-8c51-0df530427315 admin admin] PATH_INFO: `/v3/projects/3e0cd24c8bb24851a15ca069155446b2/users/4b0742ddc87c45f8990ab01a4d1b233c/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:43.820313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165a5e8-a585-4bb2-8c51-0df530427315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0cd24c8bb24851a15ca069155446b2, user_id=4b0742ddc87c45f8990ab01a4d1b233c, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:43.825088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4165a5e8-a585-4bb2-8c51-0df530427315 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:43.845806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 882/1755] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:43 2022] PUT /identity/v3/projects/3e0cd24c8bb24851a15ca069155446b2/users/4b0742ddc87c45f8990ab01a4d1b233c/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:43.847304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b42d23-ea37-470d-8ecb-737790fd5096 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:43.847840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b42d23-ea37-470d-8ecb-737790fd5096 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:43.848220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b42d23-ea37-470d-8ecb-737790fd5096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:43.857452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 874/1756] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:43.858237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f251774-19fa-42c5-91a9-c6f759d1c47c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:43.859639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5f251774-19fa-42c5-91a9-c6f759d1c47c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:43.881930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b4b42d23-ea37-470d-8ecb-737790fd5096 None None] MFA Rules not processed for user `35b5e545d75d40d0abb9c8d996e3b4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:43.883887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b4b42d23-ea37-470d-8ecb-737790fd5096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:44.073698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 883/1757] 10.222.0.42 () {58 vars in 1058 bytes} [Mon Aug 1 12:03:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:44.075398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70a90-630a-4c21-a960-4e4734d9e7c1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:44.077599 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70a90-630a-4c21-a960-4e4734d9e7c1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:44.077916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a70a90-630a-4c21-a960-4e4734d9e7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:44.111032 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f251774-19fa-42c5-91a9-c6f759d1c47c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:44.136047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7980c47-9b4b-4596-b611-c97eed2d80d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:44.136748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7980c47-9b4b-4596-b611-c97eed2d80d5 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:44.137068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7980c47-9b4b-4596-b611-c97eed2d80d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:44.137434 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7980c47-9b4b-4596-b611-c97eed2d80d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:44.151193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e7980c47-9b4b-4596-b611-c97eed2d80d5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:44.159570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:44.179910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a4a70a90-630a-4c21-a960-4e4734d9e7c1 None None] MFA Rules not processed for user `4b0742ddc87c45f8990ab01a4d1b233c`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:44.182535 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a4a70a90-630a-4c21-a960-4e4734d9e7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:44.193345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7980c47-9b4b-4596-b611-c97eed2d80d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:44.194887 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7980c47-9b4b-4596-b611-c97eed2d80d5 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:44.269245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 875/1758] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:44.270508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7980c47-9b4b-4596-b611-c97eed2d80d5 service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:44.405135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:44.434287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7980c47-9b4b-4596-b611-c97eed2d80d5 service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:44.440829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 884/1759] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:44 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:44.442908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70a90-630a-4c21-a960-4e4734d9e7c1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:44.463280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30683ec2-9b96-4bcc-affc-ecbc7fe0d61f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:44.466745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30683ec2-9b96-4bcc-affc-ecbc7fe0d61f service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:44.469591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30683ec2-9b96-4bcc-affc-ecbc7fe0d61f service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:44.470087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30683ec2-9b96-4bcc-affc-ecbc7fe0d61f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:44.479622 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a70a90-630a-4c21-a960-4e4734d9e7c1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:44.504221 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c631d-c879-4e57-bcd2-d0877140a3af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:44.505887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c631d-c879-4e57-bcd2-d0877140a3af service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:44.506253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c631d-c879-4e57-bcd2-d0877140a3af service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:44.506581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c631d-c879-4e57-bcd2-d0877140a3af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:44.517943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c631d-c879-4e57-bcd2-d0877140a3af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:44.520145 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c631d-c879-4e57-bcd2-d0877140a3af service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:44.535618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 885/1760] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:44.536480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c631d-c879-4e57-bcd2-d0877140a3af service placement] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:44.659294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c631d-c879-4e57-bcd2-d0877140a3af service placement] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:44.666790 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ba2bb-9198-44e3-872b-1e8da7a44acc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:44.667507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ba2bb-9198-44e3-872b-1e8da7a44acc service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:44.668017 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ba2bb-9198-44e3-872b-1e8da7a44acc service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:44.669000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2ba2bb-9198-44e3-872b-1e8da7a44acc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:44.672529 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30683ec2-9b96-4bcc-affc-ecbc7fe0d61f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:44.674222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30683ec2-9b96-4bcc-affc-ecbc7fe0d61f service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:44.682541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ba2bb-9198-44e3-872b-1e8da7a44acc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:44.685038 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2ba2bb-9198-44e3-872b-1e8da7a44acc service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:44.709816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 886/1761] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:44 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:44.735940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 876/1762] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:45.056035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ba2bb-9198-44e3-872b-1e8da7a44acc service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:45.069681 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2ba2bb-9198-44e3-872b-1e8da7a44acc service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:45.080079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc56622-eab5-4a37-b09d-f86eeb61f330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:45.080959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc56622-eab5-4a37-b09d-f86eeb61f330 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:45.082645 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc56622-eab5-4a37-b09d-f86eeb61f330 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:45.083629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc56622-eab5-4a37-b09d-f86eeb61f330 admin admin] PATH_INFO: `/v3/users/1a0e1c08e3f945cc8a37cab8ad050fdb` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:45.085917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc56622-eab5-4a37-b09d-f86eeb61f330 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a0e1c08e3f945cc8a37cab8ad050fdb)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:45.093826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc56622-eab5-4a37-b09d-f86eeb61f330 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:45.311865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4fc56622-eab5-4a37-b09d-f86eeb61f330 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a0e1c08e3f945cc8a37cab8ad050fdb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:45.350186 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4fc56622-eab5-4a37-b09d-f86eeb61f330 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a0e1c08e3f945cc8a37cab8ad050fdb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:45.397730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4fc56622-eab5-4a37-b09d-f86eeb61f330 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a0e1c08e3f945cc8a37cab8ad050fdb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:45.399941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4fc56622-eab5-4a37-b09d-f86eeb61f330 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a0e1c08e3f945cc8a37cab8ad050fdb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:45.432736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4fc56622-eab5-4a37-b09d-f86eeb61f330 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a0e1c08e3f945cc8a37cab8ad050fdb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:45.436200 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:45.456089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 887/1763] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:45 2022] DELETE /identity/v3/users/1a0e1c08e3f945cc8a37cab8ad050fdb => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:45.460567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b3be2-90ff-4ab1-8d46-b86132705524 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:45.461075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b3be2-90ff-4ab1-8d46-b86132705524 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:45.461153 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12b3be2-90ff-4ab1-8d46-b86132705524 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:45.541052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b12b3be2-90ff-4ab1-8d46-b86132705524 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:45.550189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b12b3be2-90ff-4ab1-8d46-b86132705524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:45.746993 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02449c0d-7c68-4bdb-a62c-e4c0e22820bb None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:45.747293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02449c0d-7c68-4bdb-a62c-e4c0e22820bb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:45.747570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02449c0d-7c68-4bdb-a62c-e4c0e22820bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:45.766065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 877/1764] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:45.778249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b3be2-90ff-4ab1-8d46-b86132705524 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:45.780197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b12b3be2-90ff-4ab1-8d46-b86132705524 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:45.848795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-02449c0d-7c68-4bdb-a62c-e4c0e22820bb None None] MFA Rules not processed for user `10f497bc876d4aa7b4ff9119d618b25a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:45.865755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-02449c0d-7c68-4bdb-a62c-e4c0e22820bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:45.962589 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12b3be2-90ff-4ab1-8d46-b86132705524 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:45.969266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816dc7-4453-4698-8b9a-124b62e681e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:45.970034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816dc7-4453-4698-8b9a-124b62e681e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:45.970876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816dc7-4453-4698-8b9a-124b62e681e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:45.972355 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6816dc7-4453-4698-8b9a-124b62e681e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:46.010762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6816dc7-4453-4698-8b9a-124b62e681e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:46.016664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6816dc7-4453-4698-8b9a-124b62e681e5 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:46.056744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 878/1765] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:46.173981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 888/1766] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:03:47.055762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816dc7-4453-4698-8b9a-124b62e681e5 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:47.062104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e6816dc7-4453-4698-8b9a-124b62e681e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:47.115168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6816dc7-4453-4698-8b9a-124b62e681e5 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:47.142887 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f100bd-458a-4e01-b8a1-90f61b7043c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:47.146928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f100bd-458a-4e01-b8a1-90f61b7043c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:47.148369 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f100bd-458a-4e01-b8a1-90f61b7043c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:47.149506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f100bd-458a-4e01-b8a1-90f61b7043c1 admin admin] PATH_INFO: `/v3/projects/0ff048a1cda04066920422a2bbd8ac31` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:47.154722 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f100bd-458a-4e01-b8a1-90f61b7043c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ff048a1cda04066920422a2bbd8ac31)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:47.169860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f100bd-458a-4e01-b8a1-90f61b7043c1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:47.287923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:47.328270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c0f100bd-458a-4e01-b8a1-90f61b7043c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ff048a1cda04066920422a2bbd8ac31', 'request_id': 'req-c0f100bd-458a-4e01-b8a1-90f61b7043c1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:47.348000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c0f100bd-458a-4e01-b8a1-90f61b7043c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ff048a1cda04066920422a2bbd8ac31', 'request_id': 'req-c0f100bd-458a-4e01-b8a1-90f61b7043c1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:47.370855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c0f100bd-458a-4e01-b8a1-90f61b7043c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ff048a1cda04066920422a2bbd8ac31', 'request_id': 'req-c0f100bd-458a-4e01-b8a1-90f61b7043c1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:47.390934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c0f100bd-458a-4e01-b8a1-90f61b7043c1 admin admin] The token cache is being invalidate because project 0ff048a1cda04066920422a2bbd8ac31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:03:47.393626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c0f100bd-458a-4e01-b8a1-90f61b7043c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:47.395229 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c0f100bd-458a-4e01-b8a1-90f61b7043c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:47.401589 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 879/1767] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:03:47 2022] DELETE /identity/v3/projects/0ff048a1cda04066920422a2bbd8ac31 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:47.403105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02449c0d-7c68-4bdb-a62c-e4c0e22820bb None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:47.422743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02449c0d-7c68-4bdb-a62c-e4c0e22820bb None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:47.590704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefa162-0ec6-45d0-8698-c6540c9c9cc3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:47.591598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefa162-0ec6-45d0-8698-c6540c9c9cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:47.600165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:47.602471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:47.603103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:47.603762 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] PATH_INFO: `/v3/users/4b0742ddc87c45f8990ab01a4d1b233c` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:47.606989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0742ddc87c45f8990ab01a4d1b233c)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:47.609979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:47.620997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aefa162-0ec6-45d0-8698-c6540c9c9cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:47.704063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0742ddc87c45f8990ab01a4d1b233c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:47.706164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4aefa162-0ec6-45d0-8698-c6540c9c9cc3 None None] MFA Rules not processed for user `e6aaad10422c4c1798f43ae2cdda5dc4`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:47.708149 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4aefa162-0ec6-45d0-8698-c6540c9c9cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:47.716182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0742ddc87c45f8990ab01a4d1b233c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:47.736338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0742ddc87c45f8990ab01a4d1b233c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:47.737201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0742ddc87c45f8990ab01a4d1b233c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:47.752984 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0742ddc87c45f8990ab01a4d1b233c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:47.771025 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 889/1768] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:47 2022] DELETE /identity/v3/users/4b0742ddc87c45f8990ab01a4d1b233c => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:03:47.772086 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:47.775527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:47.867543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:48.028112 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1b8bb-6047-40ac-a5ed-810c983d6637 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:48.051937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1d0a7-eec4-44a2-b791-86dd8e94b32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:48.055745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1d0a7-eec4-44a2-b791-86dd8e94b32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:48.056043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1d0a7-eec4-44a2-b791-86dd8e94b32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:48.062056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1d0a7-eec4-44a2-b791-86dd8e94b32f admin admin] PATH_INFO: `/v3/users/6ae73353efa1463bae133d4f39b829c3` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:48.077554 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1d0a7-eec4-44a2-b791-86dd8e94b32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae73353efa1463bae133d4f39b829c3)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:48.077983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 880/1769] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 485 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:03:48.079736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1d0a7-eec4-44a2-b791-86dd8e94b32f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:48.084766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefa162-0ec6-45d0-8698-c6540c9c9cc3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:48.111907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4aefa162-0ec6-45d0-8698-c6540c9c9cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:48.171898 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aefa162-0ec6-45d0-8698-c6540c9c9cc3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:48.188125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dd320-bc82-4c4b-8426-a1320dc8b2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:48.188773 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dd320-bc82-4c4b-8426-a1320dc8b2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:48.189210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dd320-bc82-4c4b-8426-a1320dc8b2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:48.189653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8dd320-bc82-4c4b-8426-a1320dc8b2d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:48.192137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dd320-bc82-4c4b-8426-a1320dc8b2d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:48.194296 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8dd320-bc82-4c4b-8426-a1320dc8b2d7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:48.243331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-23a1d0a7-eec4-44a2-b791-86dd8e94b32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae73353efa1463bae133d4f39b829c3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:48.263002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 881/1770] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:48 2022] POST /identity/v3/projects => generated 403 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:48.268342 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-23a1d0a7-eec4-44a2-b791-86dd8e94b32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae73353efa1463bae133d4f39b829c3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:48.269333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dd320-bc82-4c4b-8426-a1320dc8b2d7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:48.317234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-23a1d0a7-eec4-44a2-b791-86dd8e94b32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae73353efa1463bae133d4f39b829c3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:48.319066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-23a1d0a7-eec4-44a2-b791-86dd8e94b32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae73353efa1463bae133d4f39b829c3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:48.359827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-23a1d0a7-eec4-44a2-b791-86dd8e94b32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae73353efa1463bae133d4f39b829c3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:48.385031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 890/1771] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:47 2022] DELETE /identity/v3/users/6ae73353efa1463bae133d4f39b829c3 => generated 0 bytes in 613 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:48.391896 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eda7ef-48f0-417f-b909-8f336acd7d6a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:48.392195 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eda7ef-48f0-417f-b909-8f336acd7d6a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:48.394273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03eda7ef-48f0-417f-b909-8f336acd7d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:48.451190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-03eda7ef-48f0-417f-b909-8f336acd7d6a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:48.455064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-03eda7ef-48f0-417f-b909-8f336acd7d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:48.514555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8dd320-bc82-4c4b-8426-a1320dc8b2d7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:48.570908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:48.641585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72aea4-e2b2-451e-8ffd-d7fed5496e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:48.642299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72aea4-e2b2-451e-8ffd-d7fed5496e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:48.642730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72aea4-e2b2-451e-8ffd-d7fed5496e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:48.642999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72aea4-e2b2-451e-8ffd-d7fed5496e56 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:48.643766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72aea4-e2b2-451e-8ffd-d7fed5496e56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:48.646144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa72aea4-e2b2-451e-8ffd-d7fed5496e56 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:48.672118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 891/1772] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:48.682743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eda7ef-48f0-417f-b909-8f336acd7d6a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:48.684999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-03eda7ef-48f0-417f-b909-8f336acd7d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:48.718361 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 882/1773] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:48 2022] POST /identity/v3/users => generated 308 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:48.719547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72aea4-e2b2-451e-8ffd-d7fed5496e56 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:48.722925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fa72aea4-e2b2-451e-8ffd-d7fed5496e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:48.739695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72aea4-e2b2-451e-8ffd-d7fed5496e56 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:48.744843 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcf9de-d7e0-4008-85fa-0562a6d01b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:48.745503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcf9de-d7e0-4008-85fa-0562a6d01b71 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:48.745796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcf9de-d7e0-4008-85fa-0562a6d01b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:48.746179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adcf9de-d7e0-4008-85fa-0562a6d01b71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:48.747432 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcf9de-d7e0-4008-85fa-0562a6d01b71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:48.749111 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adcf9de-d7e0-4008-85fa-0562a6d01b71 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:48.766150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 883/1774] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:48.767754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcf9de-d7e0-4008-85fa-0562a6d01b71 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:48.780852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adcf9de-d7e0-4008-85fa-0562a6d01b71 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:48.798618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:48.800532 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692ddb2-78d4-4a96-8912-f7f1c2134459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:48.802526 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692ddb2-78d4-4a96-8912-f7f1c2134459 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:48.802923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692ddb2-78d4-4a96-8912-f7f1c2134459 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:48.803815 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f692ddb2-78d4-4a96-8912-f7f1c2134459 admin admin] PATH_INFO: `/v3/projects/6cd0d29996d0472aa9879dc9b50e33c0/users/cf460825da1a4be194c6b4a15d1d1b3f/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:48.832233 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03eda7ef-48f0-417f-b909-8f336acd7d6a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:48.836230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd12341-298c-4695-89b4-561b7e258f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:48.837028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd12341-298c-4695-89b4-561b7e258f90 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:48.837325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd12341-298c-4695-89b4-561b7e258f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:48.837763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd12341-298c-4695-89b4-561b7e258f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:48.838832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692ddb2-78d4-4a96-8912-f7f1c2134459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd0d29996d0472aa9879dc9b50e33c0, user_id=cf460825da1a4be194c6b4a15d1d1b3f, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:48.844724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f692ddb2-78d4-4a96-8912-f7f1c2134459 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:48.848663 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd12341-298c-4695-89b4-561b7e258f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:48.850153 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd12341-298c-4695-89b4-561b7e258f90 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:48.862147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 892/1775] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:03:48.867132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 884/1776] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:48 2022] PUT /identity/v3/projects/6cd0d29996d0472aa9879dc9b50e33c0/users/cf460825da1a4be194c6b4a15d1d1b3f/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:48.871293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd12341-298c-4695-89b4-561b7e258f90 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:48.883843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd12341-298c-4695-89b4-561b7e258f90 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:48.953050 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39a9e-276e-40ed-89bf-b69a979ff7de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:48.953732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39a9e-276e-40ed-89bf-b69a979ff7de admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:48.954106 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39a9e-276e-40ed-89bf-b69a979ff7de admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:48.954380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39a9e-276e-40ed-89bf-b69a979ff7de admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:48.955129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee39a9e-276e-40ed-89bf-b69a979ff7de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:48.956865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee39a9e-276e-40ed-89bf-b69a979ff7de admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:48.974190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 893/1777] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:48 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:48.976606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692ddb2-78d4-4a96-8912-f7f1c2134459 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:49.002961 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f692ddb2-78d4-4a96-8912-f7f1c2134459 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:49.009585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfa4e6-05f5-4e6e-8080-8fa1a56eaeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:49.010556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfa4e6-05f5-4e6e-8080-8fa1a56eaeca admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:49.011147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfa4e6-05f5-4e6e-8080-8fa1a56eaeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:49.011776 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dfa4e6-05f5-4e6e-8080-8fa1a56eaeca admin admin] PATH_INFO: `/v3/projects/6cd0d29996d0472aa9879dc9b50e33c0/users/cf460825da1a4be194c6b4a15d1d1b3f/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:49.015563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfa4e6-05f5-4e6e-8080-8fa1a56eaeca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cd0d29996d0472aa9879dc9b50e33c0, user_id=cf460825da1a4be194c6b4a15d1d1b3f, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:49.031176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dfa4e6-05f5-4e6e-8080-8fa1a56eaeca admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:49.062535 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 885/1778] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:48 2022] PUT /identity/v3/projects/6cd0d29996d0472aa9879dc9b50e33c0/users/cf460825da1a4be194c6b4a15d1d1b3f/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:49.086959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39a9e-276e-40ed-89bf-b69a979ff7de admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:49.088928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0ee39a9e-276e-40ed-89bf-b69a979ff7de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:49.104315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39a9e-276e-40ed-89bf-b69a979ff7de admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:49.299083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:49.299818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:49.300107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:49.300389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3 admin admin] PATH_INFO: `/v3/projects/3e0cd24c8bb24851a15ca069155446b2` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:49.307156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0cd24c8bb24851a15ca069155446b2)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:49.309562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:49.395792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0cd24c8bb24851a15ca069155446b2', 'request_id': 'req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:49.403279 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0cd24c8bb24851a15ca069155446b2', 'request_id': 'req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:49.413616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0cd24c8bb24851a15ca069155446b2', 'request_id': 'req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:49.434883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3 admin admin] The token cache is being invalidate because project 3e0cd24c8bb24851a15ca069155446b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:03:49.440762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfa4e6-05f5-4e6e-8080-8fa1a56eaeca admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:49.441870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:49.443430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9b68fc28-c5a9-4e76-80d1-7c88e0b278b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:49.445227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c1dfa4e6-05f5-4e6e-8080-8fa1a56eaeca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:49.445715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 894/1779] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:03:49 2022] DELETE /identity/v3/projects/3e0cd24c8bb24851a15ca069155446b2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:03:49.452495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240433ac-ba97-4634-b49a-5f0285de0e94 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:49.453690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240433ac-ba97-4634-b49a-5f0285de0e94 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:49.454189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240433ac-ba97-4634-b49a-5f0285de0e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:49.482276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dfa4e6-05f5-4e6e-8080-8fa1a56eaeca admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:49.508760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-240433ac-ba97-4634-b49a-5f0285de0e94 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:49.510361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-240433ac-ba97-4634-b49a-5f0285de0e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:49.540823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:49.652631 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04f135b-ba4c-45c4-8eae-22a78b1094dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:49.652631 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f135b-ba4c-45c4-8eae-22a78b1094dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:49.652631 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f135b-ba4c-45c4-8eae-22a78b1094dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:49.652631 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04f135b-ba4c-45c4-8eae-22a78b1094dc admin admin] PATH_INFO: `/v3/projects/4ae5e89c0c524ce68ffbd804fbf297ae` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:49.653413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f135b-ba4c-45c4-8eae-22a78b1094dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ae5e89c0c524ce68ffbd804fbf297ae)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:49.660024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04f135b-ba4c-45c4-8eae-22a78b1094dc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:49.802380 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c04f135b-ba4c-45c4-8eae-22a78b1094dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ae5e89c0c524ce68ffbd804fbf297ae', 'request_id': 'req-c04f135b-ba4c-45c4-8eae-22a78b1094dc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:49.814096 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 895/1780] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:49.822215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513d37d-e008-4e99-9614-2921f24f0857 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:49.822215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513d37d-e008-4e99-9614-2921f24f0857 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:49.822215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d513d37d-e008-4e99-9614-2921f24f0857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:49.822574 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c04f135b-ba4c-45c4-8eae-22a78b1094dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ae5e89c0c524ce68ffbd804fbf297ae', 'request_id': 'req-c04f135b-ba4c-45c4-8eae-22a78b1094dc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:49.852062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c04f135b-ba4c-45c4-8eae-22a78b1094dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ae5e89c0c524ce68ffbd804fbf297ae', 'request_id': 'req-c04f135b-ba4c-45c4-8eae-22a78b1094dc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:49.876027 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:49.904769 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c04f135b-ba4c-45c4-8eae-22a78b1094dc admin admin] The token cache is being invalidate because project 4ae5e89c0c524ce68ffbd804fbf297ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:03:49.904769 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c04f135b-ba4c-45c4-8eae-22a78b1094dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:49.904769 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c04f135b-ba4c-45c4-8eae-22a78b1094dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:49.904769 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 886/1781] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:03:49 2022] DELETE /identity/v3/projects/4ae5e89c0c524ce68ffbd804fbf297ae => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:49.905784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19bca2-a0b5-4bb1-903d-70b18f9dfd1b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:49.906101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19bca2-a0b5-4bb1-903d-70b18f9dfd1b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:49.906700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea19bca2-a0b5-4bb1-903d-70b18f9dfd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:49.971455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ea19bca2-a0b5-4bb1-903d-70b18f9dfd1b None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:49.972620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d513d37d-e008-4e99-9614-2921f24f0857 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:49.973213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ea19bca2-a0b5-4bb1-903d-70b18f9dfd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:49.979498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d513d37d-e008-4e99-9614-2921f24f0857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:50.090449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 887/1782] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:50.091000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19bca2-a0b5-4bb1-903d-70b18f9dfd1b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:50.094164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ea19bca2-a0b5-4bb1-903d-70b18f9dfd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:50.110030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea19bca2-a0b5-4bb1-903d-70b18f9dfd1b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:50.133074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 896/1783] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:03:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:50.134158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513d37d-e008-4e99-9614-2921f24f0857 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:50.137227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:50.138156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:50.138644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:50.139059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] PATH_INFO: `/v3/users/a33ec004501c4c8d9e873c93e105347a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:50.141145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a33ec004501c4c8d9e873c93e105347a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:50.150318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:50.174999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d513d37d-e008-4e99-9614-2921f24f0857 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:50.186239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb977a-d995-431b-b883-896231430050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:50.188302 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb977a-d995-431b-b883-896231430050 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:50.189852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb977a-d995-431b-b883-896231430050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:50.190150 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb977a-d995-431b-b883-896231430050 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:50.192304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb977a-d995-431b-b883-896231430050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:50.192761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb977a-d995-431b-b883-896231430050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:50.206989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb977a-d995-431b-b883-896231430050 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:50.243093 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a33ec004501c4c8d9e873c93e105347a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:50.244433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a33ec004501c4c8d9e873c93e105347a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:50.282314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 897/1784] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:50.297438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb977a-d995-431b-b883-896231430050 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:50.301707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a33ec004501c4c8d9e873c93e105347a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:50.327953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a33ec004501c4c8d9e873c93e105347a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:50.359112 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a33ec004501c4c8d9e873c93e105347a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:50.363512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb977a-d995-431b-b883-896231430050 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:50.382566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 888/1785] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:50 2022] DELETE /identity/v3/users/a33ec004501c4c8d9e873c93e105347a => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:50.390555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20f1ca-c729-4b0a-854e-0b86ac9da859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:50.391200 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20f1ca-c729-4b0a-854e-0b86ac9da859 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:50.391483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20f1ca-c729-4b0a-854e-0b86ac9da859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:50.391761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd20f1ca-c729-4b0a-854e-0b86ac9da859 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:50.406098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20f1ca-c729-4b0a-854e-0b86ac9da859 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:50.412415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd20f1ca-c729-4b0a-854e-0b86ac9da859 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:50.454833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 898/1786] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:50 2022] POST /identity/v3/projects => generated 379 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:50.458926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:50.461527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:50.473693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20f1ca-c729-4b0a-854e-0b86ac9da859 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:50.476104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cd20f1ca-c729-4b0a-854e-0b86ac9da859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:50.681831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36f75e-6cc3-4e7d-8593-ca94c24f636a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:50.685139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:50.755073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:50.808284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd20f1ca-c729-4b0a-854e-0b86ac9da859 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:50.827431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda5bf-aa5c-4417-ad2d-05150274607f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:50.827431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda5bf-aa5c-4417-ad2d-05150274607f service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:50.827431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda5bf-aa5c-4417-ad2d-05150274607f service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:50.831254 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cda5bf-aa5c-4417-ad2d-05150274607f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:50.836609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e5cda5bf-aa5c-4417-ad2d-05150274607f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:50.863671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4118e8-fcc8-4dd3-94f0-3da210f2b3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:50.866334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4118e8-fcc8-4dd3-94f0-3da210f2b3e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:50.866622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4118e8-fcc8-4dd3-94f0-3da210f2b3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:50.866903 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4118e8-fcc8-4dd3-94f0-3da210f2b3e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:50.883189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4118e8-fcc8-4dd3-94f0-3da210f2b3e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:50.883189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4118e8-fcc8-4dd3-94f0-3da210f2b3e8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:50.952337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 889/1787] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:50 2022] POST /identity/v3/users => generated 290 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:50.957830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4118e8-fcc8-4dd3-94f0-3da210f2b3e8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:50.984655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cda5bf-aa5c-4417-ad2d-05150274607f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:50.986153 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4118e8-fcc8-4dd3-94f0-3da210f2b3e8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:50.988468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cda5bf-aa5c-4417-ad2d-05150274607f service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:50.992639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a16af-e277-497a-9691-085176b7a659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:50.993491 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a16af-e277-497a-9691-085176b7a659 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:50.993770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a16af-e277-497a-9691-085176b7a659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:50.994082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36a16af-e277-497a-9691-085176b7a659 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:50.994959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a16af-e277-497a-9691-085176b7a659 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:50.999301 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36a16af-e277-497a-9691-085176b7a659 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:51.015146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 899/1788] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:03:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:03:51.018479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 890/1789] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:03:51.018596 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda5bf-aa5c-4417-ad2d-05150274607f service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:51.044067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cda5bf-aa5c-4417-ad2d-05150274607f service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:51.058061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d391e68f-5084-4d26-ad12-3665407997fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:51.061717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e68f-5084-4d26-ad12-3665407997fe admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:51.061987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e68f-5084-4d26-ad12-3665407997fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:51.062267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d391e68f-5084-4d26-ad12-3665407997fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:51.064257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391e68f-5084-4d26-ad12-3665407997fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:51.070428 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d391e68f-5084-4d26-ad12-3665407997fe admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:51.099800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 900/1790] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:51.100796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a16af-e277-497a-9691-085176b7a659 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:51.115213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36a16af-e277-497a-9691-085176b7a659 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:51.144397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2ea57-13d5-4f47-9bb0-1390cede7f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:51.145091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2ea57-13d5-4f47-9bb0-1390cede7f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:51.150918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2ea57-13d5-4f47-9bb0-1390cede7f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:51.151103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db2ea57-13d5-4f47-9bb0-1390cede7f30 admin admin] PATH_INFO: `/v3/projects/3b97a37fee6f4a9aacd5c62df7bf5af8/users/70d96f5233e64a7e9a2e26e423adcc0c/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:51.219612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2ea57-13d5-4f47-9bb0-1390cede7f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b97a37fee6f4a9aacd5c62df7bf5af8, user_id=70d96f5233e64a7e9a2e26e423adcc0c, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:51.233760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db2ea57-13d5-4f47-9bb0-1390cede7f30 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:51.266778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 891/1791] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:51 2022] PUT /identity/v3/projects/3b97a37fee6f4a9aacd5c62df7bf5af8/users/70d96f5233e64a7e9a2e26e423adcc0c/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:51.277832 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20d0d3-c34e-4aed-8091-4b491efe368c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:51.278100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20d0d3-c34e-4aed-8091-4b491efe368c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:51.278387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20d0d3-c34e-4aed-8091-4b491efe368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:51.379711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2b20d0d3-c34e-4aed-8091-4b491efe368c None None] MFA Rules not processed for user `70d96f5233e64a7e9a2e26e423adcc0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:51.380987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2b20d0d3-c34e-4aed-8091-4b491efe368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:51.523167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 901/1792] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:03:51.528542 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2ea57-13d5-4f47-9bb0-1390cede7f30 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:51.707419 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db2ea57-13d5-4f47-9bb0-1390cede7f30 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:51.723016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81484cb-6eb6-4a0c-a313-39f7a5e6d07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:51.724956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81484cb-6eb6-4a0c-a313-39f7a5e6d07e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:51.725164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81484cb-6eb6-4a0c-a313-39f7a5e6d07e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:51.725424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81484cb-6eb6-4a0c-a313-39f7a5e6d07e admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:51.728474 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81484cb-6eb6-4a0c-a313-39f7a5e6d07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:51.732721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81484cb-6eb6-4a0c-a313-39f7a5e6d07e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:51.785006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 892/1793] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:51 2022] POST /identity/v3/projects => generated 377 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:51.787092 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20d0d3-c34e-4aed-8091-4b491efe368c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:51.813705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b20d0d3-c34e-4aed-8091-4b491efe368c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:51.901707 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:51.928267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f7df7-4169-4d9d-9df7-0035bdeae2b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:51.931131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f7df7-4169-4d9d-9df7-0035bdeae2b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:51.931426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f7df7-4169-4d9d-9df7-0035bdeae2b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:51.931751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f7df7-4169-4d9d-9df7-0035bdeae2b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:51.934313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f7df7-4169-4d9d-9df7-0035bdeae2b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:51.957622 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f7df7-4169-4d9d-9df7-0035bdeae2b7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:52.050260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 902/1794] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:51 2022] POST /identity/v3/users => generated 289 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:03:52.054752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81484cb-6eb6-4a0c-a313-39f7a5e6d07e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:52.075419 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81484cb-6eb6-4a0c-a313-39f7a5e6d07e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:52.116619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ac8d4-6c90-4b3d-81b7-d5ce5c748918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:52.118583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ac8d4-6c90-4b3d-81b7-d5ce5c748918 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:52.119153 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ac8d4-6c90-4b3d-81b7-d5ce5c748918 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:52.119586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1ac8d4-6c90-4b3d-81b7-d5ce5c748918 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:52.123825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ac8d4-6c90-4b3d-81b7-d5ce5c748918 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:52.133517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1ac8d4-6c90-4b3d-81b7-d5ce5c748918 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:52.161778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 893/1795] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:52.164019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f7df7-4169-4d9d-9df7-0035bdeae2b7 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:52.178311 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f7df7-4169-4d9d-9df7-0035bdeae2b7 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:52.190117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd696ee-fb64-4c9f-b9f5-cc3680a6300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:52.191031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd696ee-fb64-4c9f-b9f5-cc3680a6300e admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:52.191748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd696ee-fb64-4c9f-b9f5-cc3680a6300e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:52.191748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd696ee-fb64-4c9f-b9f5-cc3680a6300e admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:52.192593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd696ee-fb64-4c9f-b9f5-cc3680a6300e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:52.194610 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd696ee-fb64-4c9f-b9f5-cc3680a6300e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:52.226037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 903/1796] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:52.227579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ac8d4-6c90-4b3d-81b7-d5ce5c748918 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:52.250155 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1ac8d4-6c90-4b3d-81b7-d5ce5c748918 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:52.266465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71e03b-f9c2-400c-b35a-73b7f8cd36d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:52.271787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71e03b-f9c2-400c-b35a-73b7f8cd36d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:52.271787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71e03b-f9c2-400c-b35a-73b7f8cd36d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:52.271787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71e03b-f9c2-400c-b35a-73b7f8cd36d6 admin admin] PATH_INFO: `/v3/projects/a72a7961136d4e63ae2fc979b3edd9c1/users/ed3f1431ae6c4d21857106bb6f0b39eb/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:52.321721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71e03b-f9c2-400c-b35a-73b7f8cd36d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a72a7961136d4e63ae2fc979b3edd9c1, user_id=ed3f1431ae6c4d21857106bb6f0b39eb, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:52.331331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71e03b-f9c2-400c-b35a-73b7f8cd36d6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:52.367455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 894/1797] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:52 2022] PUT /identity/v3/projects/a72a7961136d4e63ae2fc979b3edd9c1/users/ed3f1431ae6c4d21857106bb6f0b39eb/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:52.384981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca216c-1943-4c58-a014-f770d7e999f2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:52.385403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca216c-1943-4c58-a014-f770d7e999f2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:52.385687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca216c-1943-4c58-a014-f770d7e999f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:52.469156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b1ca216c-1943-4c58-a014-f770d7e999f2 None None] MFA Rules not processed for user `ed3f1431ae6c4d21857106bb6f0b39eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:52.474412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b1ca216c-1943-4c58-a014-f770d7e999f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:52.621327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 904/1798] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:52 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:52.627198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71e03b-f9c2-400c-b35a-73b7f8cd36d6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:52.698401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:52.754457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71e03b-f9c2-400c-b35a-73b7f8cd36d6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:52.760876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c1651-487e-414b-b347-adb9993ae788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:52.762346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1651-487e-414b-b347-adb9993ae788 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:52.763750 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1651-487e-414b-b347-adb9993ae788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:52.764420 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c1651-487e-414b-b347-adb9993ae788 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:52.765697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c1651-487e-414b-b347-adb9993ae788 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:52.768651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c1651-487e-414b-b347-adb9993ae788 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:52.864425 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 895/1799] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:52 2022] POST /identity/v3/projects => generated 377 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:52.868882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca216c-1943-4c58-a014-f770d7e999f2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:52.893093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca216c-1943-4c58-a014-f770d7e999f2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:53.041715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042ea40-a8c6-43f8-b5ac-80fb1f380539 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:53.042263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042ea40-a8c6-43f8-b5ac-80fb1f380539 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:53.042616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2042ea40-a8c6-43f8-b5ac-80fb1f380539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:53.111901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2042ea40-a8c6-43f8-b5ac-80fb1f380539 None None] MFA Rules not processed for user `a2afb18a441549e3b853966ea1ad286e`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:53.113570 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2042ea40-a8c6-43f8-b5ac-80fb1f380539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:53.122424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b59e6-0489-4b0f-9d44-73efe71932f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:53.123342 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b59e6-0489-4b0f-9d44-73efe71932f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:53.124800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b59e6-0489-4b0f-9d44-73efe71932f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:53.125256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b59e6-0489-4b0f-9d44-73efe71932f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:53.128980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b59e6-0489-4b0f-9d44-73efe71932f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:53.131669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50b59e6-0489-4b0f-9d44-73efe71932f8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:53.187624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 905/1800] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:52 2022] POST /identity/v3/users => generated 295 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:53.191837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b59e6-0489-4b0f-9d44-73efe71932f8 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:53.232648 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50b59e6-0489-4b0f-9d44-73efe71932f8 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:53.252326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c549ef-c9be-4919-aa3e-ada97a007df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:53.252971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c549ef-c9be-4919-aa3e-ada97a007df9 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:53.253246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c549ef-c9be-4919-aa3e-ada97a007df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:53.253539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c549ef-c9be-4919-aa3e-ada97a007df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:53.254980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c549ef-c9be-4919-aa3e-ada97a007df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:53.261415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c549ef-c9be-4919-aa3e-ada97a007df9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:53.283339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 906/1801] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:03:53.290509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 896/1802] 10.222.0.36 () {58 vars in 1015 bytes} [Mon Aug 1 12:03:53 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:53.290509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042ea40-a8c6-43f8-b5ac-80fb1f380539 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:53.330347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2042ea40-a8c6-43f8-b5ac-80fb1f380539 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:53.342843 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110365e-ec7f-4ab4-8b97-bdbc07620582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:53.345519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110365e-ec7f-4ab4-8b97-bdbc07620582 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:53.346744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110365e-ec7f-4ab4-8b97-bdbc07620582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:53.351527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3110365e-ec7f-4ab4-8b97-bdbc07620582 admin admin] PATH_INFO: `/v3/projects/9ddcd66f0c494d1c990009f55866b4a5/users/d1ba61446ecf470c9fd9d5207a1eca60/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:53.364327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c549ef-c9be-4919-aa3e-ada97a007df9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:53.366323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f8c549ef-c9be-4919-aa3e-ada97a007df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:53.395353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c549ef-c9be-4919-aa3e-ada97a007df9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:53.397781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110365e-ec7f-4ab4-8b97-bdbc07620582 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ddcd66f0c494d1c990009f55866b4a5, user_id=d1ba61446ecf470c9fd9d5207a1eca60, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:53.401604 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3110365e-ec7f-4ab4-8b97-bdbc07620582 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:53.416561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cfa29-659e-4f40-829d-14862857cfed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:53.418598 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cfa29-659e-4f40-829d-14862857cfed service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:53.418873 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cfa29-659e-4f40-829d-14862857cfed service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:53.421567 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19cfa29-659e-4f40-829d-14862857cfed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:53.451622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 897/1803] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:53 2022] PUT /identity/v3/projects/9ddcd66f0c494d1c990009f55866b4a5/users/d1ba61446ecf470c9fd9d5207a1eca60/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:53.458001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cfa29-659e-4f40-829d-14862857cfed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:53.459638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110365e-ec7f-4ab4-8b97-bdbc07620582 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:53.461468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19cfa29-659e-4f40-829d-14862857cfed service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:53.496721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 907/1804] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:53 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:53.690411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3110365e-ec7f-4ab4-8b97-bdbc07620582 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:53.741903 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b9fd33-78f4-4572-b691-caed91160351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:53.742552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9fd33-78f4-4572-b691-caed91160351 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:53.742892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9fd33-78f4-4572-b691-caed91160351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:53.743095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9fd33-78f4-4572-b691-caed91160351 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:53.743805 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9fd33-78f4-4572-b691-caed91160351 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:53.745693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b9fd33-78f4-4572-b691-caed91160351 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:53.785460 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 898/1805] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:53 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:53.786988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cfa29-659e-4f40-829d-14862857cfed service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:53.806262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19cfa29-659e-4f40-829d-14862857cfed service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:53.821534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fee422-1b16-4559-a36d-13cbbfb64a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:53.822399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fee422-1b16-4559-a36d-13cbbfb64a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:53.822798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fee422-1b16-4559-a36d-13cbbfb64a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:53.823210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fee422-1b16-4559-a36d-13cbbfb64a8e admin admin] PATH_INFO: `/v3/projects/9ddcd66f0c494d1c990009f55866b4a5/users/d1ba61446ecf470c9fd9d5207a1eca60/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:53.827766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fee422-1b16-4559-a36d-13cbbfb64a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ddcd66f0c494d1c990009f55866b4a5, user_id=d1ba61446ecf470c9fd9d5207a1eca60, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:53.832569 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fee422-1b16-4559-a36d-13cbbfb64a8e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:53.869405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 908/1806] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:53 2022] PUT /identity/v3/projects/9ddcd66f0c494d1c990009f55866b4a5/users/d1ba61446ecf470c9fd9d5207a1eca60/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:53.884616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c79053-22eb-4f8d-b7e6-4fe6ebff8a3b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:53.884867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c79053-22eb-4f8d-b7e6-4fe6ebff8a3b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:53.885262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c79053-22eb-4f8d-b7e6-4fe6ebff8a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:53.953730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-78c79053-22eb-4f8d-b7e6-4fe6ebff8a3b None None] MFA Rules not processed for user `d1ba61446ecf470c9fd9d5207a1eca60`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:53.956984 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-78c79053-22eb-4f8d-b7e6-4fe6ebff8a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:54.003200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:54.084958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 899/1807] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:54.098589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fee422-1b16-4559-a36d-13cbbfb64a8e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:54.100708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-61fee422-1b16-4559-a36d-13cbbfb64a8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:54.125171 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:54.202361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fee422-1b16-4559-a36d-13cbbfb64a8e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:54.206999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc3c3-3bff-42a7-80df-c95646a4ff07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:54.207846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc3c3-3bff-42a7-80df-c95646a4ff07 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:54.208245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc3c3-3bff-42a7-80df-c95646a4ff07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:54.208630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99afc3c3-3bff-42a7-80df-c95646a4ff07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:54.224117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afc3c3-3bff-42a7-80df-c95646a4ff07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:54.236302 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99afc3c3-3bff-42a7-80df-c95646a4ff07 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:54.264752 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 909/1808] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:54 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:54.333033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c79053-22eb-4f8d-b7e6-4fe6ebff8a3b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:54.341078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc3c3-3bff-42a7-80df-c95646a4ff07 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:54.343084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-99afc3c3-3bff-42a7-80df-c95646a4ff07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:54.349693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-78c79053-22eb-4f8d-b7e6-4fe6ebff8a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:54.364852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99afc3c3-3bff-42a7-80df-c95646a4ff07 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:54.385394 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d8439-66d5-4c9c-84d5-083e3902458e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:54.386048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8439-66d5-4c9c-84d5-083e3902458e service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:54.386222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8439-66d5-4c9c-84d5-083e3902458e service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:54.386625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d8439-66d5-4c9c-84d5-083e3902458e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:54.553283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c79053-22eb-4f8d-b7e6-4fe6ebff8a3b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:54.565843 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:54.566580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:54.566730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:54.567007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f admin admin] PATH_INFO: `/v3/projects/cf6faa143b464033b431d1ce6ab3b91b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:54.588463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf6faa143b464033b431d1ce6ab3b91b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:54.588463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:54.589014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d8439-66d5-4c9c-84d5-083e3902458e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:54.589014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d8439-66d5-4c9c-84d5-083e3902458e service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:54.647779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 910/1809] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:54 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:03:54.649224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397994-ea79-4ffb-bc76-00e818d24433 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:54.649538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397994-ea79-4ffb-bc76-00e818d24433 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:54.649825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9397994-ea79-4ffb-bc76-00e818d24433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:54.748732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d9397994-ea79-4ffb-bc76-00e818d24433 None None] MFA Rules not processed for user `cf460825da1a4be194c6b4a15d1d1b3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:54.752854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d9397994-ea79-4ffb-bc76-00e818d24433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:54.757381 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf6faa143b464033b431d1ce6ab3b91b', 'request_id': 'req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:54.781742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf6faa143b464033b431d1ce6ab3b91b', 'request_id': 'req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:54.814336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf6faa143b464033b431d1ce6ab3b91b', 'request_id': 'req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:54.872839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f admin admin] The token cache is being invalidate because project cf6faa143b464033b431d1ce6ab3b91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:03:54.872839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:54.874584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a01a9e7-dde8-42c4-b9f2-53e190253e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:54.892711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 900/1810] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:03:54 2022] DELETE /identity/v3/projects/cf6faa143b464033b431d1ce6ab3b91b => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:54.897736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67678273-ab19-47e6-ac8c-22e6ddfba88a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:54.898301 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67678273-ab19-47e6-ac8c-22e6ddfba88a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:54.898774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67678273-ab19-47e6-ac8c-22e6ddfba88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:54.956017 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-67678273-ab19-47e6-ac8c-22e6ddfba88a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:54.961166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-67678273-ab19-47e6-ac8c-22e6ddfba88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:55.004131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 911/1811] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:54 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:55.112346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:55.162074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 901/1812] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:55.170492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33f7e2-5752-4bd6-842a-2f159e09f561 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:55.170937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33f7e2-5752-4bd6-842a-2f159e09f561 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:55.171316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db33f7e2-5752-4bd6-842a-2f159e09f561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:55.207238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-db33f7e2-5752-4bd6-842a-2f159e09f561 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:55.210840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-db33f7e2-5752-4bd6-842a-2f159e09f561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:55.228452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 912/1813] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:55.232806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67678273-ab19-47e6-ac8c-22e6ddfba88a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:55.248340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67678273-ab19-47e6-ac8c-22e6ddfba88a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:55.258330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ad8f7-9fba-44bb-a9e7-8f5bb5cb357f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:55.259148 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ad8f7-9fba-44bb-a9e7-8f5bb5cb357f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:55.260444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ad8f7-9fba-44bb-a9e7-8f5bb5cb357f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:55.260820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07ad8f7-9fba-44bb-a9e7-8f5bb5cb357f admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:55.262739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ad8f7-9fba-44bb-a9e7-8f5bb5cb357f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:03:55.264162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ad8f7-9fba-44bb-a9e7-8f5bb5cb357f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:55.267810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07ad8f7-9fba-44bb-a9e7-8f5bb5cb357f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:55.296317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 902/1814] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:03:55.301280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33f7e2-5752-4bd6-842a-2f159e09f561 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:55.313245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db33f7e2-5752-4bd6-842a-2f159e09f561 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:55.325678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ac82-a202-4b3e-b7b8-80154408b449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:55.328854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ac82-a202-4b3e-b7b8-80154408b449 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:55.329698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ac82-a202-4b3e-b7b8-80154408b449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:55.331847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc7ac82-a202-4b3e-b7b8-80154408b449 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:55.333980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7ac82-a202-4b3e-b7b8-80154408b449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:55.340972 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc7ac82-a202-4b3e-b7b8-80154408b449 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:55.429623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 913/1815] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:55 2022] POST /identity/v3/projects => generated 387 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:55.438841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ad8f7-9fba-44bb-a9e7-8f5bb5cb357f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:55.466799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07ad8f7-9fba-44bb-a9e7-8f5bb5cb357f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:55.705252 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66ad3d-9729-493f-acc5-b2d4c7986592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:55.707814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66ad3d-9729-493f-acc5-b2d4c7986592 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:55.709558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66ad3d-9729-493f-acc5-b2d4c7986592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:55.711274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b66ad3d-9729-493f-acc5-b2d4c7986592 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:55.712372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66ad3d-9729-493f-acc5-b2d4c7986592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:55.716556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b66ad3d-9729-493f-acc5-b2d4c7986592 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:55.805142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 903/1816] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:55 2022] POST /identity/v3/users => generated 294 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:03:55.808396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ac82-a202-4b3e-b7b8-80154408b449 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:55.838829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc7ac82-a202-4b3e-b7b8-80154408b449 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:55.846874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8db883-bea4-44f0-aaed-d1352aee6d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:55.848183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8db883-bea4-44f0-aaed-d1352aee6d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:55.848676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8db883-bea4-44f0-aaed-d1352aee6d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:55.849179 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8db883-bea4-44f0-aaed-d1352aee6d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:55.850460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8db883-bea4-44f0-aaed-d1352aee6d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:55.853723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8db883-bea4-44f0-aaed-d1352aee6d9b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:55.855938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:55.877103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 914/1817] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:55.878988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66ad3d-9729-493f-acc5-b2d4c7986592 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:55.897922 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b66ad3d-9729-493f-acc5-b2d4c7986592 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:55.906220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f0b6b7-9bcc-4f86-bffa-337245be091b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:55.907508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0b6b7-9bcc-4f86-bffa-337245be091b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:55.907800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0b6b7-9bcc-4f86-bffa-337245be091b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:55.908859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f0b6b7-9bcc-4f86-bffa-337245be091b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:55.909674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0b6b7-9bcc-4f86-bffa-337245be091b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:55.913352 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f0b6b7-9bcc-4f86-bffa-337245be091b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:55.934775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 904/1818] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:55 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:03:55.936310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8db883-bea4-44f0-aaed-d1352aee6d9b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:55.955757 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8db883-bea4-44f0-aaed-d1352aee6d9b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:55.963937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34367a-154d-475b-a4a1-1cd4efb642e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:55.965882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34367a-154d-475b-a4a1-1cd4efb642e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:55.966149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34367a-154d-475b-a4a1-1cd4efb642e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:55.966479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34367a-154d-475b-a4a1-1cd4efb642e7 admin admin] PATH_INFO: `/v3/projects/1d344f7c14bf49e3a4c1d3b8ab66a51e/users/3a9cfcaf676549efafaedba79ead21e3/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:55.992895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34367a-154d-475b-a4a1-1cd4efb642e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d344f7c14bf49e3a4c1d3b8ab66a51e, user_id=3a9cfcaf676549efafaedba79ead21e3, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:55.998507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34367a-154d-475b-a4a1-1cd4efb642e7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:56.052730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aef0a1-7856-4a99-8f88-0bd3a1d62eb4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:56.057709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aef0a1-7856-4a99-8f88-0bd3a1d62eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:56.057709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aef0a1-7856-4a99-8f88-0bd3a1d62eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:56.057936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 915/1819] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:55 2022] PUT /identity/v3/projects/1d344f7c14bf49e3a4c1d3b8ab66a51e/users/3a9cfcaf676549efafaedba79ead21e3/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:56.142717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a0aef0a1-7856-4a99-8f88-0bd3a1d62eb4 None None] MFA Rules not processed for user `3a9cfcaf676549efafaedba79ead21e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:56.147589 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a0aef0a1-7856-4a99-8f88-0bd3a1d62eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:56.371340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 905/1820] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:03:56.375241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34367a-154d-475b-a4a1-1cd4efb642e7 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:56.529792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34367a-154d-475b-a4a1-1cd4efb642e7 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:56.577341 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1611f-2cb8-49eb-96a3-c8a3a8164ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:56.578563 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1611f-2cb8-49eb-96a3-c8a3a8164ebf admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:56.580431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1611f-2cb8-49eb-96a3-c8a3a8164ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:56.580736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1611f-2cb8-49eb-96a3-c8a3a8164ebf admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:56.586900 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1611f-2cb8-49eb-96a3-c8a3a8164ebf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:56.602464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e1611f-2cb8-49eb-96a3-c8a3a8164ebf admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:56.710232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 916/1821] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:03:56 2022] POST /identity/v3/projects => generated 387 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:56.713464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aef0a1-7856-4a99-8f88-0bd3a1d62eb4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:56.745974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aef0a1-7856-4a99-8f88-0bd3a1d62eb4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:56.850931 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:56.893789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce24b7-5d7e-45df-9f5a-01f30fc7c78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:56.895266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce24b7-5d7e-45df-9f5a-01f30fc7c78d admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:56.896005 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce24b7-5d7e-45df-9f5a-01f30fc7c78d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:56.896955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ce24b7-5d7e-45df-9f5a-01f30fc7c78d admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:56.898689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce24b7-5d7e-45df-9f5a-01f30fc7c78d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:56.903439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ce24b7-5d7e-45df-9f5a-01f30fc7c78d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:56.940852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 906/1822] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:03:56 2022] POST /identity/v3/users => generated 300 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:03:56.942098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1611f-2cb8-49eb-96a3-c8a3a8164ebf admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:56.965648 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e1611f-2cb8-49eb-96a3-c8a3a8164ebf admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:56.989784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20ee61-4c6e-47b6-a2ee-68c7020cf34e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:56.990516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20ee61-4c6e-47b6-a2ee-68c7020cf34e admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:56.990924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20ee61-4c6e-47b6-a2ee-68c7020cf34e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:56.991430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba20ee61-4c6e-47b6-a2ee-68c7020cf34e admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:56.992610 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20ee61-4c6e-47b6-a2ee-68c7020cf34e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:56.995498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba20ee61-4c6e-47b6-a2ee-68c7020cf34e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:57.025457 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 917/1823] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:57.026923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce24b7-5d7e-45df-9f5a-01f30fc7c78d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:57.042486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ce24b7-5d7e-45df-9f5a-01f30fc7c78d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:57.052790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fbae4-8b62-45e9-b40f-9eaef38e2f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:57.054073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fbae4-8b62-45e9-b40f-9eaef38e2f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:57.054454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fbae4-8b62-45e9-b40f-9eaef38e2f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:57.055047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fbae4-8b62-45e9-b40f-9eaef38e2f38 admin admin] PATH_INFO: `/v3/projects/680c7812078d458bb2a4b4410e8597e8/users/65eb4c645c2742abb3a1d53e9330bc31/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:57.081409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fbae4-8b62-45e9-b40f-9eaef38e2f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=680c7812078d458bb2a4b4410e8597e8, user_id=65eb4c645c2742abb3a1d53e9330bc31, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:57.084704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fbae4-8b62-45e9-b40f-9eaef38e2f38 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:57.104552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 907/1824] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:57 2022] PUT /identity/v3/projects/680c7812078d458bb2a4b4410e8597e8/users/65eb4c645c2742abb3a1d53e9330bc31/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:57.108705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20ee61-4c6e-47b6-a2ee-68c7020cf34e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:57.124162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba20ee61-4c6e-47b6-a2ee-68c7020cf34e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:57.322691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a164cd04-2550-42d2-80bf-d98e83c513b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:57.327847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164cd04-2550-42d2-80bf-d98e83c513b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:57.328693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164cd04-2550-42d2-80bf-d98e83c513b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:57.329653 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a164cd04-2550-42d2-80bf-d98e83c513b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:57.334394 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164cd04-2550-42d2-80bf-d98e83c513b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:57.337561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a164cd04-2550-42d2-80bf-d98e83c513b5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:57.383824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 918/1825] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:03:57 2022] GET /identity/v3/roles => generated 1420 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:03:57.388068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fbae4-8b62-45e9-b40f-9eaef38e2f38 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:57.402258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fbae4-8b62-45e9-b40f-9eaef38e2f38 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:57.418942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a89c1-030a-4679-9768-ef0bb4525a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:57.421865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a89c1-030a-4679-9768-ef0bb4525a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:57.422146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a89c1-030a-4679-9768-ef0bb4525a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:57.430249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a89c1-030a-4679-9768-ef0bb4525a92 admin admin] PATH_INFO: `/v3/projects/680c7812078d458bb2a4b4410e8597e8/users/65eb4c645c2742abb3a1d53e9330bc31/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:57.435169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a89c1-030a-4679-9768-ef0bb4525a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=680c7812078d458bb2a4b4410e8597e8, user_id=65eb4c645c2742abb3a1d53e9330bc31, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:57.438421 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a89c1-030a-4679-9768-ef0bb4525a92 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:57.481680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 908/1826] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:03:57 2022] PUT /identity/v3/projects/680c7812078d458bb2a4b4410e8597e8/users/65eb4c645c2742abb3a1d53e9330bc31/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:57.494532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fbb21-924b-4b4b-ab66-091b23f4b534 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:57.494888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fbb21-924b-4b4b-ab66-091b23f4b534 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:57.495238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fbb21-924b-4b4b-ab66-091b23f4b534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:57.563821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-614fbb21-924b-4b4b-ab66-091b23f4b534 None None] MFA Rules not processed for user `65eb4c645c2742abb3a1d53e9330bc31`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:57.567220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-614fbb21-924b-4b4b-ab66-091b23f4b534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:57.643340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:57.750208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 919/1827] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:57 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:57.760813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a89c1-030a-4679-9768-ef0bb4525a92 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:57.763321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-355a89c1-030a-4679-9768-ef0bb4525a92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:57.955491 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fbb21-924b-4b4b-ab66-091b23f4b534 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:57.956633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-614fbb21-924b-4b4b-ab66-091b23f4b534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:58.003253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a89c1-030a-4679-9768-ef0bb4525a92 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:58.017817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d902440-daf6-4e86-9ac7-74da1ea8d00c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:58.018525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d902440-daf6-4e86-9ac7-74da1ea8d00c service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:58.018944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d902440-daf6-4e86-9ac7-74da1ea8d00c service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:58.019180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d902440-daf6-4e86-9ac7-74da1ea8d00c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:58.059801 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d902440-daf6-4e86-9ac7-74da1ea8d00c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:58.061388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d902440-daf6-4e86-9ac7-74da1ea8d00c service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:58.098994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 909/1828] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:57 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:58.163924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d902440-daf6-4e86-9ac7-74da1ea8d00c service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:58.218524 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fbb21-924b-4b4b-ab66-091b23f4b534 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:58.227774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655662ff-2768-46b4-8177-4f2747a54a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:58.228516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655662ff-2768-46b4-8177-4f2747a54a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:58.228818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655662ff-2768-46b4-8177-4f2747a54a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:58.229182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655662ff-2768-46b4-8177-4f2747a54a79 admin admin] PATH_INFO: `/v3/users/052c38b716104f34b7b71cecef1c3bcd` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:58.231893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655662ff-2768-46b4-8177-4f2747a54a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=052c38b716104f34b7b71cecef1c3bcd)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:58.234102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655662ff-2768-46b4-8177-4f2747a54a79 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:58.360763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-655662ff-2768-46b4-8177-4f2747a54a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '052c38b716104f34b7b71cecef1c3bcd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:58.383408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-655662ff-2768-46b4-8177-4f2747a54a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '052c38b716104f34b7b71cecef1c3bcd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:58.392356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d902440-daf6-4e86-9ac7-74da1ea8d00c service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:58.410609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03897c6f-dffe-4099-911a-16976aaeda3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:58.411275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03897c6f-dffe-4099-911a-16976aaeda3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:58.411552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03897c6f-dffe-4099-911a-16976aaeda3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:58.411824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03897c6f-dffe-4099-911a-16976aaeda3a admin admin] PATH_INFO: `/v3/users/3a9cfcaf676549efafaedba79ead21e3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:58.426251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-655662ff-2768-46b4-8177-4f2747a54a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '052c38b716104f34b7b71cecef1c3bcd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:58.430118 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03897c6f-dffe-4099-911a-16976aaeda3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a9cfcaf676549efafaedba79ead21e3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:58.432298 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03897c6f-dffe-4099-911a-16976aaeda3a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:58.433899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-655662ff-2768-46b4-8177-4f2747a54a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '052c38b716104f34b7b71cecef1c3bcd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:58.461134 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-655662ff-2768-46b4-8177-4f2747a54a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '052c38b716104f34b7b71cecef1c3bcd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:58.485196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 920/1829] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:57 2022] DELETE /identity/v3/users/052c38b716104f34b7b71cecef1c3bcd => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:58.490136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c794ce1-6fe9-4730-9760-b38dee076a0d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:58.490415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c794ce1-6fe9-4730-9760-b38dee076a0d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:58.490684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c794ce1-6fe9-4730-9760-b38dee076a0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:58.520008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:58.538767 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1c794ce1-6fe9-4730-9760-b38dee076a0d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:58.540060 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1c794ce1-6fe9-4730-9760-b38dee076a0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:58.549686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-03897c6f-dffe-4099-911a-16976aaeda3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a9cfcaf676549efafaedba79ead21e3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:58.551158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-03897c6f-dffe-4099-911a-16976aaeda3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a9cfcaf676549efafaedba79ead21e3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:58.590249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-03897c6f-dffe-4099-911a-16976aaeda3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a9cfcaf676549efafaedba79ead21e3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:58.654639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-03897c6f-dffe-4099-911a-16976aaeda3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a9cfcaf676549efafaedba79ead21e3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:58.703566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:58.733426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-03897c6f-dffe-4099-911a-16976aaeda3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a9cfcaf676549efafaedba79ead21e3'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:58.776448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 921/1830] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:03:58.785991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 910/1831] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:58 2022] DELETE /identity/v3/users/3a9cfcaf676549efafaedba79ead21e3 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:03:58.790832 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d31b1-b571-41aa-bc19-4f37a368f048 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:58.791063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d31b1-b571-41aa-bc19-4f37a368f048 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:58.791363 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d31b1-b571-41aa-bc19-4f37a368f048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:58.840511 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-927d31b1-b571-41aa-bc19-4f37a368f048 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:58.842169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-927d31b1-b571-41aa-bc19-4f37a368f048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:58.847733 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654e274-3250-4ec8-a5a2-796f8143bea4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:58.847733 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654e274-3250-4ec8-a5a2-796f8143bea4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:58.847733 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1654e274-3250-4ec8-a5a2-796f8143bea4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:58.849425 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 911/1832] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 12:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:03:58.933898 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654e274-3250-4ec8-a5a2-796f8143bea4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:58.939768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1654e274-3250-4ec8-a5a2-796f8143bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:58.988078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 922/1833] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:58.988078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a79f9-1822-4ed9-a724-ec3b47111786 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:58.988078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a79f9-1822-4ed9-a724-ec3b47111786 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:58.988826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3a79f9-1822-4ed9-a724-ec3b47111786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:59.042327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2a3a79f9-1822-4ed9-a724-ec3b47111786 None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:59.043990 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2a3a79f9-1822-4ed9-a724-ec3b47111786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:59.119010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1654e274-3250-4ec8-a5a2-796f8143bea4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:59.124276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:59.124940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:59.125218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:59.125537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] PATH_INFO: `/v3/users/70d96f5233e64a7e9a2e26e423adcc0c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:59.126879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d96f5233e64a7e9a2e26e423adcc0c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:59.129076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:59.214495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d96f5233e64a7e9a2e26e423adcc0c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:59.216850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d96f5233e64a7e9a2e26e423adcc0c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:59.242971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 923/1834] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 12:03:58 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:59.244914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a79f9-1822-4ed9-a724-ec3b47111786 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:59.245220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d96f5233e64a7e9a2e26e423adcc0c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:59.246774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2a3a79f9-1822-4ed9-a724-ec3b47111786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:59.262440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d96f5233e64a7e9a2e26e423adcc0c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:59.276036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d96f5233e64a7e9a2e26e423adcc0c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:03:59.291336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 912/1835] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:03:58 2022] DELETE /identity/v3/users/70d96f5233e64a7e9a2e26e423adcc0c => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:03:59.298655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:59.306069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:59.366993 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:59.391659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77411b3a-67be-47eb-941c-8c742a93ee03 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:59.395394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47b1cd3-c590-41a8-9cd2-f483a53270c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:59.396154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b1cd3-c590-41a8-9cd2-f483a53270c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:59.396503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b1cd3-c590-41a8-9cd2-f483a53270c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:59.396840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47b1cd3-c590-41a8-9cd2-f483a53270c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:59.398834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b47b1cd3-c590-41a8-9cd2-f483a53270c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:59.445041 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3a79f9-1822-4ed9-a724-ec3b47111786 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:59.456276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b80dc-91b5-4197-acb1-1567c5409533 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:59.458906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b80dc-91b5-4197-acb1-1567c5409533 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:59.459799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b80dc-91b5-4197-acb1-1567c5409533 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:59.461792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16b80dc-91b5-4197-acb1-1567c5409533 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:59.465678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b16b80dc-91b5-4197-acb1-1567c5409533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:59.494513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b1cd3-c590-41a8-9cd2-f483a53270c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:59.506545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47b1cd3-c590-41a8-9cd2-f483a53270c8 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:59.528658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 913/1836] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:59.532274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103775c3-c59a-4493-8275-5299b9d86097 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:59.532582 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103775c3-c59a-4493-8275-5299b9d86097 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:59.533656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103775c3-c59a-4493-8275-5299b9d86097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:59.565603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:03:59.583122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-103775c3-c59a-4493-8275-5299b9d86097 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:03:59.586538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-103775c3-c59a-4493-8275-5299b9d86097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:59.608266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 914/1837] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:03:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:03:59.647998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b80dc-91b5-4197-acb1-1567c5409533 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:59.651767 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16b80dc-91b5-4197-acb1-1567c5409533 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:59.671968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103775c3-c59a-4493-8275-5299b9d86097 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:59.674306 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 924/1838] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:03:59.685985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103775c3-c59a-4493-8275-5299b9d86097 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:59.696938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b63367-c6e6-4206-889f-7eabca83db66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:59.697859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b63367-c6e6-4206-889f-7eabca83db66 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:59.698203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b63367-c6e6-4206-889f-7eabca83db66 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:59.698457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b63367-c6e6-4206-889f-7eabca83db66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:59.717063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b80dc-91b5-4197-acb1-1567c5409533 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:03:59.719232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b16b80dc-91b5-4197-acb1-1567c5409533 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:03:59.738067 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b63367-c6e6-4206-889f-7eabca83db66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:03:59.740319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b63367-c6e6-4206-889f-7eabca83db66 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:03:59.765289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 915/1839] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:03:59.930817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16b80dc-91b5-4197-acb1-1567c5409533 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:03:59.956806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f152d-1020-4e3b-8795-b9214745699d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:03:59.959553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f152d-1020-4e3b-8795-b9214745699d service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:03:59.961827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f152d-1020-4e3b-8795-b9214745699d service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:03:59.962116 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f152d-1020-4e3b-8795-b9214745699d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:03:59.966248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-875f152d-1020-4e3b-8795-b9214745699d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:00.010473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f152d-1020-4e3b-8795-b9214745699d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:00.015645 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f152d-1020-4e3b-8795-b9214745699d service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:00.042695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 925/1840] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:03:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:04:00.758084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b63367-c6e6-4206-889f-7eabca83db66 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:00.763937 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-72b63367-c6e6-4206-889f-7eabca83db66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:00.810425 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b63367-c6e6-4206-889f-7eabca83db66 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:00.820294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:00.821091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:00.821394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:00.821762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] PATH_INFO: `/v3/projects/1d344f7c14bf49e3a4c1d3b8ab66a51e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:00.823057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d344f7c14bf49e3a4c1d3b8ab66a51e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:00.826930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:00.842364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f152d-1020-4e3b-8795-b9214745699d service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:00.844233 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-875f152d-1020-4e3b-8795-b9214745699d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:00.882770 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f152d-1020-4e3b-8795-b9214745699d service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:00.898475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852b1bb0-2bd0-485e-beb9-553cfe43bc73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:00.910895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b1bb0-2bd0-485e-beb9-553cfe43bc73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:00.911183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b1bb0-2bd0-485e-beb9-553cfe43bc73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:00.911456 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852b1bb0-2bd0-485e-beb9-553cfe43bc73 admin admin] PATH_INFO: `/v3/projects/3b97a37fee6f4a9aacd5c62df7bf5af8` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:00.915460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b1bb0-2bd0-485e-beb9-553cfe43bc73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b97a37fee6f4a9aacd5c62df7bf5af8)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:00.918661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852b1bb0-2bd0-485e-beb9-553cfe43bc73 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:00.999865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d344f7c14bf49e3a4c1d3b8ab66a51e', 'request_id': 'req-357d07c4-137f-456d-ae92-3496884257d4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.001846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-852b1bb0-2bd0-485e-beb9-553cfe43bc73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b97a37fee6f4a9aacd5c62df7bf5af8', 'request_id': 'req-852b1bb0-2bd0-485e-beb9-553cfe43bc73'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.009487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-852b1bb0-2bd0-485e-beb9-553cfe43bc73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b97a37fee6f4a9aacd5c62df7bf5af8', 'request_id': 'req-852b1bb0-2bd0-485e-beb9-553cfe43bc73'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.015248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d344f7c14bf49e3a4c1d3b8ab66a51e', 'request_id': 'req-357d07c4-137f-456d-ae92-3496884257d4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.022805 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-852b1bb0-2bd0-485e-beb9-553cfe43bc73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b97a37fee6f4a9aacd5c62df7bf5af8', 'request_id': 'req-852b1bb0-2bd0-485e-beb9-553cfe43bc73'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.035351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d344f7c14bf49e3a4c1d3b8ab66a51e', 'request_id': 'req-357d07c4-137f-456d-ae92-3496884257d4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.051697 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-852b1bb0-2bd0-485e-beb9-553cfe43bc73 admin admin] The token cache is being invalidate because project 3b97a37fee6f4a9aacd5c62df7bf5af8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:01.052453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-852b1bb0-2bd0-485e-beb9-553cfe43bc73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.053481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-852b1bb0-2bd0-485e-beb9-553cfe43bc73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.057194 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 926/1841] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:00 2022] DELETE /identity/v3/projects/3b97a37fee6f4a9aacd5c62df7bf5af8 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:01.059548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fab06f-531d-45ab-9716-f950a0374482 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:01.060326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fab06f-531d-45ab-9716-f950a0374482 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:01.060814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fab06f-531d-45ab-9716-f950a0374482 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:01.064676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 927/1842] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 12:04:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:04:01.064837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] The token cache is being invalidate because project 1d344f7c14bf49e3a4c1d3b8ab66a51e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:01.065094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.066253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fab06f-531d-45ab-9716-f950a0374482 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:01.069472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e5fab06f-531d-45ab-9716-f950a0374482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:01.072248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.078102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 916/1843] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:00 2022] DELETE /identity/v3/projects/1d344f7c14bf49e3a4c1d3b8ab66a51e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:01.080089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:01.083431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:01.235928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:01.254203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:01.304480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357d07c4-137f-456d-ae92-3496884257d4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:01.311850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:01.313335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:01.313843 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:01.314865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] PATH_INFO: `/v3/users/ed3f1431ae6c4d21857106bb6f0b39eb` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:01.317167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed3f1431ae6c4d21857106bb6f0b39eb)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:01.324702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:01.329213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fab06f-531d-45ab-9716-f950a0374482 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:01.353185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:01.353879 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:01.354162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:01.354440 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259 admin admin] PATH_INFO: `/v3/projects/ed6b402f2cfa4215851abb44a38e9abf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:01.355735 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed6b402f2cfa4215851abb44a38e9abf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:01.357720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:01.439902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed3f1431ae6c4d21857106bb6f0b39eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.441272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed3f1431ae6c4d21857106bb6f0b39eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.461760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed3f1431ae6c4d21857106bb6f0b39eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.472589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed6b402f2cfa4215851abb44a38e9abf', 'request_id': 'req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.473996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed3f1431ae6c4d21857106bb6f0b39eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.484558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed3f1431ae6c4d21857106bb6f0b39eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.493395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed6b402f2cfa4215851abb44a38e9abf', 'request_id': 'req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.495395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 917/1844] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:01 2022] DELETE /identity/v3/users/ed3f1431ae6c4d21857106bb6f0b39eb => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:01.496545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:01.499518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:01.507002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed6b402f2cfa4215851abb44a38e9abf', 'request_id': 'req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.532379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259 admin admin] The token cache is being invalidate because project ed6b402f2cfa4215851abb44a38e9abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:01.532827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.534371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-afa9f78a-ebbc-45d5-8594-5e82b4e2c259 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.537691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 928/1845] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:01 2022] DELETE /identity/v3/projects/ed6b402f2cfa4215851abb44a38e9abf => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:01.540284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e0ea-db90-4820-8c0e-615c692dabd9 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:01.541130 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e0ea-db90-4820-8c0e-615c692dabd9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:01.541705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96e0ea-db90-4820-8c0e-615c692dabd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:01.599942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-bf96e0ea-db90-4820-8c0e-615c692dabd9 None None] MFA Rules not processed for user `35b5e545d75d40d0abb9c8d996e3b4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:01.601217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bf96e0ea-db90-4820-8c0e-615c692dabd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:01.626566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bdce47-9585-4a8c-91fc-a6de2c3ff59d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:01.645742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:01.646672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:01.646956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:01.647360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] PATH_INFO: `/v3/users/65eb4c645c2742abb3a1d53e9330bc31` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:01.649595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65eb4c645c2742abb3a1d53e9330bc31)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:01.660132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:01.685976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 929/1846] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 12:04:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:01.687263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96e0ea-db90-4820-8c0e-615c692dabd9 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:01.689166 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bf96e0ea-db90-4820-8c0e-615c692dabd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:01.716369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96e0ea-db90-4820-8c0e-615c692dabd9 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:01.724731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:01.725499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:01.726051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:01.726338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] PATH_INFO: `/v3/users/afdcc0ac2744460e859b27088c8d41ee` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:01.727824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afdcc0ac2744460e859b27088c8d41ee)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:01.730345 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:01.734794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65eb4c645c2742abb3a1d53e9330bc31'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.735994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65eb4c645c2742abb3a1d53e9330bc31'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.755472 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65eb4c645c2742abb3a1d53e9330bc31'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.761337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:01.766398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65eb4c645c2742abb3a1d53e9330bc31'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.776113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65eb4c645c2742abb3a1d53e9330bc31'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.785881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 918/1847] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:01 2022] DELETE /identity/v3/users/65eb4c645c2742abb3a1d53e9330bc31 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:01.793613 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afdcc0ac2744460e859b27088c8d41ee'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.809725 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afdcc0ac2744460e859b27088c8d41ee'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.817516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:01.819114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:01.827656 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:01.852241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afdcc0ac2744460e859b27088c8d41ee'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.853897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afdcc0ac2744460e859b27088c8d41ee'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.869280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afdcc0ac2744460e859b27088c8d41ee'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:01.884391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 930/1848] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:01 2022] DELETE /identity/v3/users/afdcc0ac2744460e859b27088c8d41ee => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:01.935281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beee1e93-0b45-4885-af39-904eb54d3377 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:02.009169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68457-6e44-43b0-8d3b-39f4c9927dc6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:02.011029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68457-6e44-43b0-8d3b-39f4c9927dc6 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:02.011029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68457-6e44-43b0-8d3b-39f4c9927dc6 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:02.011029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d68457-6e44-43b0-8d3b-39f4c9927dc6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:02.013157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-44d68457-6e44-43b0-8d3b-39f4c9927dc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:02.027389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d68457-6e44-43b0-8d3b-39f4c9927dc6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:02.030421 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d68457-6e44-43b0-8d3b-39f4c9927dc6 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:02.046343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 919/1849] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:04:02.494152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:02.495682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:02.584897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68457-6e44-43b0-8d3b-39f4c9927dc6 service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:02.586600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-44d68457-6e44-43b0-8d3b-39f4c9927dc6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:02.608609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b32d8bc-a0b3-4419-b081-deed0c40ed85 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:02.614990 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:02.615958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:02.616391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:02.616814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64 admin admin] PATH_INFO: `/v3/projects/680c7812078d458bb2a4b4410e8597e8` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:02.618856 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=680c7812078d458bb2a4b4410e8597e8)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:02.620945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:02.708992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d68457-6e44-43b0-8d3b-39f4c9927dc6 service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:02.711174 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '680c7812078d458bb2a4b4410e8597e8', 'request_id': 'req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:02.718775 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '680c7812078d458bb2a4b4410e8597e8', 'request_id': 'req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:02.727763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '680c7812078d458bb2a4b4410e8597e8', 'request_id': 'req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:02.749228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64 admin admin] The token cache is being invalidate because project 680c7812078d458bb2a4b4410e8597e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:02.749650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:02.750394 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6e242b0f-f258-4ed5-ae59-80dcbbc8fd64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:02.752470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 931/1850] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:02 2022] DELETE /identity/v3/projects/680c7812078d458bb2a4b4410e8597e8 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:02.759434 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:02.759924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3814edd-b717-49ef-841e-7dcec2229b67 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:02.760227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3814edd-b717-49ef-841e-7dcec2229b67 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:02.760504 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3814edd-b717-49ef-841e-7dcec2229b67 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:02.764055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 932/1851] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 12:04:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:04:02.765285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a58896-528f-452a-9872-592b10bc3d3c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:02.765592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a58896-528f-452a-9872-592b10bc3d3c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:02.765898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a58896-528f-452a-9872-592b10bc3d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:02.799355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-60a58896-528f-452a-9872-592b10bc3d3c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:02.800997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-60a58896-528f-452a-9872-592b10bc3d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:02.834773 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:02.835518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:02.835806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:02.836106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] PATH_INFO: `/v3/projects/6f84d86867f545cdba56964bcab57712` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:02.837312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f84d86867f545cdba56964bcab57712)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:02.841216 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:02.888261 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 933/1852] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:02.894766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc121f-dead-4cd7-9141-53a2a31ffc54 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:02.895048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc121f-dead-4cd7-9141-53a2a31ffc54 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:02.895521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc121f-dead-4cd7-9141-53a2a31ffc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:02.915713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:02.923104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fdbc121f-dead-4cd7-9141-53a2a31ffc54 None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:02.926170 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fdbc121f-dead-4cd7-9141-53a2a31ffc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:02.931899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f84d86867f545cdba56964bcab57712', 'request_id': 'req-53c22bee-92b9-4f2a-b126-86ae0286d001'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:02.938219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f84d86867f545cdba56964bcab57712', 'request_id': 'req-53c22bee-92b9-4f2a-b126-86ae0286d001'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:02.948736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f84d86867f545cdba56964bcab57712', 'request_id': 'req-53c22bee-92b9-4f2a-b126-86ae0286d001'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:02.961808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] The token cache is being invalidate because project 6f84d86867f545cdba56964bcab57712 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:02.962272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:02.962976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:02.968629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 920/1853] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:02 2022] DELETE /identity/v3/projects/6f84d86867f545cdba56964bcab57712 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:02.969618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:02.971180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.010360 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 934/1854] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 12:04:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:03.012342 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda889-93b1-4900-8315-91a7ce14f3d6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.012620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda889-93b1-4900-8315-91a7ce14f3d6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.012889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fda889-93b1-4900-8315-91a7ce14f3d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.033810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-98fda889-93b1-4900-8315-91a7ce14f3d6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:03.035176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-98fda889-93b1-4900-8315-91a7ce14f3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.053262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c22bee-92b9-4f2a-b126-86ae0286d001 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.059593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.060353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.060823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.061177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] PATH_INFO: `/v3/projects/a72a7961136d4e63ae2fc979b3edd9c1` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.062620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=a72a7961136d4e63ae2fc979b3edd9c1)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:03.064717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:03.119099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 935/1855] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:03.120551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c635e-877a-44d1-99c1-2fd4ec7501ab None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.121404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c635e-877a-44d1-99c1-2fd4ec7501ab None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.121717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208c635e-877a-44d1-99c1-2fd4ec7501ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.133384 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a72a7961136d4e63ae2fc979b3edd9c1', 'request_id': 'req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.142035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a72a7961136d4e63ae2fc979b3edd9c1', 'request_id': 'req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.144125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:03.148883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-208c635e-877a-44d1-99c1-2fd4ec7501ab None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:03.150600 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-208c635e-877a-44d1-99c1-2fd4ec7501ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.154367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a72a7961136d4e63ae2fc979b3edd9c1', 'request_id': 'req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.171809 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] The token cache is being invalidate because project a72a7961136d4e63ae2fc979b3edd9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:03.172089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.173716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.180408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 921/1856] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:02 2022] DELETE /identity/v3/projects/a72a7961136d4e63ae2fc979b3edd9c1 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:03.181270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.184477 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.229807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 936/1857] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:03.230784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c635e-877a-44d1-99c1-2fd4ec7501ab None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.232806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-208c635e-877a-44d1-99c1-2fd4ec7501ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.248246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208c635e-877a-44d1-99c1-2fd4ec7501ab None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.253285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d18b2-58d9-4c36-b965-ba0a127e0d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.253983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d18b2-58d9-4c36-b965-ba0a127e0d19 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.254273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d18b2-58d9-4c36-b965-ba0a127e0d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.254862 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d18b2-58d9-4c36-b965-ba0a127e0d19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.255581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d18b2-58d9-4c36-b965-ba0a127e0d19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:03.255885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d18b2-58d9-4c36-b965-ba0a127e0d19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:03.257626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74d18b2-58d9-4c36-b965-ba0a127e0d19 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:03.275428 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 937/1858] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:03.275428 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d18b2-58d9-4c36-b965-ba0a127e0d19 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.277165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a74d18b2-58d9-4c36-b965-ba0a127e0d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.309334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f5c7b9-1b1a-48ff-9eca-4db799b424ac admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.311223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74d18b2-58d9-4c36-b965-ba0a127e0d19 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.315431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.315967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.316246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.316582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] PATH_INFO: `/v3/users/d1ba61446ecf470c9fd9d5207a1eca60` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.317232 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99360f8-603c-4ad9-8f0f-4184e6d35090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.317791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ba61446ecf470c9fd9d5207a1eca60)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:03.318076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99360f8-603c-4ad9-8f0f-4184e6d35090 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.318468 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99360f8-603c-4ad9-8f0f-4184e6d35090 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.318839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99360f8-603c-4ad9-8f0f-4184e6d35090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.319712 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:03.321683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c99360f8-603c-4ad9-8f0f-4184e6d35090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.336166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99360f8-603c-4ad9-8f0f-4184e6d35090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:03.339080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99360f8-603c-4ad9-8f0f-4184e6d35090 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:03.344933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:03.355053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 922/1859] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:03.356753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911127b-5765-482b-8e63-0ee127aca7d0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.357236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911127b-5765-482b-8e63-0ee127aca7d0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.357494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1911127b-5765-482b-8e63-0ee127aca7d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.381493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1911127b-5765-482b-8e63-0ee127aca7d0 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:03.382919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1911127b-5765-482b-8e63-0ee127aca7d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.393246 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 923/1860] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:03.394354 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911127b-5765-482b-8e63-0ee127aca7d0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.399630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ba61446ecf470c9fd9d5207a1eca60'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.411057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ba61446ecf470c9fd9d5207a1eca60'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.415836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1911127b-5765-482b-8e63-0ee127aca7d0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.426939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2852a-f54c-43cd-97bf-8a4a798edcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.427854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2852a-f54c-43cd-97bf-8a4a798edcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.428383 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2852a-f54c-43cd-97bf-8a4a798edcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.428828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f2852a-f54c-43cd-97bf-8a4a798edcc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.429808 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ba61446ecf470c9fd9d5207a1eca60'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.430603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ba61446ecf470c9fd9d5207a1eca60'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.430980 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2852a-f54c-43cd-97bf-8a4a798edcc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:03.433206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f2852a-f54c-43cd-97bf-8a4a798edcc2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:03.441546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ba61446ecf470c9fd9d5207a1eca60'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.453495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 938/1861] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:03 2022] DELETE /identity/v3/users/d1ba61446ecf470c9fd9d5207a1eca60 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:03.453495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.455996 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.484635 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 924/1862] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:03 2022] POST /identity/v3/projects => generated 373 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:03.488791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2852a-f54c-43cd-97bf-8a4a798edcc2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.497807 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-69f2852a-f54c-43cd-97bf-8a4a798edcc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.563579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f21e3-8e2d-4ae0-b07c-b86ba2cdc513 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.587650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f2852a-f54c-43cd-97bf-8a4a798edcc2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.601676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907c36a-e3a5-41ef-8c9a-d96356856055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.602907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907c36a-e3a5-41ef-8c9a-d96356856055 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.603232 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907c36a-e3a5-41ef-8c9a-d96356856055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.604297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907c36a-e3a5-41ef-8c9a-d96356856055 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.605079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907c36a-e3a5-41ef-8c9a-d96356856055 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:03.609174 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0907c36a-e3a5-41ef-8c9a-d96356856055 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:03.644570 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 925/1863] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:03 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:04:03.646140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907c36a-e3a5-41ef-8c9a-d96356856055 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.648731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0907c36a-e3a5-41ef-8c9a-d96356856055 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.650718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a577550-d3e2-46bf-a376-810c6d40bb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.651378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a577550-d3e2-46bf-a376-810c6d40bb16 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.651666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a577550-d3e2-46bf-a376-810c6d40bb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.651946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a577550-d3e2-46bf-a376-810c6d40bb16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.652851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a577550-d3e2-46bf-a376-810c6d40bb16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:03.653230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a577550-d3e2-46bf-a376-810c6d40bb16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:03.654995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a577550-d3e2-46bf-a376-810c6d40bb16 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:03.671972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907c36a-e3a5-41ef-8c9a-d96356856055 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.675919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 939/1864] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:03.677002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a577550-d3e2-46bf-a376-810c6d40bb16 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.678497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.679362 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.679851 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.680314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] PATH_INFO: `/v3/users/e6aaad10422c4c1798f43ae2cdda5dc4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.681866 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6aaad10422c4c1798f43ae2cdda5dc4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:03.685221 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:03.689833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a577550-d3e2-46bf-a376-810c6d40bb16 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.698946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af0de5-f699-4751-bb28-614e0a25cabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.699808 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af0de5-f699-4751-bb28-614e0a25cabd admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.700246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af0de5-f699-4751-bb28-614e0a25cabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.700640 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af0de5-f699-4751-bb28-614e0a25cabd admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.701625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af0de5-f699-4751-bb28-614e0a25cabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:03.703620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af0de5-f699-4751-bb28-614e0a25cabd admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:03.718732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 940/1865] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:03.719930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af0de5-f699-4751-bb28-614e0a25cabd admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.723273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=5,keystone:DELETE=6,keystone:SELECT=89 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:03.739923 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af0de5-f699-4751-bb28-614e0a25cabd admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.747452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94326d-6d8c-44ea-bc6c-443fd776b5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.748287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94326d-6d8c-44ea-bc6c-443fd776b5e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.748661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94326d-6d8c-44ea-bc6c-443fd776b5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.749205 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94326d-6d8c-44ea-bc6c-443fd776b5e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.750169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94326d-6d8c-44ea-bc6c-443fd776b5e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:03.752308 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94326d-6d8c-44ea-bc6c-443fd776b5e6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:03.758313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6aaad10422c4c1798f43ae2cdda5dc4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.759587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6aaad10422c4c1798f43ae2cdda5dc4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.777146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6aaad10422c4c1798f43ae2cdda5dc4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.785054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6aaad10422c4c1798f43ae2cdda5dc4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.786326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 941/1866] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:03 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:03.790888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94326d-6d8c-44ea-bc6c-443fd776b5e6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.795887 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6aaad10422c4c1798f43ae2cdda5dc4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:03.802522 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:03.806536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 926/1867] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:03 2022] DELETE /identity/v3/users/e6aaad10422c4c1798f43ae2cdda5dc4 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:03.806536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.807391 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.925488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4dc53b-3204-4d5e-9204-14374fa1a2d8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.930411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451056d-ce88-4868-a027-955c8dc6f3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.931586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451056d-ce88-4868-a027-955c8dc6f3f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.931586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451056d-ce88-4868-a027-955c8dc6f3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.931891 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a451056d-ce88-4868-a027-955c8dc6f3f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.932593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451056d-ce88-4868-a027-955c8dc6f3f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:03.935382 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a451056d-ce88-4868-a027-955c8dc6f3f3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:03.945454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94326d-6d8c-44ea-bc6c-443fd776b5e6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.952040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27e15-fc29-4267-9688-852d4b66b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.952822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27e15-fc29-4267-9688-852d4b66b374 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:03.953810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27e15-fc29-4267-9688-852d4b66b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:03.954225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b27e15-fc29-4267-9688-852d4b66b374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:03.955127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b27e15-fc29-4267-9688-852d4b66b374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:03.956998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b27e15-fc29-4267-9688-852d4b66b374 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:03.968964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 942/1868] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:03.973647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 927/1869] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:03 2022] POST /identity/v3/users => generated 289 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:03.973967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27e15-fc29-4267-9688-852d4b66b374 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.975227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451056d-ce88-4868-a027-955c8dc6f3f3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:03.978843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-50b27e15-fc29-4267-9688-852d4b66b374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:03.993223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b27e15-fc29-4267-9688-852d4b66b374 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:03.998966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac074392-a81b-4afd-8fd3-b37476ea7050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:03.999894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac074392-a81b-4afd-8fd3-b37476ea7050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:04.000269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac074392-a81b-4afd-8fd3-b37476ea7050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:04.000640 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac074392-a81b-4afd-8fd3-b37476ea7050 admin admin] PATH_INFO: `/v3/projects/4c8e016670c14922804c96e783c2ee01/users/220e2813cbe04e35a9214a7191a6fc87/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:04.013147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a451056d-ce88-4868-a027-955c8dc6f3f3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:04.018597 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac074392-a81b-4afd-8fd3-b37476ea7050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c8e016670c14922804c96e783c2ee01, user_id=220e2813cbe04e35a9214a7191a6fc87, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:04.020723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f15e46-4bed-4b59-9a06-5a012fa69d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:04.021444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac074392-a81b-4afd-8fd3-b37476ea7050 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:04.021963 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f15e46-4bed-4b59-9a06-5a012fa69d5f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:04.022627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f15e46-4bed-4b59-9a06-5a012fa69d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:04.022911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f15e46-4bed-4b59-9a06-5a012fa69d5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:04.024229 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f15e46-4bed-4b59-9a06-5a012fa69d5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:04.026392 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f15e46-4bed-4b59-9a06-5a012fa69d5f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:04.045484 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 928/1870] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:04.049702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f15e46-4bed-4b59-9a06-5a012fa69d5f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:04.072457 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 943/1871] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:03 2022] PUT /identity/v3/projects/4c8e016670c14922804c96e783c2ee01/users/220e2813cbe04e35a9214a7191a6fc87/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:04.074465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac074392-a81b-4afd-8fd3-b37476ea7050 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:04.077275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ac074392-a81b-4afd-8fd3-b37476ea7050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:04.095882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f15e46-4bed-4b59-9a06-5a012fa69d5f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:04.179272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b4356e-92a2-4947-b017-168021960dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:04.179979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4356e-92a2-4947-b017-168021960dd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:04.180331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4356e-92a2-4947-b017-168021960dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:04.180674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b4356e-92a2-4947-b017-168021960dd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:04.181961 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4356e-92a2-4947-b017-168021960dd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:04.182819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac074392-a81b-4afd-8fd3-b37476ea7050 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:04.185934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b4356e-92a2-4947-b017-168021960dd2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:04.188269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:04.189136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:04.189446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:04.189719 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] PATH_INFO: `/v3/projects/d56a33789b6148499aec6df72ce24639` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:04.190953 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=d56a33789b6148499aec6df72ce24639)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:04.193146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:04.198495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 929/1872] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:04 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:04.199938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2dc9-c508-4281-b080-130c7bcad958 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:04.200323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2dc9-c508-4281-b080-130c7bcad958 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:04.200696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2dc9-c508-4281-b080-130c7bcad958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:04.234170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a87b2dc9-c508-4281-b080-130c7bcad958 None None] MFA Rules not processed for user `220e2813cbe04e35a9214a7191a6fc87`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:04.235792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a87b2dc9-c508-4281-b080-130c7bcad958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:04.248965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:04.257628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd56a33789b6148499aec6df72ce24639', 'request_id': 'req-b62a3bb4-f3fe-4c91-9449-a623591384fa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.266597 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd56a33789b6148499aec6df72ce24639', 'request_id': 'req-b62a3bb4-f3fe-4c91-9449-a623591384fa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.275630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd56a33789b6148499aec6df72ce24639', 'request_id': 'req-b62a3bb4-f3fe-4c91-9449-a623591384fa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.322656 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] The token cache is being invalidate because project d56a33789b6148499aec6df72ce24639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:04.322868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.323595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.328812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 944/1873] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:04 2022] DELETE /identity/v3/projects/d56a33789b6148499aec6df72ce24639 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:04.328812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:04.328812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:04.343634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 930/1874] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:04.344212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:04.344882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b2dc9-c508-4281-b080-130c7bcad958 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:04.421880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b2dc9-c508-4281-b080-130c7bcad958 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:04.427643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992740ae-1cd5-45fa-aa8d-2e5ba42583f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:04.428835 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992740ae-1cd5-45fa-aa8d-2e5ba42583f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:04.429182 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992740ae-1cd5-45fa-aa8d-2e5ba42583f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:04.429566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992740ae-1cd5-45fa-aa8d-2e5ba42583f6 admin admin] PATH_INFO: `/v3/projects/e890d6cd2b5d478bbf3d12d6c0eaeacd/users/8ab2b2caa5b946ffa73d5a656ce4e2c7/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:04.442617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a3bb4-f3fe-4c91-9449-a623591384fa admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:04.447909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:04.448573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:04.448891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:04.449174 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] PATH_INFO: `/v3/projects/9ddcd66f0c494d1c990009f55866b4a5` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:04.450646 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ddcd66f0c494d1c990009f55866b4a5)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:04.453049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:04.459572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992740ae-1cd5-45fa-aa8d-2e5ba42583f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e890d6cd2b5d478bbf3d12d6c0eaeacd, user_id=8ab2b2caa5b946ffa73d5a656ce4e2c7, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:04.463497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992740ae-1cd5-45fa-aa8d-2e5ba42583f6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:04.487051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 931/1875] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:04 2022] PUT /identity/v3/projects/e890d6cd2b5d478bbf3d12d6c0eaeacd/users/8ab2b2caa5b946ffa73d5a656ce4e2c7/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:04.489275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992740ae-1cd5-45fa-aa8d-2e5ba42583f6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:04.494989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-992740ae-1cd5-45fa-aa8d-2e5ba42583f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:04.533063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ddcd66f0c494d1c990009f55866b4a5', 'request_id': 'req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.547231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ddcd66f0c494d1c990009f55866b4a5', 'request_id': 'req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.561485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ddcd66f0c494d1c990009f55866b4a5', 'request_id': 'req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.590706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] The token cache is being invalidate because project 9ddcd66f0c494d1c990009f55866b4a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:04.591149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.592481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.596293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 945/1876] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:04 2022] DELETE /identity/v3/projects/9ddcd66f0c494d1c990009f55866b4a5 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:04.598067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:04.601186 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:04.635583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992740ae-1cd5-45fa-aa8d-2e5ba42583f6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:04.676118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d1ee10-7420-46cd-9d5d-f1d94f3e654c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:04.680509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c7a93-10fc-4de1-bbe6-6b654e7bd93c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:04.681392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c7a93-10fc-4de1-bbe6-6b654e7bd93c service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:04.681778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c7a93-10fc-4de1-bbe6-6b654e7bd93c service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:04.682374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c7a93-10fc-4de1-bbe6-6b654e7bd93c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:04.685108 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e07c7a93-10fc-4de1-bbe6-6b654e7bd93c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:04.690747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:04.715367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a47c1f-15d4-426b-8955-bcbefe4e2922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:04.716222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a47c1f-15d4-426b-8955-bcbefe4e2922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:04.716605 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a47c1f-15d4-426b-8955-bcbefe4e2922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:04.716976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a47c1f-15d4-426b-8955-bcbefe4e2922 admin admin] PATH_INFO: `/v3/users/cf460825da1a4be194c6b4a15d1d1b3f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:04.720995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a47c1f-15d4-426b-8955-bcbefe4e2922 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf460825da1a4be194c6b4a15d1d1b3f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:04.723609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a47c1f-15d4-426b-8955-bcbefe4e2922 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:04.778846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:04.785060 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c7a93-10fc-4de1-bbe6-6b654e7bd93c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:04.788614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c7a93-10fc-4de1-bbe6-6b654e7bd93c service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:04.791458 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-46a47c1f-15d4-426b-8955-bcbefe4e2922 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf460825da1a4be194c6b4a15d1d1b3f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.792438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-46a47c1f-15d4-426b-8955-bcbefe4e2922 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf460825da1a4be194c6b4a15d1d1b3f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.804089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 946/1877] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:04.805400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733f884-a595-43d7-9c97-8d45e7df38f1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:04.805688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733f884-a595-43d7-9c97-8d45e7df38f1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:04.805967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8733f884-a595-43d7-9c97-8d45e7df38f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:04.814561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-46a47c1f-15d4-426b-8955-bcbefe4e2922 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf460825da1a4be194c6b4a15d1d1b3f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.825503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-46a47c1f-15d4-426b-8955-bcbefe4e2922 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf460825da1a4be194c6b4a15d1d1b3f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.841651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-46a47c1f-15d4-426b-8955-bcbefe4e2922 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf460825da1a4be194c6b4a15d1d1b3f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:04.844261 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8733f884-a595-43d7-9c97-8d45e7df38f1 None None] MFA Rules not processed for user `8ab2b2caa5b946ffa73d5a656ce4e2c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:04.845534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8733f884-a595-43d7-9c97-8d45e7df38f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:04.852162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 932/1878] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:04 2022] DELETE /identity/v3/users/cf460825da1a4be194c6b4a15d1d1b3f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:04.852162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ff3cc-94ee-47fd-8d0e-71c1ea8a8db8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:04.852162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ff3cc-94ee-47fd-8d0e-71c1ea8a8db8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:04.852162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ff3cc-94ee-47fd-8d0e-71c1ea8a8db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:04.942068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2c0ff3cc-94ee-47fd-8d0e-71c1ea8a8db8 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:04.944828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2c0ff3cc-94ee-47fd-8d0e-71c1ea8a8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:04.947119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 947/1879] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:04 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:04.948127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733f884-a595-43d7-9c97-8d45e7df38f1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:04.950306 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8733f884-a595-43d7-9c97-8d45e7df38f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:04.968073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8733f884-a595-43d7-9c97-8d45e7df38f1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.023173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 933/1880] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:05.024292 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ff3cc-94ee-47fd-8d0e-71c1ea8a8db8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.025802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2c0ff3cc-94ee-47fd-8d0e-71c1ea8a8db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:05.043304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0ff3cc-94ee-47fd-8d0e-71c1ea8a8db8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.050817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a754ed-eab9-4c0a-96c0-726cf46a8148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.051695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a754ed-eab9-4c0a-96c0-726cf46a8148 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.052236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a754ed-eab9-4c0a-96c0-726cf46a8148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.052806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a754ed-eab9-4c0a-96c0-726cf46a8148 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.053712 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.054878 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a754ed-eab9-4c0a-96c0-726cf46a8148 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.055042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.055674 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.056119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] PATH_INFO: `/v3/users/220e2813cbe04e35a9214a7191a6fc87` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.057089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a754ed-eab9-4c0a-96c0-726cf46a8148 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.057753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=220e2813cbe04e35a9214a7191a6fc87)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.060117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.120416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 934/1881] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:05 2022] POST /identity/v3/projects => generated 375 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:05.130401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac302bd4-01ec-42ef-9dc4-fca73db0fe16 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.130886 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac302bd4-01ec-42ef-9dc4-fca73db0fe16 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.131165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac302bd4-01ec-42ef-9dc4-fca73db0fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.131282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '220e2813cbe04e35a9214a7191a6fc87'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:05.142450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '220e2813cbe04e35a9214a7191a6fc87'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:05.154445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ac302bd4-01ec-42ef-9dc4-fca73db0fe16 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:05.155829 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ac302bd4-01ec-42ef-9dc4-fca73db0fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:05.160927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '220e2813cbe04e35a9214a7191a6fc87'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:05.162470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '220e2813cbe04e35a9214a7191a6fc87'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:05.172021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '220e2813cbe04e35a9214a7191a6fc87'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:05.181563 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 948/1882] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:04 2022] DELETE /identity/v3/users/220e2813cbe04e35a9214a7191a6fc87 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:05.182367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.183810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:05.190682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:05.226031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:05.271545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 935/1883] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:05.273246 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd06532-ac31-4050-b780-8092f2e4e430 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.273585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd06532-ac31-4050-b780-8092f2e4e430 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.273893 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd06532-ac31-4050-b780-8092f2e4e430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.294196 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ebd06532-ac31-4050-b780-8092f2e4e430 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:05.295786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ebd06532-ac31-4050-b780-8092f2e4e430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:05.296119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43d6f0a-4681-46c8-b6cb-2927891010e4 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.305987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccf27c-e3da-414d-8bf0-8e8e74f9dd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.306796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccf27c-e3da-414d-8bf0-8e8e74f9dd6b admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.307253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccf27c-e3da-414d-8bf0-8e8e74f9dd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.307567 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ccf27c-e3da-414d-8bf0-8e8e74f9dd6b admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.308772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccf27c-e3da-414d-8bf0-8e8e74f9dd6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.313396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 936/1884] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:05.313532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ccf27c-e3da-414d-8bf0-8e8e74f9dd6b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.313612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd06532-ac31-4050-b780-8092f2e4e430 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.313612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ebd06532-ac31-4050-b780-8092f2e4e430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:05.325993 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd06532-ac31-4050-b780-8092f2e4e430 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.331366 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.332255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.332255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.332530 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] PATH_INFO: `/v3/projects/6cd0d29996d0472aa9879dc9b50e33c0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.334040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cd0d29996d0472aa9879dc9b50e33c0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.336326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.345348 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 949/1885] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:05 2022] POST /identity/v3/users => generated 294 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:05.346019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccf27c-e3da-414d-8bf0-8e8e74f9dd6b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.356779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ccf27c-e3da-414d-8bf0-8e8e74f9dd6b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.361868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bece1c-3fbb-4484-9d23-d405fb5dd7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.362526 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bece1c-3fbb-4484-9d23-d405fb5dd7a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.362840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bece1c-3fbb-4484-9d23-d405fb5dd7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.363173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bece1c-3fbb-4484-9d23-d405fb5dd7a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.364222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bece1c-3fbb-4484-9d23-d405fb5dd7a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:05.364582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bece1c-3fbb-4484-9d23-d405fb5dd7a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.366404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bece1c-3fbb-4484-9d23-d405fb5dd7a2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.378976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 950/1886] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:05.379764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bece1c-3fbb-4484-9d23-d405fb5dd7a2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.382589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-85bece1c-3fbb-4484-9d23-d405fb5dd7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:05.383386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cd0d29996d0472aa9879dc9b50e33c0', 'request_id': 'req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:05.389565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cd0d29996d0472aa9879dc9b50e33c0', 'request_id': 'req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:05.397555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cd0d29996d0472aa9879dc9b50e33c0', 'request_id': 'req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:05.409061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] The token cache is being invalidate because project 6cd0d29996d0472aa9879dc9b50e33c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:05.409380 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:05.410237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:05.411651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 937/1887] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:05 2022] DELETE /identity/v3/projects/6cd0d29996d0472aa9879dc9b50e33c0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:05.412438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.413755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:05.456589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bece1c-3fbb-4484-9d23-d405fb5dd7a2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.486171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9d5d1e-e517-4e61-980c-f6dd844ce7eb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.491220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c79369-1603-462e-a393-15b241a79260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.491833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c79369-1603-462e-a393-15b241a79260 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.492107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c79369-1603-462e-a393-15b241a79260 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.492404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c79369-1603-462e-a393-15b241a79260 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.493087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c79369-1603-462e-a393-15b241a79260 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.494717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c79369-1603-462e-a393-15b241a79260 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.505139 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 938/1888] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:05.505937 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c79369-1603-462e-a393-15b241a79260 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.506293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0d0720-94d7-46f7-9f20-0b84833e9ae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.506867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d0720-94d7-46f7-9f20-0b84833e9ae9 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.507154 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d0720-94d7-46f7-9f20-0b84833e9ae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.507425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0d0720-94d7-46f7-9f20-0b84833e9ae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.507629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-29c79369-1603-462e-a393-15b241a79260 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:05.509478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7d0d0720-94d7-46f7-9f20-0b84833e9ae9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:05.521645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c79369-1603-462e-a393-15b241a79260 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.523936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d0720-94d7-46f7-9f20-0b84833e9ae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.525430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0d0720-94d7-46f7-9f20-0b84833e9ae9 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.526531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b7f06-465f-42ed-bfc0-25502949ee5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.527303 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b7f06-465f-42ed-bfc0-25502949ee5f admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.527654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b7f06-465f-42ed-bfc0-25502949ee5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.527999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b7f06-465f-42ed-bfc0-25502949ee5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.528669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b7f06-465f-42ed-bfc0-25502949ee5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.530646 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5b7f06-465f-42ed-bfc0-25502949ee5f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.535335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 951/1889] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:05.536593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ebf2f-97dc-4028-b387-8373b9101ebb None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.536900 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ebf2f-97dc-4028-b387-8373b9101ebb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.537368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490ebf2f-97dc-4028-b387-8373b9101ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.557919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-490ebf2f-97dc-4028-b387-8373b9101ebb None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:05.559647 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-490ebf2f-97dc-4028-b387-8373b9101ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:05.565718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 939/1890] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:05 2022] POST /identity/v3/projects => generated 367 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:05.566160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b7f06-465f-42ed-bfc0-25502949ee5f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.576687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 952/1891] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:05.576687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ebf2f-97dc-4028-b387-8373b9101ebb None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.588662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490ebf2f-97dc-4028-b387-8373b9101ebb None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.605226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:05.625113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:05.656126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5b7f06-465f-42ed-bfc0-25502949ee5f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.661565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756283a-bd2b-4687-a0d4-0255c62719cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.662581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756283a-bd2b-4687-a0d4-0255c62719cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.662892 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e5b35-bae5-4004-a4b9-32029a872f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.663028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756283a-bd2b-4687-a0d4-0255c62719cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.663170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d756283a-bd2b-4687-a0d4-0255c62719cd admin admin] PATH_INFO: `/v3/projects/b6b4a5cbbf484b00b20febc9e6553364/users/a4ff3d10d4fb4f95870aea379aa618ca/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.663518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5b35-bae5-4004-a4b9-32029a872f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.663803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5b35-bae5-4004-a4b9-32029a872f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.664077 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e5b35-bae5-4004-a4b9-32029a872f36 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.664748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e5b35-bae5-4004-a4b9-32029a872f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.666740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e5b35-bae5-4004-a4b9-32029a872f36 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.692577 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756283a-bd2b-4687-a0d4-0255c62719cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b4a5cbbf484b00b20febc9e6553364, user_id=a4ff3d10d4fb4f95870aea379aa618ca, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.695239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 953/1892] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:05 2022] POST /identity/v3/users => generated 284 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:05.696572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430491-4389-4fbb-abbc-6390c4bc66ea None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.696893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430491-4389-4fbb-abbc-6390c4bc66ea None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.697168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc430491-4389-4fbb-abbc-6390c4bc66ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.698868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d756283a-bd2b-4687-a0d4-0255c62719cd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.722277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 940/1893] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:05 2022] PUT /identity/v3/projects/b6b4a5cbbf484b00b20febc9e6553364/users/a4ff3d10d4fb4f95870aea379aa618ca/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:05.723155 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756283a-bd2b-4687-a0d4-0255c62719cd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.726546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fc430491-4389-4fbb-abbc-6390c4bc66ea None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:05.728248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fc430491-4389-4fbb-abbc-6390c4bc66ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:05.793337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d756283a-bd2b-4687-a0d4-0255c62719cd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.798263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6741706-4304-4248-a681-f04acaeede33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.799069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 954/1894] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:05.799191 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6741706-4304-4248-a681-f04acaeede33 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.799278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6741706-4304-4248-a681-f04acaeede33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.799577 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6741706-4304-4248-a681-f04acaeede33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.800513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6741706-4304-4248-a681-f04acaeede33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.802445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6741706-4304-4248-a681-f04acaeede33 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.803890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430491-4389-4fbb-abbc-6390c4bc66ea None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.813863 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 941/1895] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:05.815573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc430491-4389-4fbb-abbc-6390c4bc66ea None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.817265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6741706-4304-4248-a681-f04acaeede33 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.821936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd79fd-d7ec-4bdf-b805-f4ac42809e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.822601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd79fd-d7ec-4bdf-b805-f4ac42809e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.822958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd79fd-d7ec-4bdf-b805-f4ac42809e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.823234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dd79fd-d7ec-4bdf-b805-f4ac42809e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.824102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd79fd-d7ec-4bdf-b805-f4ac42809e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.825784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dd79fd-d7ec-4bdf-b805-f4ac42809e58 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.827757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6741706-4304-4248-a681-f04acaeede33 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.833400 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525a4b3-64d8-4f3d-a730-6353268c9bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.834165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525a4b3-64d8-4f3d-a730-6353268c9bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.834449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525a4b3-64d8-4f3d-a730-6353268c9bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.835148 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525a4b3-64d8-4f3d-a730-6353268c9bb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.835559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525a4b3-64d8-4f3d-a730-6353268c9bb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:05.835868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525a4b3-64d8-4f3d-a730-6353268c9bb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.837609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525a4b3-64d8-4f3d-a730-6353268c9bb0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.837976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 955/1896] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:05.839111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd79fd-d7ec-4bdf-b805-f4ac42809e58 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.850443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dd79fd-d7ec-4bdf-b805-f4ac42809e58 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.852370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 942/1897] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:05.853077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525a4b3-64d8-4f3d-a730-6353268c9bb0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.859889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36d359-5a36-467a-84b1-aa75f4181ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.860521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36d359-5a36-467a-84b1-aa75f4181ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.860806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36d359-5a36-467a-84b1-aa75f4181ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.861334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de36d359-5a36-467a-84b1-aa75f4181ecc admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.861877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36d359-5a36-467a-84b1-aa75f4181ecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.863734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de36d359-5a36-467a-84b1-aa75f4181ecc admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.866128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525a4b3-64d8-4f3d-a730-6353268c9bb0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.871798 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beca8c7-ba40-4c9f-98e5-283d16213337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.872585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beca8c7-ba40-4c9f-98e5-283d16213337 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.872872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beca8c7-ba40-4c9f-98e5-283d16213337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.873140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beca8c7-ba40-4c9f-98e5-283d16213337 admin admin] PATH_INFO: `/v3/projects/b6b4a5cbbf484b00b20febc9e6553364/users/a4ff3d10d4fb4f95870aea379aa618ca/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.878591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 956/1898] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:05.878591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36d359-5a36-467a-84b1-aa75f4181ecc admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.878908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beca8c7-ba40-4c9f-98e5-283d16213337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6b4a5cbbf484b00b20febc9e6553364, user_id=a4ff3d10d4fb4f95870aea379aa618ca, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.880822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beca8c7-ba40-4c9f-98e5-283d16213337 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.893180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 943/1899] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:05 2022] PUT /identity/v3/projects/b6b4a5cbbf484b00b20febc9e6553364/users/a4ff3d10d4fb4f95870aea379aa618ca/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:05.894072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beca8c7-ba40-4c9f-98e5-283d16213337 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:05.909962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de36d359-5a36-467a-84b1-aa75f4181ecc admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.969902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beca8c7-ba40-4c9f-98e5-283d16213337 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:05.974677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc9b92-ba63-46ea-b6c8-4fefb81e8ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.975346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc9b92-ba63-46ea-b6c8-4fefb81e8ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.975630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc9b92-ba63-46ea-b6c8-4fefb81e8ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.975911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc9b92-ba63-46ea-b6c8-4fefb81e8ddf admin admin] PATH_INFO: `/v3/projects/fb197f129a394624bb4df6ac611cf579/users/5e6aeda94e0340bcbd100df94f7753d5/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.979484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e7d43-62e4-49cd-9721-ef0cde141c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:05.979484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e7d43-62e4-49cd-9721-ef0cde141c0a admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:05.980026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e7d43-62e4-49cd-9721-ef0cde141c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:05.980026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51e7d43-62e4-49cd-9721-ef0cde141c0a admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:05.981270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e7d43-62e4-49cd-9721-ef0cde141c0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.983282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51e7d43-62e4-49cd-9721-ef0cde141c0a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:05.991765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc9b92-ba63-46ea-b6c8-4fefb81e8ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb197f129a394624bb4df6ac611cf579, user_id=5e6aeda94e0340bcbd100df94f7753d5, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:05.994478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc9b92-ba63-46ea-b6c8-4fefb81e8ddf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.008691 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 944/1900] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:05 2022] PUT /identity/v3/projects/fb197f129a394624bb4df6ac611cf579/users/5e6aeda94e0340bcbd100df94f7753d5/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:06.010028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ae90-89a8-4254-9bb7-7994e93c20c3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.010311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ae90-89a8-4254-9bb7-7994e93c20c3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.010581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134ae90-89a8-4254-9bb7-7994e93c20c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.010977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 957/1901] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:05 2022] POST /identity/v3/projects => generated 363 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:06.011943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e7d43-62e4-49cd-9721-ef0cde141c0a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.013637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b51e7d43-62e4-49cd-9721-ef0cde141c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:06.020670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:06.044676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5134ae90-89a8-4254-9bb7-7994e93c20c3 None None] MFA Rules not processed for user `a4ff3d10d4fb4f95870aea379aa618ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:06.045843 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5134ae90-89a8-4254-9bb7-7994e93c20c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:06.047773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:06.088734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51e7d43-62e4-49cd-9721-ef0cde141c0a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.094187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.094826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.095105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.095377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] PATH_INFO: `/v3/projects/4c8e016670c14922804c96e783c2ee01` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.096602 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c8e016670c14922804c96e783c2ee01)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.098750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.115867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 945/1902] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:06 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:06.119856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7690f-a4bf-4569-8992-65e47f8b9992 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.119856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7690f-a4bf-4569-8992-65e47f8b9992 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.119856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b7690f-a4bf-4569-8992-65e47f8b9992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.147437 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-81b7690f-a4bf-4569-8992-65e47f8b9992 None None] MFA Rules not processed for user `5e6aeda94e0340bcbd100df94f7753d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:06.149363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-81b7690f-a4bf-4569-8992-65e47f8b9992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:06.158417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c8e016670c14922804c96e783c2ee01', 'request_id': 'req-dee88667-faf8-4cc9-b68c-9186aeae8844'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:06.165087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c8e016670c14922804c96e783c2ee01', 'request_id': 'req-dee88667-faf8-4cc9-b68c-9186aeae8844'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:06.175236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c8e016670c14922804c96e783c2ee01', 'request_id': 'req-dee88667-faf8-4cc9-b68c-9186aeae8844'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:06.193938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] The token cache is being invalidate because project 4c8e016670c14922804c96e783c2ee01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:06.194220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:06.195256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:06.197206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 958/1903] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:06 2022] DELETE /identity/v3/projects/4c8e016670c14922804c96e783c2ee01 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:06.198321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.199970 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:06.234914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 946/1904] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:06 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:06.234914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7690f-a4bf-4569-8992-65e47f8b9992 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.238723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-81b7690f-a4bf-4569-8992-65e47f8b9992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:06.279272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee88667-faf8-4cc9-b68c-9186aeae8844 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.285368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220c771-b032-4b31-b1e6-d7bca7bfcb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.286498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220c771-b032-4b31-b1e6-d7bca7bfcb89 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.286778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220c771-b032-4b31-b1e6-d7bca7bfcb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.287199 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220c771-b032-4b31-b1e6-d7bca7bfcb89 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.288089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220c771-b032-4b31-b1e6-d7bca7bfcb89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.290353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220c771-b032-4b31-b1e6-d7bca7bfcb89 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.319717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b7690f-a4bf-4569-8992-65e47f8b9992 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.324928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 959/1905] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:06 2022] POST /identity/v3/users => generated 282 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:06.324928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41a945-0085-4ad8-b3ba-12636f365a9a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.324928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41a945-0085-4ad8-b3ba-12636f365a9a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.324928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb41a945-0085-4ad8-b3ba-12636f365a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.331719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54437b44-31b4-40bd-8d4f-19ac98a239d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.334378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437b44-31b4-40bd-8d4f-19ac98a239d7 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.335100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437b44-31b4-40bd-8d4f-19ac98a239d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.335989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54437b44-31b4-40bd-8d4f-19ac98a239d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.339176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-54437b44-31b4-40bd-8d4f-19ac98a239d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:06.354603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-bb41a945-0085-4ad8-b3ba-12636f365a9a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:06.356839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bb41a945-0085-4ad8-b3ba-12636f365a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:06.367093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 960/1906] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:06.374840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41a945-0085-4ad8-b3ba-12636f365a9a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.376717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bb41a945-0085-4ad8-b3ba-12636f365a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:06.383139 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:06.393594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb41a945-0085-4ad8-b3ba-12636f365a9a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.399898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eff689-2d1f-4485-b62e-c2cfb8f9bc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.400881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eff689-2d1f-4485-b62e-c2cfb8f9bc86 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.401167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eff689-2d1f-4485-b62e-c2cfb8f9bc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.401472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eff689-2d1f-4485-b62e-c2cfb8f9bc86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.402747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eff689-2d1f-4485-b62e-c2cfb8f9bc86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.405023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eff689-2d1f-4485-b62e-c2cfb8f9bc86 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.423723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54437b44-31b4-40bd-8d4f-19ac98a239d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.425607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54437b44-31b4-40bd-8d4f-19ac98a239d7 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.447145 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 961/1907] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:06 2022] POST /identity/v3/projects => generated 363 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:06.448509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eff689-2d1f-4485-b62e-c2cfb8f9bc86 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.453617 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 947/1908] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:06.455407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36188c-efd1-42ff-bd4b-946cb90c9cfe None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.455942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36188c-efd1-42ff-bd4b-946cb90c9cfe None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.456468 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36188c-efd1-42ff-bd4b-946cb90c9cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.468641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:06.484082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4f36188c-efd1-42ff-bd4b-946cb90c9cfe None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:06.486181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4f36188c-efd1-42ff-bd4b-946cb90c9cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:06.526228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eff689-2d1f-4485-b62e-c2cfb8f9bc86 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.534239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbad4-075c-462d-8725-0c453c641144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.535315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbad4-075c-462d-8725-0c453c641144 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.535837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbad4-075c-462d-8725-0c453c641144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.536118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cbad4-075c-462d-8725-0c453c641144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.536833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cbad4-075c-462d-8725-0c453c641144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.538713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7cbad4-075c-462d-8725-0c453c641144 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.565739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 962/1909] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:06.565739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbad4-075c-462d-8725-0c453c641144 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.574314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cbad4-075c-462d-8725-0c453c641144 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.578727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 948/1910] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:06.579533 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36188c-efd1-42ff-bd4b-946cb90c9cfe None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.580365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1db4b-8104-450b-91bf-bccbee2f681d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.581173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1db4b-8104-450b-91bf-bccbee2f681d admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.581771 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1db4b-8104-450b-91bf-bccbee2f681d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.582751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1db4b-8104-450b-91bf-bccbee2f681d admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.583602 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1db4b-8104-450b-91bf-bccbee2f681d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.585671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1db4b-8104-450b-91bf-bccbee2f681d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.590350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f36188c-efd1-42ff-bd4b-946cb90c9cfe None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.595141 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10f6a-2431-445b-bc5e-59569d6bc8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.595838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10f6a-2431-445b-bc5e-59569d6bc8f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.596198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10f6a-2431-445b-bc5e-59569d6bc8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.596532 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da10f6a-2431-445b-bc5e-59569d6bc8f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.597331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da10f6a-2431-445b-bc5e-59569d6bc8f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.598991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da10f6a-2431-445b-bc5e-59569d6bc8f0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.615465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 949/1911] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:06.615465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10f6a-2431-445b-bc5e-59569d6bc8f0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.615788 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 963/1912] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:06 2022] POST /identity/v3/users => generated 288 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:06.617743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1db4b-8104-450b-91bf-bccbee2f681d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.621889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da10f6a-2431-445b-bc5e-59569d6bc8f0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.627588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1db4b-8104-450b-91bf-bccbee2f681d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.627731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70094-60ab-470d-85de-033519259eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.628200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70094-60ab-470d-85de-033519259eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.628480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70094-60ab-470d-85de-033519259eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.628751 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a70094-60ab-470d-85de-033519259eb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.629487 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a70094-60ab-470d-85de-033519259eb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:06.629846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a70094-60ab-470d-85de-033519259eb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.631541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a70094-60ab-470d-85de-033519259eb9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.633438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cdebd-e86a-420b-b828-17a99556b21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.634095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cdebd-e86a-420b-b828-17a99556b21c admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.634378 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cdebd-e86a-420b-b828-17a99556b21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.634651 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268cdebd-e86a-420b-b828-17a99556b21c admin admin] PATH_INFO: `/v3/projects/78611e8534de4b0a97d4cc9c192bdbf0/users/c756c89954c84ca7ac75a49a53621f32/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.646019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 950/1913] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:06.647414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70094-60ab-470d-85de-033519259eb9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.656259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cdebd-e86a-420b-b828-17a99556b21c admin admin] RBAC: Authorizing `identity:create_grant(project_id=78611e8534de4b0a97d4cc9c192bdbf0, user_id=c756c89954c84ca7ac75a49a53621f32, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.659619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a70094-60ab-470d-85de-033519259eb9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.660178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268cdebd-e86a-420b-b828-17a99556b21c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.665711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251f2a0-c1f0-49bf-af58-1b7aac9a7140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.666045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251f2a0-c1f0-49bf-af58-1b7aac9a7140 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.666324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251f2a0-c1f0-49bf-af58-1b7aac9a7140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.666593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251f2a0-c1f0-49bf-af58-1b7aac9a7140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.667641 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251f2a0-c1f0-49bf-af58-1b7aac9a7140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.669331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251f2a0-c1f0-49bf-af58-1b7aac9a7140 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.682004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 951/1914] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:06.682968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251f2a0-c1f0-49bf-af58-1b7aac9a7140 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.693884 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251f2a0-c1f0-49bf-af58-1b7aac9a7140 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.701844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002259d-4b62-479a-b591-acb03c3d8634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.702470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002259d-4b62-479a-b591-acb03c3d8634 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.702747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002259d-4b62-479a-b591-acb03c3d8634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.703016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2002259d-4b62-479a-b591-acb03c3d8634 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.703687 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002259d-4b62-479a-b591-acb03c3d8634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.707041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2002259d-4b62-479a-b591-acb03c3d8634 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.804639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 964/1915] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:06 2022] PUT /identity/v3/projects/78611e8534de4b0a97d4cc9c192bdbf0/users/c756c89954c84ca7ac75a49a53621f32/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:06.804639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cdebd-e86a-420b-b828-17a99556b21c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.805250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 952/1916] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:06 2022] POST /identity/v3/projects => generated 375 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:06.805250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002259d-4b62-479a-b591-acb03c3d8634 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.881772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2002259d-4b62-479a-b591-acb03c3d8634 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.887938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ceb9ae-7b10-4691-9032-6f079cf61fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.888834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceb9ae-7b10-4691-9032-6f079cf61fa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.889142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceb9ae-7b10-4691-9032-6f079cf61fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.889423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ceb9ae-7b10-4691-9032-6f079cf61fa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.890206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ceb9ae-7b10-4691-9032-6f079cf61fa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.890641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268cdebd-e86a-420b-b828-17a99556b21c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:06.892183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ceb9ae-7b10-4691-9032-6f079cf61fa9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.895639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea92cc6-999f-478c-8d70-b2d57dd81254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:06.896312 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92cc6-999f-478c-8d70-b2d57dd81254 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.896591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92cc6-999f-478c-8d70-b2d57dd81254 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.896866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea92cc6-999f-478c-8d70-b2d57dd81254 admin admin] PATH_INFO: `/v3/projects/98aa73645c75407d94a0e484e1cecb47/users/843b3f45519d41728146ac67669b9d07/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.916172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea92cc6-999f-478c-8d70-b2d57dd81254 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98aa73645c75407d94a0e484e1cecb47, user_id=843b3f45519d41728146ac67669b9d07, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:06.919029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 953/1917] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:06 2022] POST /identity/v3/users => generated 288 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:04:06.921451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ccd45-680e-42cf-aaa3-fdbb6dc615fa None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:06.921451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ccd45-680e-42cf-aaa3-fdbb6dc615fa None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:06.921451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ccd45-680e-42cf-aaa3-fdbb6dc615fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:06.922926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea92cc6-999f-478c-8d70-b2d57dd81254 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:06.938343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:06.946829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 965/1918] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:06 2022] PUT /identity/v3/projects/98aa73645c75407d94a0e484e1cecb47/users/843b3f45519d41728146ac67669b9d07/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:06.948570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea92cc6-999f-478c-8d70-b2d57dd81254 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:06.957233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-403ccd45-680e-42cf-aaa3-fdbb6dc615fa None None] MFA Rules not processed for user `c756c89954c84ca7ac75a49a53621f32`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:06.959307 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-403ccd45-680e-42cf-aaa3-fdbb6dc615fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:07.012404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:07.023939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea92cc6-999f-478c-8d70-b2d57dd81254 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.030521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcefa7a-a17b-4fd6-8370-e99ae2d474ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.031210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcefa7a-a17b-4fd6-8370-e99ae2d474ef admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.031496 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcefa7a-a17b-4fd6-8370-e99ae2d474ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.031815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcefa7a-a17b-4fd6-8370-e99ae2d474ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.032667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcefa7a-a17b-4fd6-8370-e99ae2d474ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.034444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcefa7a-a17b-4fd6-8370-e99ae2d474ef admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.047909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 966/1919] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:07.047909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcefa7a-a17b-4fd6-8370-e99ae2d474ef admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.048657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 954/1920] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:07.049557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ccd45-680e-42cf-aaa3-fdbb6dc615fa None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.061170 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcefa7a-a17b-4fd6-8370-e99ae2d474ef admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.061363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ccd45-680e-42cf-aaa3-fdbb6dc615fa None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.066065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94006b1b-e6dd-4e1f-80bf-5e029f1c733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.066821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94006b1b-e6dd-4e1f-80bf-5e029f1c733d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.067169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94006b1b-e6dd-4e1f-80bf-5e029f1c733d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.067272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1756401-bea6-41fa-8053-1dbde3a9a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.067541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94006b1b-e6dd-4e1f-80bf-5e029f1c733d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.067803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1756401-bea6-41fa-8053-1dbde3a9a246 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.068370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94006b1b-e6dd-4e1f-80bf-5e029f1c733d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.068469 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1756401-bea6-41fa-8053-1dbde3a9a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.068721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1756401-bea6-41fa-8053-1dbde3a9a246 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.069740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1756401-bea6-41fa-8053-1dbde3a9a246 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.070269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94006b1b-e6dd-4e1f-80bf-5e029f1c733d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.071328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1756401-bea6-41fa-8053-1dbde3a9a246 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.083569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 955/1921] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:07.084266 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 967/1922] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:07.090350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94006b1b-e6dd-4e1f-80bf-5e029f1c733d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.090498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1756401-bea6-41fa-8053-1dbde3a9a246 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.100239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94006b1b-e6dd-4e1f-80bf-5e029f1c733d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.101229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1756401-bea6-41fa-8053-1dbde3a9a246 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.105382 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071c7e2e-39b0-4b85-87fa-9fa793530184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.106019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7e2e-39b0-4b85-87fa-9fa793530184 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.106235 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f28f1-7758-410c-b2e5-11d9e6d56bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.106346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7e2e-39b0-4b85-87fa-9fa793530184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.106536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071c7e2e-39b0-4b85-87fa-9fa793530184 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.107067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f28f1-7758-410c-b2e5-11d9e6d56bc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.107217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c7e2e-39b0-4b85-87fa-9fa793530184 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.107471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f28f1-7758-410c-b2e5-11d9e6d56bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.107867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7f28f1-7758-410c-b2e5-11d9e6d56bc9 admin admin] PATH_INFO: `/v3/projects/98aa73645c75407d94a0e484e1cecb47/users/843b3f45519d41728146ac67669b9d07/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.109114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071c7e2e-39b0-4b85-87fa-9fa793530184 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.110178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f28f1-7758-410c-b2e5-11d9e6d56bc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98aa73645c75407d94a0e484e1cecb47, user_id=843b3f45519d41728146ac67669b9d07, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.112928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7f28f1-7758-410c-b2e5-11d9e6d56bc9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.127979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 968/1923] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:07 2022] PUT /identity/v3/projects/98aa73645c75407d94a0e484e1cecb47/users/843b3f45519d41728146ac67669b9d07/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:07.128836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f28f1-7758-410c-b2e5-11d9e6d56bc9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.147628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 956/1924] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:07 2022] POST /identity/v3/projects => generated 361 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:07.149009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b4ed-056d-4cdb-b1d1-90e87df59cee None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.149404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b4ed-056d-4cdb-b1d1-90e87df59cee None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.149740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d273b4ed-056d-4cdb-b1d1-90e87df59cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.178329 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d273b4ed-056d-4cdb-b1d1-90e87df59cee None None] MFA Rules not processed for user `843b3f45519d41728146ac67669b9d07`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:07.179542 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d273b4ed-056d-4cdb-b1d1-90e87df59cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:07.196199 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7f28f1-7758-410c-b2e5-11d9e6d56bc9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.250092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 957/1925] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:07 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:07.250907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273b4ed-056d-4cdb-b1d1-90e87df59cee None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.254127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53067-1589-4d90-8564-d652fe0e389b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.254844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53067-1589-4d90-8564-d652fe0e389b admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.255127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53067-1589-4d90-8564-d652fe0e389b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.255410 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f53067-1589-4d90-8564-d652fe0e389b admin admin] PATH_INFO: `/v3/projects/d42d57972cc14e34bdfa258d6f2deb67/users/da1d6d9da9834042abbb6b9c63129fea/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.260822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d273b4ed-056d-4cdb-b1d1-90e87df59cee None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.265406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d6a8b-dc0d-47b3-90b6-c17d8c1bd631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.266010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d6a8b-dc0d-47b3-90b6-c17d8c1bd631 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.266289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d6a8b-dc0d-47b3-90b6-c17d8c1bd631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.266560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d6a8b-dc0d-47b3-90b6-c17d8c1bd631 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.267218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d6a8b-dc0d-47b3-90b6-c17d8c1bd631 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.269148 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d6a8b-dc0d-47b3-90b6-c17d8c1bd631 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.272653 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f53067-1589-4d90-8564-d652fe0e389b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d42d57972cc14e34bdfa258d6f2deb67, user_id=da1d6d9da9834042abbb6b9c63129fea, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.275494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f53067-1589-4d90-8564-d652fe0e389b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.289526 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 969/1926] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:07 2022] PUT /identity/v3/projects/d42d57972cc14e34bdfa258d6f2deb67/users/da1d6d9da9834042abbb6b9c63129fea/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:07.290346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53067-1589-4d90-8564-d652fe0e389b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.300958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 958/1927] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:07 2022] POST /identity/v3/users => generated 287 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:07.302636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d4cbc-b0cd-451e-ac1b-9e2033d58260 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.302926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d4cbc-b0cd-451e-ac1b-9e2033d58260 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.303197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798d4cbc-b0cd-451e-ac1b-9e2033d58260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.334964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-798d4cbc-b0cd-451e-ac1b-9e2033d58260 None None] MFA Rules not processed for user `da1d6d9da9834042abbb6b9c63129fea`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:07.336132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-798d4cbc-b0cd-451e-ac1b-9e2033d58260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:07.357013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:07.358683 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f53067-1589-4d90-8564-d652fe0e389b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.363152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1037b-05d4-479a-95b0-b5b9428ec34f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.364060 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1037b-05d4-479a-95b0-b5b9428ec34f service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.364340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1037b-05d4-479a-95b0-b5b9428ec34f service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.364618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db1037b-05d4-479a-95b0-b5b9428ec34f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.375773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:07.415520 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 959/1928] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:07.416447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d4cbc-b0cd-451e-ac1b-9e2033d58260 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.454276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1037b-05d4-479a-95b0-b5b9428ec34f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.456582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db1037b-05d4-479a-95b0-b5b9428ec34f service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.481080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 970/1929] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:07 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:07.482252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1037b-05d4-479a-95b0-b5b9428ec34f service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.487037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6db1037b-05d4-479a-95b0-b5b9428ec34f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:07.512905 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db1037b-05d4-479a-95b0-b5b9428ec34f service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.529721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d77f8-680d-4a13-a80c-89c8247c86eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.529721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d77f8-680d-4a13-a80c-89c8247c86eb service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.529721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d77f8-680d-4a13-a80c-89c8247c86eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.529721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98d77f8-680d-4a13-a80c-89c8247c86eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.540165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d77f8-680d-4a13-a80c-89c8247c86eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.542025 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98d77f8-680d-4a13-a80c-89c8247c86eb service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.554647 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 971/1930] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:07.558282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798d4cbc-b0cd-451e-ac1b-9e2033d58260 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.574414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52dad0-d213-4771-a49f-3008bb31b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.575106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52dad0-d213-4771-a49f-3008bb31b4e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.575392 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52dad0-d213-4771-a49f-3008bb31b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.575664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce52dad0-d213-4771-a49f-3008bb31b4e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.576542 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52dad0-d213-4771-a49f-3008bb31b4e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.578193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce52dad0-d213-4771-a49f-3008bb31b4e4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.601400 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 960/1931] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:07.604968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d77f8-680d-4a13-a80c-89c8247c86eb service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.619919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98d77f8-680d-4a13-a80c-89c8247c86eb service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.632549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9501de6-3c42-4852-912f-9b652bfb3edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.632549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9501de6-3c42-4852-912f-9b652bfb3edd admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.632549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9501de6-3c42-4852-912f-9b652bfb3edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.632549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9501de6-3c42-4852-912f-9b652bfb3edd admin admin] PATH_INFO: `/v3/projects/dea8987888ce45af86f7d97cafa367f5/users/b5f608fcf3f740cbbf9a061fb2ff9a64/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.636599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52dad0-d213-4771-a49f-3008bb31b4e4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.648612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce52dad0-d213-4771-a49f-3008bb31b4e4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.654330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f19b2-e4ef-4112-a29f-748a4cbf87a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.655430 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f19b2-e4ef-4112-a29f-748a4cbf87a4 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.656420 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f19b2-e4ef-4112-a29f-748a4cbf87a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.656913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f19b2-e4ef-4112-a29f-748a4cbf87a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.662733 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9501de6-3c42-4852-912f-9b652bfb3edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea8987888ce45af86f7d97cafa367f5, user_id=b5f608fcf3f740cbbf9a061fb2ff9a64, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.665594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9501de6-3c42-4852-912f-9b652bfb3edd admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.696858 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 972/1932] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:07 2022] PUT /identity/v3/projects/dea8987888ce45af86f7d97cafa367f5/users/b5f608fcf3f740cbbf9a061fb2ff9a64/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:07.698570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9501de6-3c42-4852-912f-9b652bfb3edd admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.747804 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f19b2-e4ef-4112-a29f-748a4cbf87a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.750569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f19b2-e4ef-4112-a29f-748a4cbf87a4 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.768293 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 961/1933] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:07 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:04:07.836794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9501de6-3c42-4852-912f-9b652bfb3edd admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.844496 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bfa777-6cf9-4e47-97db-ddde3fad7672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.845142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfa777-6cf9-4e47-97db-ddde3fad7672 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.845725 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfa777-6cf9-4e47-97db-ddde3fad7672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.845979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bfa777-6cf9-4e47-97db-ddde3fad7672 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.846575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfa777-6cf9-4e47-97db-ddde3fad7672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.848458 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bfa777-6cf9-4e47-97db-ddde3fad7672 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.866399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 973/1934] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:07 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:07.871417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f19b2-e4ef-4112-a29f-748a4cbf87a4 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:07.887384 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f19b2-e4ef-4112-a29f-748a4cbf87a4 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:07.895787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efdc9e-d57d-4157-a6eb-f718f30c7537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:07.897613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efdc9e-d57d-4157-a6eb-f718f30c7537 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.897908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efdc9e-d57d-4157-a6eb-f718f30c7537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.898764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4efdc9e-d57d-4157-a6eb-f718f30c7537 admin admin] PATH_INFO: `/v3/projects/dea8987888ce45af86f7d97cafa367f5/users/b5f608fcf3f740cbbf9a061fb2ff9a64/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.903038 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efdc9e-d57d-4157-a6eb-f718f30c7537 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dea8987888ce45af86f7d97cafa367f5, user_id=b5f608fcf3f740cbbf9a061fb2ff9a64, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:07.906432 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4efdc9e-d57d-4157-a6eb-f718f30c7537 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:07.919761 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 962/1935] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:07 2022] PUT /identity/v3/projects/dea8987888ce45af86f7d97cafa367f5/users/b5f608fcf3f740cbbf9a061fb2ff9a64/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:07.929978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fb818-16da-454b-9021-4d12edba5f37 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:07.930268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fb818-16da-454b-9021-4d12edba5f37 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:07.930541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a43fb818-16da-454b-9021-4d12edba5f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:07.968449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a43fb818-16da-454b-9021-4d12edba5f37 None None] MFA Rules not processed for user `b5f608fcf3f740cbbf9a061fb2ff9a64`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:07.970128 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a43fb818-16da-454b-9021-4d12edba5f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:08.070549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:08.109633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 974/1936] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:07 2022] POST /identity/v3/auth/tokens => generated 3295 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:08.159608 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efdc9e-d57d-4157-a6eb-f718f30c7537 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:08.234451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:08.248189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4efdc9e-d57d-4157-a6eb-f718f30c7537 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:08.253239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e12176-2dcd-44f3-b0dd-66ae71475511 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:08.253908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e12176-2dcd-44f3-b0dd-66ae71475511 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:08.254317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e12176-2dcd-44f3-b0dd-66ae71475511 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:08.254593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e12176-2dcd-44f3-b0dd-66ae71475511 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:08.271873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e12176-2dcd-44f3-b0dd-66ae71475511 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:08.273762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e12176-2dcd-44f3-b0dd-66ae71475511 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:08.287293 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 963/1937] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:08 2022] GET /identity/v3/auth/tokens => generated 3295 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:08.746958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fb818-16da-454b-9021-4d12edba5f37 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:08.809175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a43fb818-16da-454b-9021-4d12edba5f37 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:08.813649 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:08.814279 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:08.814557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:08.814829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] PATH_INFO: `/v3/users/c756c89954c84ca7ac75a49a53621f32` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:08.815971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] RBAC: Authorizing `identity:delete_user(user_id=c756c89954c84ca7ac75a49a53621f32)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:08.817926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:08.865129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c756c89954c84ca7ac75a49a53621f32'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:08.873667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c756c89954c84ca7ac75a49a53621f32'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:08.886076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c756c89954c84ca7ac75a49a53621f32'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:08.886759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c756c89954c84ca7ac75a49a53621f32'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:08.894763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c756c89954c84ca7ac75a49a53621f32'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:08.901079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 975/1938] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:08 2022] DELETE /identity/v3/users/c756c89954c84ca7ac75a49a53621f32 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:08.905560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe2d0-34f1-4d5f-ada6-3702ca2a2464 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:08.905938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe2d0-34f1-4d5f-ada6-3702ca2a2464 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:08.906278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6defe2d0-34f1-4d5f-ada6-3702ca2a2464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:08.925820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6defe2d0-34f1-4d5f-ada6-3702ca2a2464 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:08.927030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6defe2d0-34f1-4d5f-ada6-3702ca2a2464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:08.993332 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 964/1939] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:09.018874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:09.020391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:09.084584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac62e56-1b4e-448a-8857-cc53a8f5257b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:09.088228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c345a-9820-4361-8fb7-aca0ff64a92c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:09.088869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c345a-9820-4361-8fb7-aca0ff64a92c service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:09.089147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c345a-9820-4361-8fb7-aca0ff64a92c service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:09.091428 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c345a-9820-4361-8fb7-aca0ff64a92c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:09.099620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c345a-9820-4361-8fb7-aca0ff64a92c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:09.101058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31c345a-9820-4361-8fb7-aca0ff64a92c service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:09.114513 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 976/1940] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:09.395487 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defe2d0-34f1-4d5f-ada6-3702ca2a2464 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:09.397260 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6defe2d0-34f1-4d5f-ada6-3702ca2a2464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:09.412653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6defe2d0-34f1-4d5f-ada6-3702ca2a2464 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:09.424355 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:09.424947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:09.425425 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:09.425719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] PATH_INFO: `/v3/projects/78611e8534de4b0a97d4cc9c192bdbf0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:09.428042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78611e8534de4b0a97d4cc9c192bdbf0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:09.432951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:09.507109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78611e8534de4b0a97d4cc9c192bdbf0', 'request_id': 'req-e651d187-5b59-4245-8c69-942c9e1685e4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:09.515931 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78611e8534de4b0a97d4cc9c192bdbf0', 'request_id': 'req-e651d187-5b59-4245-8c69-942c9e1685e4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:09.539203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78611e8534de4b0a97d4cc9c192bdbf0', 'request_id': 'req-e651d187-5b59-4245-8c69-942c9e1685e4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:09.560632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c345a-9820-4361-8fb7-aca0ff64a92c service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:09.562083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a31c345a-9820-4361-8fb7-aca0ff64a92c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:09.569100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] The token cache is being invalidate because project 78611e8534de4b0a97d4cc9c192bdbf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:09.569764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:09.571076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:09.579807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:09.584050 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 965/1941] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:09 2022] DELETE /identity/v3/projects/78611e8534de4b0a97d4cc9c192bdbf0 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:09.585888 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:09.587811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:09.663355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c345a-9820-4361-8fb7-aca0ff64a92c service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:09.680645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e651d187-5b59-4245-8c69-942c9e1685e4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:09.685988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:09.686626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:09.686905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:09.687175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] PATH_INFO: `/v3/users/b5f608fcf3f740cbbf9a061fb2ff9a64` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:09.688479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5f608fcf3f740cbbf9a061fb2ff9a64)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:09.690506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:09.703849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:09.729983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770b003f-a815-4b4b-8a61-8f670d8f2755 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:09.732055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b003f-a815-4b4b-8a61-8f670d8f2755 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:09.732549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b003f-a815-4b4b-8a61-8f670d8f2755 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:09.734108 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770b003f-a815-4b4b-8a61-8f670d8f2755 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:09.735745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-770b003f-a815-4b4b-8a61-8f670d8f2755 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:09.758885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5f608fcf3f740cbbf9a061fb2ff9a64'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:09.759621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5f608fcf3f740cbbf9a061fb2ff9a64'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:09.783311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5f608fcf3f740cbbf9a061fb2ff9a64'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:09.796811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5f608fcf3f740cbbf9a061fb2ff9a64'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:09.823040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5f608fcf3f740cbbf9a061fb2ff9a64'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:09.842551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 966/1942] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:09 2022] DELETE /identity/v3/users/b5f608fcf3f740cbbf9a061fb2ff9a64 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:09.883991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b003f-a815-4b4b-8a61-8f670d8f2755 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:09.887058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770b003f-a815-4b4b-8a61-8f670d8f2755 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:09.914018 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 977/1943] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:09 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:04:10.998367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:11.000194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:11.122388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5b5f1-ec05-4c3e-919e-e97bdb4b9815 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:11.137319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462f755c-1f30-47e0-8327-a83780751ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:11.137319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f755c-1f30-47e0-8327-a83780751ca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:11.137319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f755c-1f30-47e0-8327-a83780751ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:11.137319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462f755c-1f30-47e0-8327-a83780751ca7 admin admin] PATH_INFO: `/v3/projects/dea8987888ce45af86f7d97cafa367f5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:11.140640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f755c-1f30-47e0-8327-a83780751ca7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dea8987888ce45af86f7d97cafa367f5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:11.142587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462f755c-1f30-47e0-8327-a83780751ca7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:11.198022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-462f755c-1f30-47e0-8327-a83780751ca7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dea8987888ce45af86f7d97cafa367f5', 'request_id': 'req-462f755c-1f30-47e0-8327-a83780751ca7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:11.204239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-462f755c-1f30-47e0-8327-a83780751ca7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dea8987888ce45af86f7d97cafa367f5', 'request_id': 'req-462f755c-1f30-47e0-8327-a83780751ca7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:11.212202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-462f755c-1f30-47e0-8327-a83780751ca7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dea8987888ce45af86f7d97cafa367f5', 'request_id': 'req-462f755c-1f30-47e0-8327-a83780751ca7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:11.224266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-462f755c-1f30-47e0-8327-a83780751ca7 admin admin] The token cache is being invalidate because project dea8987888ce45af86f7d97cafa367f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:11.224461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-462f755c-1f30-47e0-8327-a83780751ca7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:11.225212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-462f755c-1f30-47e0-8327-a83780751ca7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:11.226802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 967/1944] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:10 2022] DELETE /identity/v3/projects/dea8987888ce45af86f7d97cafa367f5 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:11.231688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f73e5-3506-44f7-b258-37c73796f180 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:11.232144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f73e5-3506-44f7-b258-37c73796f180 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:11.232363 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f73e5-3506-44f7-b258-37c73796f180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:11.252765 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a40f73e5-3506-44f7-b258-37c73796f180 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:11.254213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a40f73e5-3506-44f7-b258-37c73796f180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:11.320877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 978/1945] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:11.330722 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdcb05-fc0a-48eb-8df6-5acd08d1c642 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:11.331122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdcb05-fc0a-48eb-8df6-5acd08d1c642 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:11.331372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bdcb05-fc0a-48eb-8df6-5acd08d1c642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:11.351523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a8bdcb05-fc0a-48eb-8df6-5acd08d1c642 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:11.352729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a8bdcb05-fc0a-48eb-8df6-5acd08d1c642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:11.361076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 968/1946] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:11.366223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f73e5-3506-44f7-b258-37c73796f180 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:11.376752 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f73e5-3506-44f7-b258-37c73796f180 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:11.385900 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029a1df-9167-4b69-8877-17265f602135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:11.387324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029a1df-9167-4b69-8877-17265f602135 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:11.387635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029a1df-9167-4b69-8877-17265f602135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:11.387908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e029a1df-9167-4b69-8877-17265f602135 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:11.388618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029a1df-9167-4b69-8877-17265f602135 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:11.389125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029a1df-9167-4b69-8877-17265f602135 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:11.390717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e029a1df-9167-4b69-8877-17265f602135 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:11.405356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 979/1947] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:11.409545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdcb05-fc0a-48eb-8df6-5acd08d1c642 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:11.420445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bdcb05-fc0a-48eb-8df6-5acd08d1c642 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:11.425242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761885d5-1103-40e0-ab1c-51f0958ee947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:11.426019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761885d5-1103-40e0-ab1c-51f0958ee947 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:11.426483 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761885d5-1103-40e0-ab1c-51f0958ee947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:11.426969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761885d5-1103-40e0-ab1c-51f0958ee947 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:11.427596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761885d5-1103-40e0-ab1c-51f0958ee947 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:11.436854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761885d5-1103-40e0-ab1c-51f0958ee947 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:11.450755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:11.481958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 969/1948] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:11 2022] POST /identity/v3/projects => generated 387 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:11.492807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029a1df-9167-4b69-8877-17265f602135 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:11.501225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:11.505951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e029a1df-9167-4b69-8877-17265f602135 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:11.606878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa53ad-d6e8-40a9-acc9-14088d8c01b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:11.607882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa53ad-d6e8-40a9-acc9-14088d8c01b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:11.608173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa53ad-d6e8-40a9-acc9-14088d8c01b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:11.608459 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa53ad-d6e8-40a9-acc9-14088d8c01b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:11.609570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa53ad-d6e8-40a9-acc9-14088d8c01b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:11.613090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faa53ad-d6e8-40a9-acc9-14088d8c01b3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:11.643158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 980/1949] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:11 2022] POST /identity/v3/users => generated 294 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:04:11.647429 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761885d5-1103-40e0-ab1c-51f0958ee947 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:11.661660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761885d5-1103-40e0-ab1c-51f0958ee947 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:11.669034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011137a6-ab03-401e-8e17-ae01dfeaea01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:11.670150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011137a6-ab03-401e-8e17-ae01dfeaea01 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:11.671539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011137a6-ab03-401e-8e17-ae01dfeaea01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:11.672037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011137a6-ab03-401e-8e17-ae01dfeaea01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:11.672946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011137a6-ab03-401e-8e17-ae01dfeaea01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:11.675948 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011137a6-ab03-401e-8e17-ae01dfeaea01 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:11.708326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 970/1950] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:11.713047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa53ad-d6e8-40a9-acc9-14088d8c01b3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:11.724254 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faa53ad-d6e8-40a9-acc9-14088d8c01b3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:11.731307 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459a2530-135d-4c66-a6ec-ec5a5541021e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:11.731307 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a2530-135d-4c66-a6ec-ec5a5541021e admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:11.731307 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a2530-135d-4c66-a6ec-ec5a5541021e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:11.733516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459a2530-135d-4c66-a6ec-ec5a5541021e admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:11.734383 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a2530-135d-4c66-a6ec-ec5a5541021e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:11.736301 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459a2530-135d-4c66-a6ec-ec5a5541021e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:11.752317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 981/1951] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:11.756499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011137a6-ab03-401e-8e17-ae01dfeaea01 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:11.768897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011137a6-ab03-401e-8e17-ae01dfeaea01 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:11.774099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c041f-0fc0-49d2-847d-fbaf37196df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:11.774879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c041f-0fc0-49d2-847d-fbaf37196df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:11.775233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c041f-0fc0-49d2-847d-fbaf37196df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:11.775603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95c041f-0fc0-49d2-847d-fbaf37196df6 admin admin] PATH_INFO: `/v3/projects/4cbed6ddbed94b24a91c228497dfa897/users/ae96508a598b4b51b8103103f395f546/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:11.793656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c041f-0fc0-49d2-847d-fbaf37196df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbed6ddbed94b24a91c228497dfa897, user_id=ae96508a598b4b51b8103103f395f546, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:11.796677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95c041f-0fc0-49d2-847d-fbaf37196df6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:11.812576 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 971/1952] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:11 2022] PUT /identity/v3/projects/4cbed6ddbed94b24a91c228497dfa897/users/ae96508a598b4b51b8103103f395f546/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:11.823490 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa2593-b1bf-4de6-b4f2-c43010eef0b2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:11.823876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa2593-b1bf-4de6-b4f2-c43010eef0b2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:11.824220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa2593-b1bf-4de6-b4f2-c43010eef0b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:11.884575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7daa2593-b1bf-4de6-b4f2-c43010eef0b2 None None] MFA Rules not processed for user `ae96508a598b4b51b8103103f395f546`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:11.885854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7daa2593-b1bf-4de6-b4f2-c43010eef0b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:12.035533 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 982/1953] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:12.037049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c041f-0fc0-49d2-847d-fbaf37196df6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:12.122976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95c041f-0fc0-49d2-847d-fbaf37196df6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:12.128841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047051bb-c575-44ce-91db-cb7b836270b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:12.129497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047051bb-c575-44ce-91db-cb7b836270b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:12.129782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047051bb-c575-44ce-91db-cb7b836270b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:12.130500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047051bb-c575-44ce-91db-cb7b836270b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:12.130752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047051bb-c575-44ce-91db-cb7b836270b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:12.132689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047051bb-c575-44ce-91db-cb7b836270b7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:12.171439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 972/1954] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:12 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:12.172111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa2593-b1bf-4de6-b4f2-c43010eef0b2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:12.185623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa2593-b1bf-4de6-b4f2-c43010eef0b2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:12.257036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5e8d5-313c-42e4-beb4-0d3dae616d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:12.259353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5e8d5-313c-42e4-beb4-0d3dae616d47 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:12.259947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5e8d5-313c-42e4-beb4-0d3dae616d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:12.260682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5e8d5-313c-42e4-beb4-0d3dae616d47 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:12.261797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5e8d5-313c-42e4-beb4-0d3dae616d47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:12.265413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c5e8d5-313c-42e4-beb4-0d3dae616d47 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:12.295553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 983/1955] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:12 2022] POST /identity/v3/users => generated 300 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:12.296180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047051bb-c575-44ce-91db-cb7b836270b7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:12.311244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047051bb-c575-44ce-91db-cb7b836270b7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:12.317654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae237c6-9412-4926-8d7f-c37e77419321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:12.318291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae237c6-9412-4926-8d7f-c37e77419321 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:12.318574 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae237c6-9412-4926-8d7f-c37e77419321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:12.318843 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae237c6-9412-4926-8d7f-c37e77419321 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:12.319549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae237c6-9412-4926-8d7f-c37e77419321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:12.321179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae237c6-9412-4926-8d7f-c37e77419321 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:12.334417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 973/1956] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:12.340147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5e8d5-313c-42e4-beb4-0d3dae616d47 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:12.346466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:12.352069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d1417-86d6-4e3d-adaf-ddca1fd027f9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:12.352581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d1417-86d6-4e3d-adaf-ddca1fd027f9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:12.352581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d1417-86d6-4e3d-adaf-ddca1fd027f9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:12.356660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c5e8d5-313c-42e4-beb4-0d3dae616d47 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:12.358152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 974/1957] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 12:04:12 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:04:12.365908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ff587-1173-4da4-a9e9-d6065b2bbb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:12.366809 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ff587-1173-4da4-a9e9-d6065b2bbb2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:12.368323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9baa1-7d1d-4ca8-bff3-28b49d0f9a3a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:12.368770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9baa1-7d1d-4ca8-bff3-28b49d0f9a3a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:12.369153 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb9baa1-7d1d-4ca8-bff3-28b49d0f9a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:12.372389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ff587-1173-4da4-a9e9-d6065b2bbb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:12.376489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68ff587-1173-4da4-a9e9-d6065b2bbb2d admin admin] PATH_INFO: `/v3/projects/68477e0ce14d4235b30c53e782c5b78c/users/c9b71597b08246d297dc2c2ac5f84cf9/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:12.405598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0fb9baa1-7d1d-4ca8-bff3-28b49d0f9a3a None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:12.409731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0fb9baa1-7d1d-4ca8-bff3-28b49d0f9a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:12.410694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ff587-1173-4da4-a9e9-d6065b2bbb2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=68477e0ce14d4235b30c53e782c5b78c, user_id=c9b71597b08246d297dc2c2ac5f84cf9, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:12.414766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68ff587-1173-4da4-a9e9-d6065b2bbb2d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:12.439148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 984/1958] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:12 2022] PUT /identity/v3/projects/68477e0ce14d4235b30c53e782c5b78c/users/c9b71597b08246d297dc2c2ac5f84cf9/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:12.444449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ff587-1173-4da4-a9e9-d6065b2bbb2d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:12.503959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 975/1959] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 12:04:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:12.518233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9baa1-7d1d-4ca8-bff3-28b49d0f9a3a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:12.519821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0fb9baa1-7d1d-4ca8-bff3-28b49d0f9a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:12.535267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68ff587-1173-4da4-a9e9-d6065b2bbb2d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:12.535425 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb9baa1-7d1d-4ca8-bff3-28b49d0f9a3a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:12.540126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77431fe4-0328-4772-b7be-f0009a8ce02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:12.540750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77431fe4-0328-4772-b7be-f0009a8ce02f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:12.541031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77431fe4-0328-4772-b7be-f0009a8ce02f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:12.541400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77431fe4-0328-4772-b7be-f0009a8ce02f admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:12.542064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77431fe4-0328-4772-b7be-f0009a8ce02f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:12.543697 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77431fe4-0328-4772-b7be-f0009a8ce02f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:12.563963 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 985/1960] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:12 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:12.564320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:12.564847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77431fe4-0328-4772-b7be-f0009a8ce02f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:12.575175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77431fe4-0328-4772-b7be-f0009a8ce02f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:12.580000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c707bd4-44b4-4b66-b534-44afddba7e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:12.580660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c707bd4-44b4-4b66-b534-44afddba7e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:12.580957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c707bd4-44b4-4b66-b534-44afddba7e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:12.581222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c707bd4-44b4-4b66-b534-44afddba7e65 admin admin] PATH_INFO: `/v3/projects/68477e0ce14d4235b30c53e782c5b78c/users/c9b71597b08246d297dc2c2ac5f84cf9/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:12.584277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c707bd4-44b4-4b66-b534-44afddba7e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68477e0ce14d4235b30c53e782c5b78c, user_id=c9b71597b08246d297dc2c2ac5f84cf9, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:12.586992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c707bd4-44b4-4b66-b534-44afddba7e65 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:12.598874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 986/1961] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:12 2022] PUT /identity/v3/projects/68477e0ce14d4235b30c53e782c5b78c/users/c9b71597b08246d297dc2c2ac5f84cf9/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:12.609528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3224486-b7f0-4d89-a007-b07978a2596e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:12.609817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3224486-b7f0-4d89-a007-b07978a2596e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:12.610093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3224486-b7f0-4d89-a007-b07978a2596e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:12.621981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b05a67-ffd5-475e-8a63-8a9010a355b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:12.622607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b05a67-ffd5-475e-8a63-8a9010a355b0 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:12.622887 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b05a67-ffd5-475e-8a63-8a9010a355b0 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:12.623158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b05a67-ffd5-475e-8a63-8a9010a355b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:12.632865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b05a67-ffd5-475e-8a63-8a9010a355b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:12.634664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b05a67-ffd5-475e-8a63-8a9010a355b0 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:12.638988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a3224486-b7f0-4d89-a007-b07978a2596e None None] MFA Rules not processed for user `c9b71597b08246d297dc2c2ac5f84cf9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:12.640258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a3224486-b7f0-4d89-a007-b07978a2596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:12.647193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 976/1962] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:12.727584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 987/1963] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:12 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:04:12.781500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b05a67-ffd5-475e-8a63-8a9010a355b0 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:12.783471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e0b05a67-ffd5-475e-8a63-8a9010a355b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:12.882838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b05a67-ffd5-475e-8a63-8a9010a355b0 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:12.970161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f279338f-49cb-4b15-a9a4-36beca14265d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:12.970890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279338f-49cb-4b15-a9a4-36beca14265d service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:12.971236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279338f-49cb-4b15-a9a4-36beca14265d service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:12.971578 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f279338f-49cb-4b15-a9a4-36beca14265d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:12.982780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279338f-49cb-4b15-a9a4-36beca14265d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:12.984414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f279338f-49cb-4b15-a9a4-36beca14265d service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:12.996388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 977/1964] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:12 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:13.720324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3224486-b7f0-4d89-a007-b07978a2596e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:13.721757 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a3224486-b7f0-4d89-a007-b07978a2596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:13.778608 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:13.799170 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3224486-b7f0-4d89-a007-b07978a2596e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:13.804103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:13.804832 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:13.805263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:13.805710 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] PATH_INFO: `/v3/users/5e6aeda94e0340bcbd100df94f7753d5` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:13.807035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e6aeda94e0340bcbd100df94f7753d5)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:13.809680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:13.866176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e6aeda94e0340bcbd100df94f7753d5'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:13.874719 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e6aeda94e0340bcbd100df94f7753d5'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:13.889894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e6aeda94e0340bcbd100df94f7753d5'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:13.890680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e6aeda94e0340bcbd100df94f7753d5'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:13.900287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e6aeda94e0340bcbd100df94f7753d5'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:13.907206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 988/1965] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:13 2022] DELETE /identity/v3/users/5e6aeda94e0340bcbd100df94f7753d5 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:13.911683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb798647-70a6-4be1-a0eb-0bb72fbd5928 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:13.912594 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb798647-70a6-4be1-a0eb-0bb72fbd5928 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:13.912976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb798647-70a6-4be1-a0eb-0bb72fbd5928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:13.937962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bb798647-70a6-4be1-a0eb-0bb72fbd5928 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:13.939157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bb798647-70a6-4be1-a0eb-0bb72fbd5928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:14.026175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 978/1966] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:14.039116 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:14.041172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:14.140992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eed7d1-da73-40bb-a339-63dd199c317e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:14.153154 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3f4b79-be0c-47fd-9db1-0efaa5a57510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:14.155551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4b79-be0c-47fd-9db1-0efaa5a57510 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:14.157488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4b79-be0c-47fd-9db1-0efaa5a57510 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:14.157920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3f4b79-be0c-47fd-9db1-0efaa5a57510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:14.186424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f4b79-be0c-47fd-9db1-0efaa5a57510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:14.188001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3f4b79-be0c-47fd-9db1-0efaa5a57510 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:14.215457 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 989/1967] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:14.310563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb798647-70a6-4be1-a0eb-0bb72fbd5928 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:14.313236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bb798647-70a6-4be1-a0eb-0bb72fbd5928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:14.343089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:14.347037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb798647-70a6-4be1-a0eb-0bb72fbd5928 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:14.353310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:14.355786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:14.356468 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:14.356825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] PATH_INFO: `/v3/users/ae96508a598b4b51b8103103f395f546` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:14.359056 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae96508a598b4b51b8103103f395f546)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:14.361606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:14.482113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae96508a598b4b51b8103103f395f546'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:14.485337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae96508a598b4b51b8103103f395f546'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:14.532268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae96508a598b4b51b8103103f395f546'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:14.556681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae96508a598b4b51b8103103f395f546'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:14.584556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae96508a598b4b51b8103103f395f546'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:14.600246 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 979/1968] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:14 2022] DELETE /identity/v3/users/ae96508a598b4b51b8103103f395f546 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:14.602580 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8cc8f-0e37-49ca-845a-9d41b5902d73 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:14.606136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8cc8f-0e37-49ca-845a-9d41b5902d73 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:14.606424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8cc8f-0e37-49ca-845a-9d41b5902d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:14.668558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-41f8cc8f-0e37-49ca-845a-9d41b5902d73 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:14.669835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-41f8cc8f-0e37-49ca-845a-9d41b5902d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:14.800693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 990/1969] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:04:14.810882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:14.812291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:14.882353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8cc8f-0e37-49ca-845a-9d41b5902d73 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:14.887079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-41f8cc8f-0e37-49ca-845a-9d41b5902d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:14.913516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8cc8f-0e37-49ca-845a-9d41b5902d73 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:14.920144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:14.920804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:14.921088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:14.921391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] PATH_INFO: `/v3/projects/fb197f129a394624bb4df6ac611cf579` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:14.922613 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb197f129a394624bb4df6ac611cf579)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:14.924532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:14.927952 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:14.979457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558011ee-ba7b-47b8-b41b-10a61d8413a4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:15.008239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb197f129a394624bb4df6ac611cf579', 'request_id': 'req-7c690ea0-af31-4513-9555-ce5828d65740'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.017965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb197f129a394624bb4df6ac611cf579', 'request_id': 'req-7c690ea0-af31-4513-9555-ce5828d65740'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.030409 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb197f129a394624bb4df6ac611cf579', 'request_id': 'req-7c690ea0-af31-4513-9555-ce5828d65740'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.049466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] The token cache is being invalidate because project fb197f129a394624bb4df6ac611cf579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:15.049999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.050841 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.051521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e462bb7-bb7e-49be-83b4-75b5f9ec62fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:15.052385 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e462bb7-bb7e-49be-83b4-75b5f9ec62fe service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:15.053338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 991/1970] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:14 2022] DELETE /identity/v3/projects/fb197f129a394624bb4df6ac611cf579 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:15.054075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e462bb7-bb7e-49be-83b4-75b5f9ec62fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:15.054562 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e462bb7-bb7e-49be-83b4-75b5f9ec62fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:15.057838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4e462bb7-bb7e-49be-83b4-75b5f9ec62fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:15.058777 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:15.060427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:15.120205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:15.145583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e462bb7-bb7e-49be-83b4-75b5f9ec62fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:15.146229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c690ea0-af31-4513-9555-ce5828d65740 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:15.147170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e462bb7-bb7e-49be-83b4-75b5f9ec62fe service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:15.151472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:15.152304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:15.152756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:15.153122 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] PATH_INFO: `/v3/users/843b3f45519d41728146ac67669b9d07` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:15.154593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=843b3f45519d41728146ac67669b9d07)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:15.156603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:15.162290 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 980/1971] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:15.226505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '843b3f45519d41728146ac67669b9d07'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.237355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '843b3f45519d41728146ac67669b9d07'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.255531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '843b3f45519d41728146ac67669b9d07'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.255531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '843b3f45519d41728146ac67669b9d07'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.263732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '843b3f45519d41728146ac67669b9d07'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.282444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 992/1972] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:15 2022] DELETE /identity/v3/users/843b3f45519d41728146ac67669b9d07 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:15.637164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e462bb7-bb7e-49be-83b4-75b5f9ec62fe service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:15.638775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4e462bb7-bb7e-49be-83b4-75b5f9ec62fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:15.650703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e462bb7-bb7e-49be-83b4-75b5f9ec62fe service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:15.718547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:15.719327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:15.719618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:15.720032 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] PATH_INFO: `/v3/projects/4cbed6ddbed94b24a91c228497dfa897` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:15.721217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbed6ddbed94b24a91c228497dfa897)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:15.723186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:15.763936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:15.765927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:15.784445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9e6c3c-242f-41aa-8fe4-b552724e9ef0 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:15.794143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbed6ddbed94b24a91c228497dfa897', 'request_id': 'req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.797256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:15.802052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbed6ddbed94b24a91c228497dfa897', 'request_id': 'req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.826250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbed6ddbed94b24a91c228497dfa897', 'request_id': 'req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.854372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] The token cache is being invalidate because project 4cbed6ddbed94b24a91c228497dfa897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:15.854661 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.856523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:15.863180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 981/1973] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:15 2022] DELETE /identity/v3/projects/4cbed6ddbed94b24a91c228497dfa897 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:15.868536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:15.870868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:15.888238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dfc890-deaf-4559-81c9-4216a16c8b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:15.889043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfc890-deaf-4559-81c9-4216a16c8b4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:15.889823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfc890-deaf-4559-81c9-4216a16c8b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:15.890589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dfc890-deaf-4559-81c9-4216a16c8b4d admin admin] PATH_INFO: `/v3/projects/98aa73645c75407d94a0e484e1cecb47` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:15.893523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfc890-deaf-4559-81c9-4216a16c8b4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=98aa73645c75407d94a0e484e1cecb47)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:15.897468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dfc890-deaf-4559-81c9-4216a16c8b4d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:15.971633 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd42aba-7c1e-44b4-b376-0a4ce3f9283b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:15.976877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2624b97-fcca-4a57-b3e8-fb4fd7bf02f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:15.977623 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2624b97-fcca-4a57-b3e8-fb4fd7bf02f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:15.977910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2624b97-fcca-4a57-b3e8-fb4fd7bf02f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:15.978183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2624b97-fcca-4a57-b3e8-fb4fd7bf02f0 admin admin] PATH_INFO: `/v3/users/c9b71597b08246d297dc2c2ac5f84cf9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:15.984273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2624b97-fcca-4a57-b3e8-fb4fd7bf02f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9b71597b08246d297dc2c2ac5f84cf9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:15.984899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2624b97-fcca-4a57-b3e8-fb4fd7bf02f0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:16.003115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:16.066019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b2624b97-fcca-4a57-b3e8-fb4fd7bf02f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9b71597b08246d297dc2c2ac5f84cf9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.067004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b2624b97-fcca-4a57-b3e8-fb4fd7bf02f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9b71597b08246d297dc2c2ac5f84cf9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.071619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-18dfc890-deaf-4559-81c9-4216a16c8b4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98aa73645c75407d94a0e484e1cecb47', 'request_id': 'req-18dfc890-deaf-4559-81c9-4216a16c8b4d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.092558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-18dfc890-deaf-4559-81c9-4216a16c8b4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98aa73645c75407d94a0e484e1cecb47', 'request_id': 'req-18dfc890-deaf-4559-81c9-4216a16c8b4d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.098498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b2624b97-fcca-4a57-b3e8-fb4fd7bf02f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9b71597b08246d297dc2c2ac5f84cf9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.101534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-18dfc890-deaf-4559-81c9-4216a16c8b4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98aa73645c75407d94a0e484e1cecb47', 'request_id': 'req-18dfc890-deaf-4559-81c9-4216a16c8b4d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.118675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b2624b97-fcca-4a57-b3e8-fb4fd7bf02f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9b71597b08246d297dc2c2ac5f84cf9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.127221 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-18dfc890-deaf-4559-81c9-4216a16c8b4d admin admin] The token cache is being invalidate because project 98aa73645c75407d94a0e484e1cecb47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:16.127524 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-18dfc890-deaf-4559-81c9-4216a16c8b4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.130445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-18dfc890-deaf-4559-81c9-4216a16c8b4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.133160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 993/1974] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:15 2022] DELETE /identity/v3/projects/98aa73645c75407d94a0e484e1cecb47 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:16.134901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b2624b97-fcca-4a57-b3e8-fb4fd7bf02f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9b71597b08246d297dc2c2ac5f84cf9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.138110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c4855-0127-4d7d-80c1-1ff6035537b9 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:16.138399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c4855-0127-4d7d-80c1-1ff6035537b9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:16.138875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242c4855-0127-4d7d-80c1-1ff6035537b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:16.144097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 982/1975] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:15 2022] DELETE /identity/v3/users/c9b71597b08246d297dc2c2ac5f84cf9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:16.177678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-242c4855-0127-4d7d-80c1-1ff6035537b9 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:16.182108 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-242c4855-0127-4d7d-80c1-1ff6035537b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:16.320407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 994/1976] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:16.336211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff28c-0f29-4e1d-92b7-533c80bbcfac None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:16.336914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff28c-0f29-4e1d-92b7-533c80bbcfac None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:16.337396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dff28c-0f29-4e1d-92b7-533c80bbcfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:16.362033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b6dff28c-0f29-4e1d-92b7-533c80bbcfac None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:16.371240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b6dff28c-0f29-4e1d-92b7-533c80bbcfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:16.380941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 983/1977] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:16.385811 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c4855-0127-4d7d-80c1-1ff6035537b9 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:16.396749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242c4855-0127-4d7d-80c1-1ff6035537b9 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:16.401612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f62f3-1f64-4685-879b-e7d1522ac4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:16.402869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f62f3-1f64-4685-879b-e7d1522ac4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:16.403153 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f62f3-1f64-4685-879b-e7d1522ac4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:16.403429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2f62f3-1f64-4685-879b-e7d1522ac4d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:16.404131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f62f3-1f64-4685-879b-e7d1522ac4d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:16.404436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f62f3-1f64-4685-879b-e7d1522ac4d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:16.406407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2f62f3-1f64-4685-879b-e7d1522ac4d3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:16.422126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 995/1978] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:16.428671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff28c-0f29-4e1d-92b7-533c80bbcfac None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:16.444070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dff28c-0f29-4e1d-92b7-533c80bbcfac None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:16.450028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe1aa0-194c-464c-a376-b91980cd5657 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:16.451094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe1aa0-194c-464c-a376-b91980cd5657 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:16.451379 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe1aa0-194c-464c-a376-b91980cd5657 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:16.451687 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffe1aa0-194c-464c-a376-b91980cd5657 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:16.452327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe1aa0-194c-464c-a376-b91980cd5657 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:16.454450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffe1aa0-194c-464c-a376-b91980cd5657 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:16.495571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 984/1979] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:16 2022] POST /identity/v3/projects => generated 373 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:16.499870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f62f3-1f64-4685-879b-e7d1522ac4d3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:16.510043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2f62f3-1f64-4685-879b-e7d1522ac4d3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:16.561644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:16.597767 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f9805-edd3-4738-96e2-9bf821e6c9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:16.598403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f9805-edd3-4738-96e2-9bf821e6c9a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:16.598686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f9805-edd3-4738-96e2-9bf821e6c9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:16.598958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211f9805-edd3-4738-96e2-9bf821e6c9a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:16.600335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f9805-edd3-4738-96e2-9bf821e6c9a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:16.601712 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211f9805-edd3-4738-96e2-9bf821e6c9a3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:16.632117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 996/1980] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:16 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:04:16.640740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe1aa0-194c-464c-a376-b91980cd5657 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:16.658308 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffe1aa0-194c-464c-a376-b91980cd5657 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:16.672657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d80fa-6c02-4a4d-af4c-452997c22758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:16.673312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d80fa-6c02-4a4d-af4c-452997c22758 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:16.673599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d80fa-6c02-4a4d-af4c-452997c22758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:16.674070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d80fa-6c02-4a4d-af4c-452997c22758 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:16.674571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d80fa-6c02-4a4d-af4c-452997c22758 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:16.676349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d80fa-6c02-4a4d-af4c-452997c22758 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:16.690600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 985/1981] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:16.695934 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f9805-edd3-4738-96e2-9bf821e6c9a3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:16.708837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211f9805-edd3-4738-96e2-9bf821e6c9a3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:16.718101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798926a1-47ac-4d58-b64b-a920ad341276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:16.719285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798926a1-47ac-4d58-b64b-a920ad341276 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:16.719285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798926a1-47ac-4d58-b64b-a920ad341276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:16.719285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798926a1-47ac-4d58-b64b-a920ad341276 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:16.719966 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798926a1-47ac-4d58-b64b-a920ad341276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:16.721648 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798926a1-47ac-4d58-b64b-a920ad341276 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:16.734177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 997/1982] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:16.737907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d80fa-6c02-4a4d-af4c-452997c22758 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:16.762882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798926a1-47ac-4d58-b64b-a920ad341276 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:16.765482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-798926a1-47ac-4d58-b64b-a920ad341276 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:16.770627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d80fa-6c02-4a4d-af4c-452997c22758 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:16.776952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d91b2b8-9aaf-459b-ac05-88f49c2a4d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:16.778134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91b2b8-9aaf-459b-ac05-88f49c2a4d51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:16.778583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91b2b8-9aaf-459b-ac05-88f49c2a4d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:16.778873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d91b2b8-9aaf-459b-ac05-88f49c2a4d51 admin admin] PATH_INFO: `/v3/projects/fa70e0f6890b48559c6da747f7ad92b8/users/ee47a1b9e04a4da89084437f432b9fd1/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:16.800424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798926a1-47ac-4d58-b64b-a920ad341276 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:16.805566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc0dd3d-2660-46de-b181-1074ba5e1089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:16.806324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0dd3d-2660-46de-b181-1074ba5e1089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:16.806677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0dd3d-2660-46de-b181-1074ba5e1089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:16.807014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc0dd3d-2660-46de-b181-1074ba5e1089 admin admin] PATH_INFO: `/v3/projects/68477e0ce14d4235b30c53e782c5b78c` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:16.808772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0dd3d-2660-46de-b181-1074ba5e1089 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68477e0ce14d4235b30c53e782c5b78c)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:16.810806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc0dd3d-2660-46de-b181-1074ba5e1089 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:16.811369 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91b2b8-9aaf-459b-ac05-88f49c2a4d51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa70e0f6890b48559c6da747f7ad92b8, user_id=ee47a1b9e04a4da89084437f432b9fd1, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:16.814141 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d91b2b8-9aaf-459b-ac05-88f49c2a4d51 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:16.827595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 986/1983] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:16 2022] PUT /identity/v3/projects/fa70e0f6890b48559c6da747f7ad92b8/users/ee47a1b9e04a4da89084437f432b9fd1/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:16.832768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4e6a0-94e2-4039-b608-4767d4b667b4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:16.833057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4e6a0-94e2-4039-b608-4767d4b667b4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:16.833400 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4e6a0-94e2-4039-b608-4767d4b667b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:16.852327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-29c4e6a0-94e2-4039-b608-4767d4b667b4 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:16.853549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-29c4e6a0-94e2-4039-b608-4767d4b667b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:16.863814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-edc0dd3d-2660-46de-b181-1074ba5e1089 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68477e0ce14d4235b30c53e782c5b78c', 'request_id': 'req-edc0dd3d-2660-46de-b181-1074ba5e1089'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.872089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-edc0dd3d-2660-46de-b181-1074ba5e1089 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68477e0ce14d4235b30c53e782c5b78c', 'request_id': 'req-edc0dd3d-2660-46de-b181-1074ba5e1089'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.879812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-edc0dd3d-2660-46de-b181-1074ba5e1089 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68477e0ce14d4235b30c53e782c5b78c', 'request_id': 'req-edc0dd3d-2660-46de-b181-1074ba5e1089'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.894590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-edc0dd3d-2660-46de-b181-1074ba5e1089 admin admin] The token cache is being invalidate because project 68477e0ce14d4235b30c53e782c5b78c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:16.895262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-edc0dd3d-2660-46de-b181-1074ba5e1089 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.895649 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-edc0dd3d-2660-46de-b181-1074ba5e1089 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:16.897205 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 998/1984] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:16 2022] DELETE /identity/v3/projects/68477e0ce14d4235b30c53e782c5b78c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:16.902142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f85ac6-21bc-4592-934b-8ab0b8a6c7cf None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:16.902439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f85ac6-21bc-4592-934b-8ab0b8a6c7cf None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:16.902716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f85ac6-21bc-4592-934b-8ab0b8a6c7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:16.927138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-69f85ac6-21bc-4592-934b-8ab0b8a6c7cf None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:16.928635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-69f85ac6-21bc-4592-934b-8ab0b8a6c7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:16.934173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 987/1985] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:04:16.939082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 999/1986] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:16.944015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4e6a0-94e2-4039-b608-4767d4b667b4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:16.946670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-29c4e6a0-94e2-4039-b608-4767d4b667b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:16.947627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9abc1c-2037-48fe-8483-c5efdb3f79ab None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:16.947979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9abc1c-2037-48fe-8483-c5efdb3f79ab None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:16.948326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9abc1c-2037-48fe-8483-c5efdb3f79ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:16.970002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ff9abc1c-2037-48fe-8483-c5efdb3f79ab None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:16.971289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ff9abc1c-2037-48fe-8483-c5efdb3f79ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:16.981116 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1000/1987] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:16.985507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9abc1c-2037-48fe-8483-c5efdb3f79ab None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:16.992477 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:16.997448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9abc1c-2037-48fe-8483-c5efdb3f79ab None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:17.003924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ee26a-bc4d-4e74-ba9b-b05c60bfb5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:17.005465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ee26a-bc4d-4e74-ba9b-b05c60bfb5ce admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:17.005820 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ee26a-bc4d-4e74-ba9b-b05c60bfb5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:17.009228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0ee26a-bc4d-4e74-ba9b-b05c60bfb5ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:17.009500 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ee26a-bc4d-4e74-ba9b-b05c60bfb5ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:17.010094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ee26a-bc4d-4e74-ba9b-b05c60bfb5ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:17.012003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0ee26a-bc4d-4e74-ba9b-b05c60bfb5ce admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:17.030998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1001/1988] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 12:04:17.036531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ee26a-bc4d-4e74-ba9b-b05c60bfb5ce admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:17.039902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4e6a0-94e2-4039-b608-4767d4b667b4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:17.044797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cae31f-393e-4a5a-bb5e-be0c9c9d14a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:17.045786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cae31f-393e-4a5a-bb5e-be0c9c9d14a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:17.046318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cae31f-393e-4a5a-bb5e-be0c9c9d14a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:17.046716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cae31f-393e-4a5a-bb5e-be0c9c9d14a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:17.056032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0ee26a-bc4d-4e74-ba9b-b05c60bfb5ce admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:17.071036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cae31f-393e-4a5a-bb5e-be0c9c9d14a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:17.071036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cae31f-393e-4a5a-bb5e-be0c9c9d14a7 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:17.071242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec34d4-a866-41c1-961e-502655a04047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:17.071242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec34d4-a866-41c1-961e-502655a04047 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:17.071242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec34d4-a866-41c1-961e-502655a04047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:17.071242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ec34d4-a866-41c1-961e-502655a04047 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:17.071513 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec34d4-a866-41c1-961e-502655a04047 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:17.071513 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ec34d4-a866-41c1-961e-502655a04047 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:17.072429 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 988/1989] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:17.100715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1002/1990] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:17 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:04:17.105433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cae31f-393e-4a5a-bb5e-be0c9c9d14a7 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:17.115492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cae31f-393e-4a5a-bb5e-be0c9c9d14a7 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:17.176321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae9711-8e3d-4ded-a6ac-fafbefacadf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:17.177060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae9711-8e3d-4ded-a6ac-fafbefacadf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:17.177371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae9711-8e3d-4ded-a6ac-fafbefacadf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:17.177651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae9711-8e3d-4ded-a6ac-fafbefacadf6 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:17.178327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae9711-8e3d-4ded-a6ac-fafbefacadf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:17.180529 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cae9711-8e3d-4ded-a6ac-fafbefacadf6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:17.202515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 989/1991] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:17 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:04:17.206559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec34d4-a866-41c1-961e-502655a04047 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:17.217471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ec34d4-a866-41c1-961e-502655a04047 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:17.222349 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c5b9f-1d4c-4361-9253-5209d7e55394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:17.222995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c5b9f-1d4c-4361-9253-5209d7e55394 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:17.223272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c5b9f-1d4c-4361-9253-5209d7e55394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:17.223543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c5b9f-1d4c-4361-9253-5209d7e55394 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:17.224707 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c5b9f-1d4c-4361-9253-5209d7e55394 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:17.226393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c5b9f-1d4c-4361-9253-5209d7e55394 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:17.240451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1003/1992] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:17.242108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae9711-8e3d-4ded-a6ac-fafbefacadf6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:17.254357 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae9711-8e3d-4ded-a6ac-fafbefacadf6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:17.259302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d839fa7-1225-486b-bc57-a861e2c78cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:17.259862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d839fa7-1225-486b-bc57-a861e2c78cce admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:17.260150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d839fa7-1225-486b-bc57-a861e2c78cce admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:17.260408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d839fa7-1225-486b-bc57-a861e2c78cce admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:17.261156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d839fa7-1225-486b-bc57-a861e2c78cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:17.262799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d839fa7-1225-486b-bc57-a861e2c78cce admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:17.276735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 990/1993] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:17 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:17.277659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c5b9f-1d4c-4361-9253-5209d7e55394 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:17.290626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c5b9f-1d4c-4361-9253-5209d7e55394 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:17.301344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78252073-cbf3-41cf-9a50-232c041d92a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:17.301344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78252073-cbf3-41cf-9a50-232c041d92a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:17.301344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78252073-cbf3-41cf-9a50-232c041d92a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:17.301344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78252073-cbf3-41cf-9a50-232c041d92a6 admin admin] PATH_INFO: `/v3/projects/9d799f62f74740e0b5b7f29caae51021/users/711a709bcbc44a1fabedb82b3dc2864a/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:17.323029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78252073-cbf3-41cf-9a50-232c041d92a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d799f62f74740e0b5b7f29caae51021, user_id=711a709bcbc44a1fabedb82b3dc2864a, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:17.325842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78252073-cbf3-41cf-9a50-232c041d92a6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:17.342588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1004/1994] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:17 2022] PUT /identity/v3/projects/9d799f62f74740e0b5b7f29caae51021/users/711a709bcbc44a1fabedb82b3dc2864a/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:17.352923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170163fb-8689-4e48-ba2d-0fa7fa37595c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:17.353208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170163fb-8689-4e48-ba2d-0fa7fa37595c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:17.353518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170163fb-8689-4e48-ba2d-0fa7fa37595c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:17.398085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-170163fb-8689-4e48-ba2d-0fa7fa37595c None None] MFA Rules not processed for user `711a709bcbc44a1fabedb82b3dc2864a`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:17.398085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-170163fb-8689-4e48-ba2d-0fa7fa37595c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:17.494603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 991/1995] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:17.508679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78252073-cbf3-41cf-9a50-232c041d92a6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:17.514957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-78252073-cbf3-41cf-9a50-232c041d92a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:17.537029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:17.621264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78252073-cbf3-41cf-9a50-232c041d92a6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:17.625006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db9102-ee9a-4b37-965e-4123856f0939 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:17.625685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db9102-ee9a-4b37-965e-4123856f0939 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:17.625964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db9102-ee9a-4b37-965e-4123856f0939 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:17.626245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6db9102-ee9a-4b37-965e-4123856f0939 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:17.635739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db9102-ee9a-4b37-965e-4123856f0939 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:17.637288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6db9102-ee9a-4b37-965e-4123856f0939 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:17.647499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1005/1996] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:18.118661 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ea11-5bfc-497f-91db-e470749822e2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:18.119241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ea11-5bfc-497f-91db-e470749822e2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:18.119321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ea11-5bfc-497f-91db-e470749822e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:18.150084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7c70ea11-5bfc-497f-91db-e470749822e2 None None] MFA Rules not processed for user `ee47a1b9e04a4da89084437f432b9fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:18.151566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7c70ea11-5bfc-497f-91db-e470749822e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:18.185660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:18.233006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 992/1997] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:18.234200 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db9102-ee9a-4b37-965e-4123856f0939 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:18.235606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e6db9102-ee9a-4b37-965e-4123856f0939 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:18.317189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6db9102-ee9a-4b37-965e-4123856f0939 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:18.324648 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca392af5-5d44-48c3-b59c-3829d60c87de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:18.325310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca392af5-5d44-48c3-b59c-3829d60c87de admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:18.325620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca392af5-5d44-48c3-b59c-3829d60c87de admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:18.325894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca392af5-5d44-48c3-b59c-3829d60c87de admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:18.326586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca392af5-5d44-48c3-b59c-3829d60c87de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:18.328806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca392af5-5d44-48c3-b59c-3829d60c87de admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:18.368140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1006/1998] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:18 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:18.373269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70ea11-5bfc-497f-91db-e470749822e2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:18.387932 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70ea11-5bfc-497f-91db-e470749822e2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:18.451818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294da41-0be6-4c0e-8cfe-3bbb43529bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:18.452470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294da41-0be6-4c0e-8cfe-3bbb43529bb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:18.452744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294da41-0be6-4c0e-8cfe-3bbb43529bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:18.453016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294da41-0be6-4c0e-8cfe-3bbb43529bb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:18.453712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294da41-0be6-4c0e-8cfe-3bbb43529bb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:18.455725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294da41-0be6-4c0e-8cfe-3bbb43529bb6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:18.480297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 993/1999] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:18 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:18.485134 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca392af5-5d44-48c3-b59c-3829d60c87de admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:18.498566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca392af5-5d44-48c3-b59c-3829d60c87de admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:18.503342 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c39d0e-c11d-4a75-84ef-6e13d7810653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:18.503967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39d0e-c11d-4a75-84ef-6e13d7810653 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:18.504252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39d0e-c11d-4a75-84ef-6e13d7810653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:18.504526 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c39d0e-c11d-4a75-84ef-6e13d7810653 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:18.505220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c39d0e-c11d-4a75-84ef-6e13d7810653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:18.506862 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c39d0e-c11d-4a75-84ef-6e13d7810653 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:18.521871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1007/2000] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:18.523316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294da41-0be6-4c0e-8cfe-3bbb43529bb6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:18.533403 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294da41-0be6-4c0e-8cfe-3bbb43529bb6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:18.537989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71964303-6569-4051-86e7-5e8e42abca17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:18.538625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71964303-6569-4051-86e7-5e8e42abca17 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:18.538904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71964303-6569-4051-86e7-5e8e42abca17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:18.539177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71964303-6569-4051-86e7-5e8e42abca17 admin admin] PATH_INFO: `/v3/projects/4e035bbe5b384a0ab1c0c42657ae4915/users/36991fe37fae4e64bfe9aee07f425532/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:18.561668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71964303-6569-4051-86e7-5e8e42abca17 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e035bbe5b384a0ab1c0c42657ae4915, user_id=36991fe37fae4e64bfe9aee07f425532, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:18.564559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71964303-6569-4051-86e7-5e8e42abca17 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:18.578852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 994/2001] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:18 2022] PUT /identity/v3/projects/4e035bbe5b384a0ab1c0c42657ae4915/users/36991fe37fae4e64bfe9aee07f425532/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:18.582733 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c39d0e-c11d-4a75-84ef-6e13d7810653 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:18.595896 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c39d0e-c11d-4a75-84ef-6e13d7810653 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:18.666407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030ddf9-80ae-46d1-963d-18b31464ca60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:18.666407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030ddf9-80ae-46d1-963d-18b31464ca60 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:18.666407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030ddf9-80ae-46d1-963d-18b31464ca60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:18.666407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4030ddf9-80ae-46d1-963d-18b31464ca60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:18.666696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030ddf9-80ae-46d1-963d-18b31464ca60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:18.666696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4030ddf9-80ae-46d1-963d-18b31464ca60 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:18.674410 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1008/2002] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:18.678601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71964303-6569-4051-86e7-5e8e42abca17 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:18.690047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71964303-6569-4051-86e7-5e8e42abca17 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:18.697492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babface-f31d-477f-b419-40b0cc345842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:18.698710 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babface-f31d-477f-b419-40b0cc345842 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:18.698875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babface-f31d-477f-b419-40b0cc345842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:18.699233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babface-f31d-477f-b419-40b0cc345842 admin admin] PATH_INFO: `/v3/projects/4e035bbe5b384a0ab1c0c42657ae4915/users/36991fe37fae4e64bfe9aee07f425532/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:18.701175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babface-f31d-477f-b419-40b0cc345842 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e035bbe5b384a0ab1c0c42657ae4915, user_id=36991fe37fae4e64bfe9aee07f425532, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:18.703893 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babface-f31d-477f-b419-40b0cc345842 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:18.720985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 995/2003] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:18 2022] PUT /identity/v3/projects/4e035bbe5b384a0ab1c0c42657ae4915/users/36991fe37fae4e64bfe9aee07f425532/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:19.079347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030ddf9-80ae-46d1-963d-18b31464ca60 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:19.082529 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4030ddf9-80ae-46d1-963d-18b31464ca60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:19.101625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4030ddf9-80ae-46d1-963d-18b31464ca60 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:19.133393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:19.185465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:19.186115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:19.186473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:19.186716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] PATH_INFO: `/v3/users/da1d6d9da9834042abbb6b9c63129fea` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:19.188084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da1d6d9da9834042abbb6b9c63129fea)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:19.189924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:19.254175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da1d6d9da9834042abbb6b9c63129fea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:19.266594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da1d6d9da9834042abbb6b9c63129fea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:19.283542 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da1d6d9da9834042abbb6b9c63129fea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:19.284430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da1d6d9da9834042abbb6b9c63129fea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:19.308058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da1d6d9da9834042abbb6b9c63129fea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:19.316872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1009/2004] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:19 2022] DELETE /identity/v3/users/da1d6d9da9834042abbb6b9c63129fea => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:19.321423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14366b11-4a34-4518-a9c7-1ba683e4ae12 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:19.321943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14366b11-4a34-4518-a9c7-1ba683e4ae12 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:19.322038 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14366b11-4a34-4518-a9c7-1ba683e4ae12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:19.350272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-14366b11-4a34-4518-a9c7-1ba683e4ae12 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:19.354040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-14366b11-4a34-4518-a9c7-1ba683e4ae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:19.440231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 996/2005] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:19.454509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:19.456582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:19.537235 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b239f44-b40c-41fb-afc7-027d36ec3778 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:19.550155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b129b5f-d731-4d34-9ac3-c7236590a59a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:19.551126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b129b5f-d731-4d34-9ac3-c7236590a59a service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:19.551511 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b129b5f-d731-4d34-9ac3-c7236590a59a service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:19.551913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b129b5f-d731-4d34-9ac3-c7236590a59a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:19.566564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b129b5f-d731-4d34-9ac3-c7236590a59a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:19.568262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b129b5f-d731-4d34-9ac3-c7236590a59a service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:19.583533 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1010/2006] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:20.393029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14366b11-4a34-4518-a9c7-1ba683e4ae12 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:20.395026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-14366b11-4a34-4518-a9c7-1ba683e4ae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:20.415123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14366b11-4a34-4518-a9c7-1ba683e4ae12 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:20.428121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf4402-ca93-4b3d-aca3-760964b682dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:20.429781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf4402-ca93-4b3d-aca3-760964b682dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:20.430208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf4402-ca93-4b3d-aca3-760964b682dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:20.430659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf4402-ca93-4b3d-aca3-760964b682dc admin admin] PATH_INFO: `/v3/projects/d42d57972cc14e34bdfa258d6f2deb67` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:20.437752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf4402-ca93-4b3d-aca3-760964b682dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d42d57972cc14e34bdfa258d6f2deb67)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:20.440854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf4402-ca93-4b3d-aca3-760964b682dc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:20.478142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:20.568127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ebf4402-ca93-4b3d-aca3-760964b682dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd42d57972cc14e34bdfa258d6f2deb67', 'request_id': 'req-6ebf4402-ca93-4b3d-aca3-760964b682dc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:20.607274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ebf4402-ca93-4b3d-aca3-760964b682dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd42d57972cc14e34bdfa258d6f2deb67', 'request_id': 'req-6ebf4402-ca93-4b3d-aca3-760964b682dc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:20.624998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ebf4402-ca93-4b3d-aca3-760964b682dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd42d57972cc14e34bdfa258d6f2deb67', 'request_id': 'req-6ebf4402-ca93-4b3d-aca3-760964b682dc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:20.645123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ebf4402-ca93-4b3d-aca3-760964b682dc admin admin] The token cache is being invalidate because project d42d57972cc14e34bdfa258d6f2deb67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:20.645691 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ebf4402-ca93-4b3d-aca3-760964b682dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:20.647196 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ebf4402-ca93-4b3d-aca3-760964b682dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:20.651423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 997/2007] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:20 2022] DELETE /identity/v3/projects/d42d57972cc14e34bdfa258d6f2deb67 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:20.657684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af624c4b-a6a5-4f3c-bf3a-161762fe7792 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:20.658187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af624c4b-a6a5-4f3c-bf3a-161762fe7792 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:20.659711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af624c4b-a6a5-4f3c-bf3a-161762fe7792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:20.666177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ada8-db20-4b07-87a8-78a02f451bcd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:20.666955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ada8-db20-4b07-87a8-78a02f451bcd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:20.668175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5253ada8-db20-4b07-87a8-78a02f451bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:20.710219 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-af624c4b-a6a5-4f3c-bf3a-161762fe7792 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:20.712006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-af624c4b-a6a5-4f3c-bf3a-161762fe7792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:20.772882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5253ada8-db20-4b07-87a8-78a02f451bcd None None] MFA Rules not processed for user `36991fe37fae4e64bfe9aee07f425532`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:20.779591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5253ada8-db20-4b07-87a8-78a02f451bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:20.809742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:20.858814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1011/2008] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:20.867416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa827e-6987-4940-93a8-3a0b69d764ee None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:20.868766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa827e-6987-4940-93a8-3a0b69d764ee None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:20.869271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aa827e-6987-4940-93a8-3a0b69d764ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:20.894130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 998/2009] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:04:20.910362 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0856a-f31b-45ce-9838-455ac1be56e9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:20.911376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0856a-f31b-45ce-9838-455ac1be56e9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:20.912358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f0856a-f31b-45ce-9838-455ac1be56e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:20.924290 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e4aa827e-6987-4940-93a8-3a0b69d764ee None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:20.925599 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e4aa827e-6987-4940-93a8-3a0b69d764ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:20.945626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1012/2010] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:20.950309 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa827e-6987-4940-93a8-3a0b69d764ee None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:20.953670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-40f0856a-f31b-45ce-9838-455ac1be56e9 None None] MFA Rules not processed for user `ee47a1b9e04a4da89084437f432b9fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:20.956558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-40f0856a-f31b-45ce-9838-455ac1be56e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:20.960523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aa827e-6987-4940-93a8-3a0b69d764ee None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:20.968588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56a68f-c62b-4cb6-858d-c8747a172b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:20.969374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56a68f-c62b-4cb6-858d-c8747a172b95 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:20.969660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56a68f-c62b-4cb6-858d-c8747a172b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:20.969936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a56a68f-c62b-4cb6-858d-c8747a172b95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:20.970827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56a68f-c62b-4cb6-858d-c8747a172b95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:20.971137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56a68f-c62b-4cb6-858d-c8747a172b95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:20.973082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a56a68f-c62b-4cb6-858d-c8747a172b95 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:20.993487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1013/2011] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 12:04:20.994724 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56a68f-c62b-4cb6-858d-c8747a172b95 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:21.005551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a56a68f-c62b-4cb6-858d-c8747a172b95 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:21.013817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97696a09-b2f1-4dde-8dda-0a0678e43ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:21.016679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97696a09-b2f1-4dde-8dda-0a0678e43ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:21.017387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97696a09-b2f1-4dde-8dda-0a0678e43ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:21.018454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97696a09-b2f1-4dde-8dda-0a0678e43ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:21.019874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97696a09-b2f1-4dde-8dda-0a0678e43ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:21.026067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97696a09-b2f1-4dde-8dda-0a0678e43ca4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:21.039098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 999/2012] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:21.050854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0856a-f31b-45ce-9838-455ac1be56e9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:21.053033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-40f0856a-f31b-45ce-9838-455ac1be56e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:21.084600 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1014/2013] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:20 2022] POST /identity/v3/projects => generated 399 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:21.086441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97696a09-b2f1-4dde-8dda-0a0678e43ca4 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:21.115678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:21.178501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97696a09-b2f1-4dde-8dda-0a0678e43ca4 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:21.186551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d89c6-3672-44c6-bbca-59f2989e3fd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:21.187287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d89c6-3672-44c6-bbca-59f2989e3fd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:21.187698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d89c6-3672-44c6-bbca-59f2989e3fd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:21.187817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f0856a-f31b-45ce-9838-455ac1be56e9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:21.188184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00d89c6-3672-44c6-bbca-59f2989e3fd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:21.188957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d89c6-3672-44c6-bbca-59f2989e3fd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:21.191023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00d89c6-3672-44c6-bbca-59f2989e3fd7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:21.218442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1015/2014] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:21 2022] POST /identity/v3/users => generated 300 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:21.222442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d89c6-3672-44c6-bbca-59f2989e3fd7 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:21.241318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00d89c6-3672-44c6-bbca-59f2989e3fd7 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:21.248294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c1092-52e3-4a41-96d2-ee8898b41ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:21.248927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1092-52e3-4a41-96d2-ee8898b41ffa admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:21.249410 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1092-52e3-4a41-96d2-ee8898b41ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:21.249693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c1092-52e3-4a41-96d2-ee8898b41ffa admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:21.250598 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c1092-52e3-4a41-96d2-ee8898b41ffa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:21.252382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c1092-52e3-4a41-96d2-ee8898b41ffa admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:21.268510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1016/2015] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:21.269563 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c1092-52e3-4a41-96d2-ee8898b41ffa admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:21.275429 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02eb866-a1b6-4686-ad9d-26a7f98685ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:21.276128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eb866-a1b6-4686-ad9d-26a7f98685ce service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:21.276343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eb866-a1b6-4686-ad9d-26a7f98685ce service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:21.276657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02eb866-a1b6-4686-ad9d-26a7f98685ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:21.279036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c02eb866-a1b6-4686-ad9d-26a7f98685ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:21.281548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c1092-52e3-4a41-96d2-ee8898b41ffa admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:21.291014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255946ee-2fcd-4ea5-888d-b8c2b83787c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:21.295013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255946ee-2fcd-4ea5-888d-b8c2b83787c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:21.297114 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255946ee-2fcd-4ea5-888d-b8c2b83787c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:21.297453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255946ee-2fcd-4ea5-888d-b8c2b83787c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:21.298173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255946ee-2fcd-4ea5-888d-b8c2b83787c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:21.304146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255946ee-2fcd-4ea5-888d-b8c2b83787c5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:21.337687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1017/2016] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:21.343633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255946ee-2fcd-4ea5-888d-b8c2b83787c5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:21.362924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255946ee-2fcd-4ea5-888d-b8c2b83787c5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:21.379438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d5b98-7b27-4cec-9136-21f3ad4d9278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:21.380258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5b98-7b27-4cec-9136-21f3ad4d9278 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:21.382088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5b98-7b27-4cec-9136-21f3ad4d9278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:21.382498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d5b98-7b27-4cec-9136-21f3ad4d9278 admin admin] PATH_INFO: `/v3/projects/a5114932b5b2472b836fea01f140e511/users/040d1696115b44529dcbae2212eabe38/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:21.382612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02eb866-a1b6-4686-ad9d-26a7f98685ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:21.384281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02eb866-a1b6-4686-ad9d-26a7f98685ce service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:21.405323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1000/2017] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:21 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:04:21.420022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d5b98-7b27-4cec-9136-21f3ad4d9278 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5114932b5b2472b836fea01f140e511, user_id=040d1696115b44529dcbae2212eabe38, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:21.434920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d5b98-7b27-4cec-9136-21f3ad4d9278 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:21.487814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0139e-c2f7-49fd-92dd-7289a6119e1d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:21.488425 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0139e-c2f7-49fd-92dd-7289a6119e1d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:21.488853 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1018/2018] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:21 2022] PUT /identity/v3/projects/a5114932b5b2472b836fea01f140e511/users/040d1696115b44529dcbae2212eabe38/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:21.489717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0139e-c2f7-49fd-92dd-7289a6119e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:21.555309 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d0f0139e-c2f7-49fd-92dd-7289a6119e1d None None] MFA Rules not processed for user `040d1696115b44529dcbae2212eabe38`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:21.556887 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d0f0139e-c2f7-49fd-92dd-7289a6119e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:21.732042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:21.746907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1001/2019] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:21 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:04:21.770859 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d5b98-7b27-4cec-9136-21f3ad4d9278 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:21.773466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d92d5b98-7b27-4cec-9136-21f3ad4d9278 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:21.832124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:21.849844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d5b98-7b27-4cec-9136-21f3ad4d9278 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:21.855664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a713c4e-c120-4921-9f57-946a336c18b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:21.856695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a713c4e-c120-4921-9f57-946a336c18b9 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:21.856978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a713c4e-c120-4921-9f57-946a336c18b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:21.857436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a713c4e-c120-4921-9f57-946a336c18b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:21.868969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a713c4e-c120-4921-9f57-946a336c18b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:21.870568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a713c4e-c120-4921-9f57-946a336c18b9 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:21.880804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1019/2020] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:21 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:23.736679 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0139e-c2f7-49fd-92dd-7289a6119e1d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:23.739480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d0f0139e-c2f7-49fd-92dd-7289a6119e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:23.849939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0139e-c2f7-49fd-92dd-7289a6119e1d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:23.855806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:23.856456 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:23.856740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:23.857018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] PATH_INFO: `/v3/users/711a709bcbc44a1fabedb82b3dc2864a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:23.858291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] RBAC: Authorizing `identity:delete_user(user_id=711a709bcbc44a1fabedb82b3dc2864a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:23.860896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:23.911880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '711a709bcbc44a1fabedb82b3dc2864a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:23.912553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '711a709bcbc44a1fabedb82b3dc2864a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:23.924219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '711a709bcbc44a1fabedb82b3dc2864a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:23.930938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '711a709bcbc44a1fabedb82b3dc2864a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:23.938967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '711a709bcbc44a1fabedb82b3dc2864a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:23.945200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1002/2021] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:23 2022] DELETE /identity/v3/users/711a709bcbc44a1fabedb82b3dc2864a => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:23.949957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf0a66-1d54-414c-9a5e-a03565b67c80 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:23.950413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf0a66-1d54-414c-9a5e-a03565b67c80 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:23.950528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbf0a66-1d54-414c-9a5e-a03565b67c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:23.970023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fdbf0a66-1d54-414c-9a5e-a03565b67c80 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:23.971230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fdbf0a66-1d54-414c-9a5e-a03565b67c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:24.030430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1020/2022] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:24.040794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:24.042328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:24.101543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b265ba1-00d2-464b-9616-960ef5b9240e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:24.105174 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a025b-b97c-4fd4-9d2c-dce24811252c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:24.105822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a025b-b97c-4fd4-9d2c-dce24811252c service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:24.106104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a025b-b97c-4fd4-9d2c-dce24811252c service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:24.106378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a025b-b97c-4fd4-9d2c-dce24811252c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:24.115560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a025b-b97c-4fd4-9d2c-dce24811252c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:24.117098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a025b-b97c-4fd4-9d2c-dce24811252c service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:24.127563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1003/2023] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:24.444333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf0a66-1d54-414c-9a5e-a03565b67c80 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:24.446057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fdbf0a66-1d54-414c-9a5e-a03565b67c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:24.480391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbf0a66-1d54-414c-9a5e-a03565b67c80 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:24.486420 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e256d-7385-48b2-9d9c-e06684066937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:24.487436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e256d-7385-48b2-9d9c-e06684066937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:24.487725 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e256d-7385-48b2-9d9c-e06684066937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:24.488108 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e256d-7385-48b2-9d9c-e06684066937 admin admin] PATH_INFO: `/v3/projects/9d799f62f74740e0b5b7f29caae51021` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:24.489975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e256d-7385-48b2-9d9c-e06684066937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d799f62f74740e0b5b7f29caae51021)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:24.492280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e256d-7385-48b2-9d9c-e06684066937 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:24.548263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c80e256d-7385-48b2-9d9c-e06684066937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d799f62f74740e0b5b7f29caae51021', 'request_id': 'req-c80e256d-7385-48b2-9d9c-e06684066937'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:24.557629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c80e256d-7385-48b2-9d9c-e06684066937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d799f62f74740e0b5b7f29caae51021', 'request_id': 'req-c80e256d-7385-48b2-9d9c-e06684066937'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:24.566688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c80e256d-7385-48b2-9d9c-e06684066937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d799f62f74740e0b5b7f29caae51021', 'request_id': 'req-c80e256d-7385-48b2-9d9c-e06684066937'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:24.581659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c80e256d-7385-48b2-9d9c-e06684066937 admin admin] The token cache is being invalidate because project 9d799f62f74740e0b5b7f29caae51021 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:24.582087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c80e256d-7385-48b2-9d9c-e06684066937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:24.582867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c80e256d-7385-48b2-9d9c-e06684066937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:24.584472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1021/2024] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:24 2022] DELETE /identity/v3/projects/9d799f62f74740e0b5b7f29caae51021 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:24.589883 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd56c5-09c3-4d01-9f69-538c1f259022 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:24.590178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd56c5-09c3-4d01-9f69-538c1f259022 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:24.590455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cd56c5-09c3-4d01-9f69-538c1f259022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:24.612927 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-20cd56c5-09c3-4d01-9f69-538c1f259022 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:24.614424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-20cd56c5-09c3-4d01-9f69-538c1f259022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:24.632731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:24.679359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1004/2025] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:24.688185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c404-9a38-40dc-b2bf-7cc97d20780e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:24.688474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c404-9a38-40dc-b2bf-7cc97d20780e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:24.688776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f9c404-9a38-40dc-b2bf-7cc97d20780e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:24.709085 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-61f9c404-9a38-40dc-b2bf-7cc97d20780e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:24.710333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-61f9c404-9a38-40dc-b2bf-7cc97d20780e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:24.718928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1022/2026] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:24.723236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd56c5-09c3-4d01-9f69-538c1f259022 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:24.733254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cd56c5-09c3-4d01-9f69-538c1f259022 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:24.738165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f239bc-5bf4-49fd-835b-17cc181f94d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:24.739033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f239bc-5bf4-49fd-835b-17cc181f94d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:24.739312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f239bc-5bf4-49fd-835b-17cc181f94d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:24.739583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f239bc-5bf4-49fd-835b-17cc181f94d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:24.740471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f239bc-5bf4-49fd-835b-17cc181f94d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:24.740776 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f239bc-5bf4-49fd-835b-17cc181f94d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:24.742430 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f239bc-5bf4-49fd-835b-17cc181f94d7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:24.757672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1005/2027] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:24.758908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9c404-9a38-40dc-b2bf-7cc97d20780e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:24.768915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f9c404-9a38-40dc-b2bf-7cc97d20780e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:24.773656 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1361883-3862-4e00-abfe-0ba3108c9b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:24.774275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1361883-3862-4e00-abfe-0ba3108c9b48 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:24.774555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1361883-3862-4e00-abfe-0ba3108c9b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:24.774860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1361883-3862-4e00-abfe-0ba3108c9b48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:24.775523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1361883-3862-4e00-abfe-0ba3108c9b48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:24.778107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1361883-3862-4e00-abfe-0ba3108c9b48 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:24.806348 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1023/2028] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:24 2022] POST /identity/v3/projects => generated 357 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:24.810948 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f239bc-5bf4-49fd-835b-17cc181f94d7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:24.820686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f239bc-5bf4-49fd-835b-17cc181f94d7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:24.881566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e4d40-3594-4e6f-9c37-31aba5ab3eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:24.882189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e4d40-3594-4e6f-9c37-31aba5ab3eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:24.882470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e4d40-3594-4e6f-9c37-31aba5ab3eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:24.882741 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e4d40-3594-4e6f-9c37-31aba5ab3eb3 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:24.883397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e4d40-3594-4e6f-9c37-31aba5ab3eb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:24.885381 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e4d40-3594-4e6f-9c37-31aba5ab3eb3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:24.909371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1006/2029] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:24 2022] POST /identity/v3/users => generated 279 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:24.912297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1361883-3862-4e00-abfe-0ba3108c9b48 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:24.923292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1361883-3862-4e00-abfe-0ba3108c9b48 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:24.928776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40c6a5-9d07-48b3-9379-a319912d9e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:24.929672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c6a5-9d07-48b3-9379-a319912d9e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:24.930278 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c6a5-9d07-48b3-9379-a319912d9e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:24.930751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f40c6a5-9d07-48b3-9379-a319912d9e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:24.932311 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40c6a5-9d07-48b3-9379-a319912d9e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:24.934689 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f40c6a5-9d07-48b3-9379-a319912d9e3c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:24.947271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1024/2030] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:24.951858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e4d40-3594-4e6f-9c37-31aba5ab3eb3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:24.966584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e4d40-3594-4e6f-9c37-31aba5ab3eb3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:24.971726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289d05ca-a1d8-4cc8-bb85-dbe401d9b8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:24.972340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d05ca-a1d8-4cc8-bb85-dbe401d9b8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:24.972614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d05ca-a1d8-4cc8-bb85-dbe401d9b8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:24.972880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289d05ca-a1d8-4cc8-bb85-dbe401d9b8d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:24.973598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d05ca-a1d8-4cc8-bb85-dbe401d9b8d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:24.975203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289d05ca-a1d8-4cc8-bb85-dbe401d9b8d6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:24.990682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1007/2031] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:25.012845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40c6a5-9d07-48b3-9379-a319912d9e3c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:25.053830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f40c6a5-9d07-48b3-9379-a319912d9e3c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:25.063012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709ba60-58ad-4271-a9b1-aa7d66875404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:25.063980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709ba60-58ad-4271-a9b1-aa7d66875404 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:25.065028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709ba60-58ad-4271-a9b1-aa7d66875404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:25.065618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0709ba60-58ad-4271-a9b1-aa7d66875404 admin admin] PATH_INFO: `/v3/projects/a5e6c94085ed4d8785248a00b36723b9/users/22ae36b86d6a428d9efec87e90d6381f/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:25.099448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709ba60-58ad-4271-a9b1-aa7d66875404 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5e6c94085ed4d8785248a00b36723b9, user_id=22ae36b86d6a428d9efec87e90d6381f, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:25.109718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0709ba60-58ad-4271-a9b1-aa7d66875404 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:25.135519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1025/2032] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:25 2022] PUT /identity/v3/projects/a5e6c94085ed4d8785248a00b36723b9/users/22ae36b86d6a428d9efec87e90d6381f/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:25.147387 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23a4d7-e099-4966-964c-d77146406a10 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:25.147675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23a4d7-e099-4966-964c-d77146406a10 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:25.147951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a23a4d7-e099-4966-964c-d77146406a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:25.182086 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8a23a4d7-e099-4966-964c-d77146406a10 None None] MFA Rules not processed for user `22ae36b86d6a428d9efec87e90d6381f`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:25.183899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8a23a4d7-e099-4966-964c-d77146406a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:25.253043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1008/2033] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:25 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:25.284767 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709ba60-58ad-4271-a9b1-aa7d66875404 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:25.286660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0709ba60-58ad-4271-a9b1-aa7d66875404 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:25.308680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:25.358923 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0709ba60-58ad-4271-a9b1-aa7d66875404 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:25.363267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18ffcb-143f-4c7c-b392-94ec89e4f1d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:25.364143 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18ffcb-143f-4c7c-b392-94ec89e4f1d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:25.364568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18ffcb-143f-4c7c-b392-94ec89e4f1d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:25.364848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e18ffcb-143f-4c7c-b392-94ec89e4f1d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:25.375305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18ffcb-143f-4c7c-b392-94ec89e4f1d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:25.376927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e18ffcb-143f-4c7c-b392-94ec89e4f1d0 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:25.385430 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23a4d7-e099-4966-964c-d77146406a10 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:25.386917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8a23a4d7-e099-4966-964c-d77146406a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:25.387035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1026/2034] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:25 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:25.404346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18ffcb-143f-4c7c-b392-94ec89e4f1d0 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:25.412638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:25.475012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e18ffcb-143f-4c7c-b392-94ec89e4f1d0 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:25.480227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fab360-12be-429b-94f7-15f5e8f5622e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:25.480995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fab360-12be-429b-94f7-15f5e8f5622e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:25.481400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fab360-12be-429b-94f7-15f5e8f5622e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:25.481765 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fab360-12be-429b-94f7-15f5e8f5622e admin admin] PATH_INFO: `/v3/users/22ae36b86d6a428d9efec87e90d6381f` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:25.483221 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fab360-12be-429b-94f7-15f5e8f5622e admin admin] RBAC: Authorizing `identity:delete_user(user_id=22ae36b86d6a428d9efec87e90d6381f)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:25.485238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fab360-12be-429b-94f7-15f5e8f5622e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:25.486263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a23a4d7-e099-4966-964c-d77146406a10 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:25.493713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d1ba0-7e71-4151-816d-91666fd4881c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:25.494658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d1ba0-7e71-4151-816d-91666fd4881c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:25.495135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d1ba0-7e71-4151-816d-91666fd4881c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:25.496710 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d1ba0-7e71-4151-816d-91666fd4881c admin admin] PATH_INFO: `/v3/users/8ab2b2caa5b946ffa73d5a656ce4e2c7` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:25.498299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d1ba0-7e71-4151-816d-91666fd4881c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ab2b2caa5b946ffa73d5a656ce4e2c7)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:25.500320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d1ba0-7e71-4151-816d-91666fd4881c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:25.552016 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-76fab360-12be-429b-94f7-15f5e8f5622e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22ae36b86d6a428d9efec87e90d6381f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:25.563967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-76fab360-12be-429b-94f7-15f5e8f5622e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22ae36b86d6a428d9efec87e90d6381f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:25.576845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ea9d1ba0-7e71-4151-816d-91666fd4881c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ab2b2caa5b946ffa73d5a656ce4e2c7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:25.577619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ea9d1ba0-7e71-4151-816d-91666fd4881c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ab2b2caa5b946ffa73d5a656ce4e2c7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:25.579553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-76fab360-12be-429b-94f7-15f5e8f5622e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22ae36b86d6a428d9efec87e90d6381f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:25.580288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-76fab360-12be-429b-94f7-15f5e8f5622e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22ae36b86d6a428d9efec87e90d6381f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:25.588415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-76fab360-12be-429b-94f7-15f5e8f5622e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22ae36b86d6a428d9efec87e90d6381f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:25.594660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ea9d1ba0-7e71-4151-816d-91666fd4881c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ab2b2caa5b946ffa73d5a656ce4e2c7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:25.596580 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1027/2035] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:25 2022] DELETE /identity/v3/users/22ae36b86d6a428d9efec87e90d6381f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:25.601251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41db41-4e89-4645-92f2-9aaab9efad88 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:25.601590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41db41-4e89-4645-92f2-9aaab9efad88 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:25.604129 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ea9d1ba0-7e71-4151-816d-91666fd4881c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ab2b2caa5b946ffa73d5a656ce4e2c7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:25.604373 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e41db41-4e89-4645-92f2-9aaab9efad88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:25.615379 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ea9d1ba0-7e71-4151-816d-91666fd4881c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ab2b2caa5b946ffa73d5a656ce4e2c7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:25.629019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1009/2036] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:25 2022] DELETE /identity/v3/users/8ab2b2caa5b946ffa73d5a656ce4e2c7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:25.633573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee949f80-f275-4eb2-aa09-4c0d586e3790 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:25.633863 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee949f80-f275-4eb2-aa09-4c0d586e3790 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:25.634129 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee949f80-f275-4eb2-aa09-4c0d586e3790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:25.641728 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-5e41db41-4e89-4645-92f2-9aaab9efad88 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:25.645334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5e41db41-4e89-4645-92f2-9aaab9efad88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:25.675392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:25.681642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ee949f80-f275-4eb2-aa09-4c0d586e3790 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:25.684803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ee949f80-f275-4eb2-aa09-4c0d586e3790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:25.743974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1028/2037] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:04:25.758344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41db41-4e89-4645-92f2-9aaab9efad88 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:25.759889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5e41db41-4e89-4645-92f2-9aaab9efad88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:25.775272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1010/2038] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:25.793075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee949f80-f275-4eb2-aa09-4c0d586e3790 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:25.796825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ee949f80-f275-4eb2-aa09-4c0d586e3790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:25.848524 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e41db41-4e89-4645-92f2-9aaab9efad88 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:25.852128 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f084438-5908-4219-96f2-8508310c3a4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:25.852749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f084438-5908-4219-96f2-8508310c3a4b service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:25.853030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f084438-5908-4219-96f2-8508310c3a4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:25.853326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f084438-5908-4219-96f2-8508310c3a4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:25.856302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:25.864395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f084438-5908-4219-96f2-8508310c3a4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:25.866112 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f084438-5908-4219-96f2-8508310c3a4b service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:25.878097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee949f80-f275-4eb2-aa09-4c0d586e3790 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:25.878279 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1029/2039] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:04:25.883313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b210f93-4acb-415d-ab43-b4dbcc070f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:25.884007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b210f93-4acb-415d-ab43-b4dbcc070f28 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:25.884357 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b210f93-4acb-415d-ab43-b4dbcc070f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:25.884762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b210f93-4acb-415d-ab43-b4dbcc070f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:25.896559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b210f93-4acb-415d-ab43-b4dbcc070f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:25.898177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b210f93-4acb-415d-ab43-b4dbcc070f28 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:25.912564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1011/2040] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:26.349329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f084438-5908-4219-96f2-8508310c3a4b service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:26.351223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1f084438-5908-4219-96f2-8508310c3a4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:26.368034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f084438-5908-4219-96f2-8508310c3a4b service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:26.376988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:26.377871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:26.379021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:26.379413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] PATH_INFO: `/v3/projects/e890d6cd2b5d478bbf3d12d6c0eaeacd` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:26.408620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] RBAC: Authorizing `identity:delete_project(project_id=e890d6cd2b5d478bbf3d12d6c0eaeacd)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:26.410579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:26.478342 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e890d6cd2b5d478bbf3d12d6c0eaeacd', 'request_id': 'req-80f68b7c-a5b9-4682-a323-6b7091048add'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.486079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b210f93-4acb-415d-ab43-b4dbcc070f28 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:26.487363 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e890d6cd2b5d478bbf3d12d6c0eaeacd', 'request_id': 'req-80f68b7c-a5b9-4682-a323-6b7091048add'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.488284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6b210f93-4acb-415d-ab43-b4dbcc070f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:26.496921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e890d6cd2b5d478bbf3d12d6c0eaeacd', 'request_id': 'req-80f68b7c-a5b9-4682-a323-6b7091048add'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.503686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b210f93-4acb-415d-ab43-b4dbcc070f28 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:26.517274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] The token cache is being invalidate because project e890d6cd2b5d478bbf3d12d6c0eaeacd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:26.521607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.522317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.524452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1030/2041] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:26 2022] DELETE /identity/v3/projects/e890d6cd2b5d478bbf3d12d6c0eaeacd => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:26.528471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:26.529857 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:26.608870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:26.609770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:26.610237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:26.610476 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc admin admin] PATH_INFO: `/v3/projects/a5e6c94085ed4d8785248a00b36723b9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:26.611766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5e6c94085ed4d8785248a00b36723b9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:26.614187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:26.614679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:26.621833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f68b7c-a5b9-4682-a323-6b7091048add admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:26.630237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c717e67f-da02-428d-b8c5-8f6787784bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:26.631136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717e67f-da02-428d-b8c5-8f6787784bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:26.631528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717e67f-da02-428d-b8c5-8f6787784bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:26.631818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c717e67f-da02-428d-b8c5-8f6787784bd6 admin admin] PATH_INFO: `/v3/users/a4ff3d10d4fb4f95870aea379aa618ca` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:26.634082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717e67f-da02-428d-b8c5-8f6787784bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ff3d10d4fb4f95870aea379aa618ca)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:26.636958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c717e67f-da02-428d-b8c5-8f6787784bd6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:26.678273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5e6c94085ed4d8785248a00b36723b9', 'request_id': 'req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.685755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5e6c94085ed4d8785248a00b36723b9', 'request_id': 'req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.695930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5e6c94085ed4d8785248a00b36723b9', 'request_id': 'req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.700410 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c717e67f-da02-428d-b8c5-8f6787784bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ff3d10d4fb4f95870aea379aa618ca'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.710183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c717e67f-da02-428d-b8c5-8f6787784bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ff3d10d4fb4f95870aea379aa618ca'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.712373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc admin admin] The token cache is being invalidate because project a5e6c94085ed4d8785248a00b36723b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:26.712944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.713844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ddf86a4-b14f-4bc6-bb97-07e903cfdcbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.716187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1012/2042] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:26 2022] DELETE /identity/v3/projects/a5e6c94085ed4d8785248a00b36723b9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:26.721486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada049e-6855-4451-9aec-9d29549a3367 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:26.722203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada049e-6855-4451-9aec-9d29549a3367 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:26.722656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ada049e-6855-4451-9aec-9d29549a3367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:26.728912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c717e67f-da02-428d-b8c5-8f6787784bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ff3d10d4fb4f95870aea379aa618ca'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.730193 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c717e67f-da02-428d-b8c5-8f6787784bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ff3d10d4fb4f95870aea379aa618ca'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.737559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c717e67f-da02-428d-b8c5-8f6787784bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ff3d10d4fb4f95870aea379aa618ca'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:26.744119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1031/2043] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:26 2022] DELETE /identity/v3/users/a4ff3d10d4fb4f95870aea379aa618ca => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:26.747531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8ada049e-6855-4451-9aec-9d29549a3367 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:26.750730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8ada049e-6855-4451-9aec-9d29549a3367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:26.850919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1013/2044] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:04:26.853371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19131d-dec6-4996-8420-041ee4309b2d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:26.855101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19131d-dec6-4996-8420-041ee4309b2d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:26.855424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19131d-dec6-4996-8420-041ee4309b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:26.879699 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4b19131d-dec6-4996-8420-041ee4309b2d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:26.880926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4b19131d-dec6-4996-8420-041ee4309b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:26.891231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1032/2045] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:26.896148 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada049e-6855-4451-9aec-9d29549a3367 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:26.909666 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ada049e-6855-4451-9aec-9d29549a3367 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:26.924289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0fde0-c5fb-4411-804f-6eb4838b0039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:26.924928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0fde0-c5fb-4411-804f-6eb4838b0039 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:26.925256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0fde0-c5fb-4411-804f-6eb4838b0039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:26.925554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f0fde0-c5fb-4411-804f-6eb4838b0039 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:26.926255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0fde0-c5fb-4411-804f-6eb4838b0039 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:26.926553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0fde0-c5fb-4411-804f-6eb4838b0039 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:26.928178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f0fde0-c5fb-4411-804f-6eb4838b0039 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:26.938581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:26.944098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1014/2046] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:26.950682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19131d-dec6-4996-8420-041ee4309b2d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:26.964119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19131d-dec6-4996-8420-041ee4309b2d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:26.969930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460d235-cc5d-4e8f-9a7c-8adc72844134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:26.970604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460d235-cc5d-4e8f-9a7c-8adc72844134 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:26.970834 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460d235-cc5d-4e8f-9a7c-8adc72844134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:26.971105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460d235-cc5d-4e8f-9a7c-8adc72844134 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:26.971835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460d235-cc5d-4e8f-9a7c-8adc72844134 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:26.974269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460d235-cc5d-4e8f-9a7c-8adc72844134 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:27.009352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1033/2047] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:26 2022] POST /identity/v3/projects => generated 389 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:27.010682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0fde0-c5fb-4411-804f-6eb4838b0039 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:27.020851 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f0fde0-c5fb-4411-804f-6eb4838b0039 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:27.080445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0ecf1-b571-4218-936b-1c0263d7f1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:27.081070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ecf1-b571-4218-936b-1c0263d7f1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.081381 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ecf1-b571-4218-936b-1c0263d7f1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.081664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f0ecf1-b571-4218-936b-1c0263d7f1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.082358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0ecf1-b571-4218-936b-1c0263d7f1b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:27.084312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f0ecf1-b571-4218-936b-1c0263d7f1b8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:27.108010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1015/2048] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:27 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:27.111704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460d235-cc5d-4e8f-9a7c-8adc72844134 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:27.122981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460d235-cc5d-4e8f-9a7c-8adc72844134 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:27.127923 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa51d8-8cd6-4708-8a23-6d10074ee719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:27.128539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa51d8-8cd6-4708-8a23-6d10074ee719 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.128821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa51d8-8cd6-4708-8a23-6d10074ee719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.129165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa51d8-8cd6-4708-8a23-6d10074ee719 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.131419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa51d8-8cd6-4708-8a23-6d10074ee719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:27.133641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa51d8-8cd6-4708-8a23-6d10074ee719 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:27.149062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1034/2049] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:27.150244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0ecf1-b571-4218-936b-1c0263d7f1b8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:27.161442 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f0ecf1-b571-4218-936b-1c0263d7f1b8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:27.168327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8626f-276d-4a7c-a626-b4bab9236a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:27.169329 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8626f-276d-4a7c-a626-b4bab9236a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.169329 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8626f-276d-4a7c-a626-b4bab9236a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.169862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8626f-276d-4a7c-a626-b4bab9236a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.170365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8626f-276d-4a7c-a626-b4bab9236a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:27.171991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8626f-276d-4a7c-a626-b4bab9236a0b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:27.190152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1016/2050] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:27 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:27.194467 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa51d8-8cd6-4708-8a23-6d10074ee719 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:27.215471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa51d8-8cd6-4708-8a23-6d10074ee719 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:27.222046 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545167c-9697-4151-94be-497979b444b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:27.222728 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545167c-9697-4151-94be-497979b444b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.223007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545167c-9697-4151-94be-497979b444b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.223278 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545167c-9697-4151-94be-497979b444b7 admin admin] PATH_INFO: `/v3/projects/ec25dfc98fe8416ba74a9416932d8eba/users/7f20d69613774f4591e2c81c4e5ffe1c/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.243653 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545167c-9697-4151-94be-497979b444b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec25dfc98fe8416ba74a9416932d8eba, user_id=7f20d69613774f4591e2c81c4e5ffe1c, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:27.246565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545167c-9697-4151-94be-497979b444b7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:27.277272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1035/2051] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:27 2022] PUT /identity/v3/projects/ec25dfc98fe8416ba74a9416932d8eba/users/7f20d69613774f4591e2c81c4e5ffe1c/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:27.296009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0fdcf-cdee-4c27-a84b-1e5d0f67360e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.296789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0fdcf-cdee-4c27-a84b-1e5d0f67360e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.297170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0fdcf-cdee-4c27-a84b-1e5d0f67360e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.317190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545167c-9697-4151-94be-497979b444b7 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:27.319255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0545167c-9697-4151-94be-497979b444b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:27.357239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b4f0fdcf-cdee-4c27-a84b-1e5d0f67360e None None] MFA Rules not processed for user `7f20d69613774f4591e2c81c4e5ffe1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:27.365187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b4f0fdcf-cdee-4c27-a84b-1e5d0f67360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:27.414558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545167c-9697-4151-94be-497979b444b7 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:27.423142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:27.425256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.426092 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.426338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] PATH_INFO: `/v3/users/040d1696115b44529dcbae2212eabe38` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.427783 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=040d1696115b44529dcbae2212eabe38)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:27.430912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:27.469527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:27.486709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1017/2052] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:27.492933 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0fdcf-cdee-4c27-a84b-1e5d0f67360e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:27.495744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b4f0fdcf-cdee-4c27-a84b-1e5d0f67360e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:27.518885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0fdcf-cdee-4c27-a84b-1e5d0f67360e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:27.530087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32d4197-a0ed-4b9d-b123-722f8d35859a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:27.530999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4197-a0ed-4b9d-b123-722f8d35859a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.531280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4197-a0ed-4b9d-b123-722f8d35859a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.531557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32d4197-a0ed-4b9d-b123-722f8d35859a admin admin] PATH_INFO: `/v3/projects/b6b4a5cbbf484b00b20febc9e6553364` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.533028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d4197-a0ed-4b9d-b123-722f8d35859a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6b4a5cbbf484b00b20febc9e6553364)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:27.533396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '040d1696115b44529dcbae2212eabe38'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:27.534997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32d4197-a0ed-4b9d-b123-722f8d35859a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:27.544492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '040d1696115b44529dcbae2212eabe38'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:27.564626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '040d1696115b44529dcbae2212eabe38'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:27.565635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '040d1696115b44529dcbae2212eabe38'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:27.574717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '040d1696115b44529dcbae2212eabe38'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:27.581917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1036/2053] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:27 2022] DELETE /identity/v3/users/040d1696115b44529dcbae2212eabe38 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:27.585942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:27.587567 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:27.600861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d32d4197-a0ed-4b9d-b123-722f8d35859a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6b4a5cbbf484b00b20febc9e6553364', 'request_id': 'req-d32d4197-a0ed-4b9d-b123-722f8d35859a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:27.607524 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d32d4197-a0ed-4b9d-b123-722f8d35859a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6b4a5cbbf484b00b20febc9e6553364', 'request_id': 'req-d32d4197-a0ed-4b9d-b123-722f8d35859a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:27.611641 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:27.619091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d32d4197-a0ed-4b9d-b123-722f8d35859a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6b4a5cbbf484b00b20febc9e6553364', 'request_id': 'req-d32d4197-a0ed-4b9d-b123-722f8d35859a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:27.638756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d32d4197-a0ed-4b9d-b123-722f8d35859a admin admin] The token cache is being invalidate because project b6b4a5cbbf484b00b20febc9e6553364 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:27.639273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d32d4197-a0ed-4b9d-b123-722f8d35859a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:27.640389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d32d4197-a0ed-4b9d-b123-722f8d35859a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:27.642615 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1018/2054] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:27 2022] DELETE /identity/v3/projects/b6b4a5cbbf484b00b20febc9e6553364 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:27.644217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44994f9d-a70b-43ef-b13a-9990810dd797 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.644707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44994f9d-a70b-43ef-b13a-9990810dd797 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.645396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44994f9d-a70b-43ef-b13a-9990810dd797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.667739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-44994f9d-a70b-43ef-b13a-9990810dd797 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:27.669553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-44994f9d-a70b-43ef-b13a-9990810dd797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:27.674348 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23251a-5802-4bc4-b5bb-3c39ec366437 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:27.731398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cadeb4a-5f5b-4ce1-8dfe-270508fa1d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:27.732119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadeb4a-5f5b-4ce1-8dfe-270508fa1d1e service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.732470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadeb4a-5f5b-4ce1-8dfe-270508fa1d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.732798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cadeb4a-5f5b-4ce1-8dfe-270508fa1d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.735810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3cadeb4a-5f5b-4ce1-8dfe-270508fa1d1e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:27.740580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1019/2055] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:27.741892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75a0d4-dc35-4fef-8017-42f189f39096 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.742179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75a0d4-dc35-4fef-8017-42f189f39096 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.742452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f75a0d4-dc35-4fef-8017-42f189f39096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.762508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8f75a0d4-dc35-4fef-8017-42f189f39096 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:27.763708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8f75a0d4-dc35-4fef-8017-42f189f39096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:27.771887 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1020/2056] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:27.772548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75a0d4-dc35-4fef-8017-42f189f39096 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:27.773817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8f75a0d4-dc35-4fef-8017-42f189f39096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:27.841802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f75a0d4-dc35-4fef-8017-42f189f39096 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:27.843369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadeb4a-5f5b-4ce1-8dfe-270508fa1d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:27.845002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cadeb4a-5f5b-4ce1-8dfe-270508fa1d1e service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:27.847453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b6398-a9bc-4b5e-aa84-0c3e32053807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:27.848154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b6398-a9bc-4b5e-aa84-0c3e32053807 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.848501 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b6398-a9bc-4b5e-aa84-0c3e32053807 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.848842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b6398-a9bc-4b5e-aa84-0c3e32053807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.850910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:27.857065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1037/2057] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:27 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:27.858567 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178710eb-616e-4a51-905d-450b532bd5e0 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.859357 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178710eb-616e-4a51-905d-450b532bd5e0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.859977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178710eb-616e-4a51-905d-450b532bd5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.877314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b6398-a9bc-4b5e-aa84-0c3e32053807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:27.878793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33b6398-a9bc-4b5e-aa84-0c3e32053807 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:27.887272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-178710eb-616e-4a51-905d-450b532bd5e0 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:27.888671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-178710eb-616e-4a51-905d-450b532bd5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:27.890058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1021/2058] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:27.897931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1038/2059] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:27.902538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b6398-a9bc-4b5e-aa84-0c3e32053807 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:27.914899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b6398-a9bc-4b5e-aa84-0c3e32053807 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:27.923211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441c08d-5826-4b6d-9d2b-d08129d30112 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:27.924772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441c08d-5826-4b6d-9d2b-d08129d30112 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.925062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441c08d-5826-4b6d-9d2b-d08129d30112 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.925371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9441c08d-5826-4b6d-9d2b-d08129d30112 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.926079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441c08d-5826-4b6d-9d2b-d08129d30112 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:27.926377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441c08d-5826-4b6d-9d2b-d08129d30112 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:27.928172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9441c08d-5826-4b6d-9d2b-d08129d30112 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:27.944696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1022/2060] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:27.950938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178710eb-616e-4a51-905d-450b532bd5e0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:27.963672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178710eb-616e-4a51-905d-450b532bd5e0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:27.971210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2fc5-5359-4d35-872e-d1e7f2558fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:27.972307 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2fc5-5359-4d35-872e-d1e7f2558fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:27.972747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2fc5-5359-4d35-872e-d1e7f2558fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:27.975264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fb2fc5-5359-4d35-872e-d1e7f2558fe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:27.976167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb2fc5-5359-4d35-872e-d1e7f2558fe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:27.978700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fb2fc5-5359-4d35-872e-d1e7f2558fe0 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:28.056120 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1039/2061] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:27 2022] POST /identity/v3/projects => generated 367 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:28.057548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441c08d-5826-4b6d-9d2b-d08129d30112 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:28.071435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9441c08d-5826-4b6d-9d2b-d08129d30112 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:28.241622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b66e4c-748d-46aa-8ae2-3fea33c626c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:28.242257 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b66e4c-748d-46aa-8ae2-3fea33c626c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:28.242537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b66e4c-748d-46aa-8ae2-3fea33c626c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:28.242810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b66e4c-748d-46aa-8ae2-3fea33c626c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:28.243471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b66e4c-748d-46aa-8ae2-3fea33c626c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:28.250167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b66e4c-748d-46aa-8ae2-3fea33c626c8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:28.302088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1023/2062] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:28 2022] POST /identity/v3/users => generated 284 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:28.308365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2fc5-5359-4d35-872e-d1e7f2558fe0 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:28.333684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fb2fc5-5359-4d35-872e-d1e7f2558fe0 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:28.368769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0def-926e-4130-9605-91097e95389d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:28.369685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0def-926e-4130-9605-91097e95389d admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:28.369970 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0def-926e-4130-9605-91097e95389d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:28.370813 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b0def-926e-4130-9605-91097e95389d admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:28.371555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0def-926e-4130-9605-91097e95389d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:28.373255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b0def-926e-4130-9605-91097e95389d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:28.387011 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1040/2063] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:28.391070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b66e4c-748d-46aa-8ae2-3fea33c626c8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:28.397340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:28.404416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b66e4c-748d-46aa-8ae2-3fea33c626c8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:28.414388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f6ba7-84d5-4040-84cd-63a4c58d48da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:28.415069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f6ba7-84d5-4040-84cd-63a4c58d48da admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:28.415345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f6ba7-84d5-4040-84cd-63a4c58d48da admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:28.415616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f6ba7-84d5-4040-84cd-63a4c58d48da admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:28.416320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f6ba7-84d5-4040-84cd-63a4c58d48da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:28.419599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f6ba7-84d5-4040-84cd-63a4c58d48da admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:28.444047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1024/2064] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:28 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:28.445204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0def-926e-4130-9605-91097e95389d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:28.458048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b0def-926e-4130-9605-91097e95389d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:28.463071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99d14f6-4c1b-4e71-b47f-d7964f577662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:28.463642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d14f6-4c1b-4e71-b47f-d7964f577662 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:28.463948 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d14f6-4c1b-4e71-b47f-d7964f577662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:28.464227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99d14f6-4c1b-4e71-b47f-d7964f577662 admin admin] PATH_INFO: `/v3/projects/208db02817e8475682bd8e25a560695e/users/d6ed544d3b924732955bcd8ed5d82364/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:28.477614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f6ba7-84d5-4040-84cd-63a4c58d48da admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:28.482934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e76f6ba7-84d5-4040-84cd-63a4c58d48da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:28.488876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d14f6-4c1b-4e71-b47f-d7964f577662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208db02817e8475682bd8e25a560695e, user_id=d6ed544d3b924732955bcd8ed5d82364, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:28.491815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99d14f6-4c1b-4e71-b47f-d7964f577662 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:28.512131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f6ba7-84d5-4040-84cd-63a4c58d48da admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:28.533269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1041/2065] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:28 2022] PUT /identity/v3/projects/208db02817e8475682bd8e25a560695e/users/d6ed544d3b924732955bcd8ed5d82364/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:28.538359 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31991-5671-4954-a3f7-32badccbf819 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:28.538777 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31991-5671-4954-a3f7-32badccbf819 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:28.539540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b31991-5671-4954-a3f7-32badccbf819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:28.605284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:28.606069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:28.606443 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:28.606917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] PATH_INFO: `/v3/projects/a5114932b5b2472b836fea01f140e511` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:28.608760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5114932b5b2472b836fea01f140e511)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:28.611632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-30b31991-5671-4954-a3f7-32badccbf819 None None] MFA Rules not processed for user `d6ed544d3b924732955bcd8ed5d82364`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:28.623248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:28.627973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-30b31991-5671-4954-a3f7-32badccbf819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:28.723814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1042/2066] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:04:28.728750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b31991-5671-4954-a3f7-32badccbf819 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:28.744176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5114932b5b2472b836fea01f140e511', 'request_id': 'req-b9385dba-80e1-479f-b03e-c4c19b566b08'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:28.745836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b31991-5671-4954-a3f7-32badccbf819 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:28.752827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5114932b5b2472b836fea01f140e511', 'request_id': 'req-b9385dba-80e1-479f-b03e-c4c19b566b08'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:28.779221 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5114932b5b2472b836fea01f140e511', 'request_id': 'req-b9385dba-80e1-479f-b03e-c4c19b566b08'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:28.800124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] The token cache is being invalidate because project a5114932b5b2472b836fea01f140e511 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:28.800860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:28.801772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:28.805596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1025/2067] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:28 2022] DELETE /identity/v3/projects/a5114932b5b2472b836fea01f140e511 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:28.867147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c06f60-cd2d-47b8-80ba-bad38e524e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:28.869964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c06f60-cd2d-47b8-80ba-bad38e524e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:28.870437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c06f60-cd2d-47b8-80ba-bad38e524e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:28.870834 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c06f60-cd2d-47b8-80ba-bad38e524e4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:28.871676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c06f60-cd2d-47b8-80ba-bad38e524e4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:28.874395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c06f60-cd2d-47b8-80ba-bad38e524e4a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:28.941713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:28.946595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:28.950050 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1043/2068] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:28 2022] POST /identity/v3/projects => generated 367 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:29.016109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9385dba-80e1-479f-b03e-c4c19b566b08 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:29.149626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ee2b9-cfd1-439b-a4dc-5ad25844fdab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:29.150360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ee2b9-cfd1-439b-a4dc-5ad25844fdab admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:29.150539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ee2b9-cfd1-439b-a4dc-5ad25844fdab admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:29.150941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8ee2b9-cfd1-439b-a4dc-5ad25844fdab admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:29.152116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ee2b9-cfd1-439b-a4dc-5ad25844fdab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:29.154576 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8ee2b9-cfd1-439b-a4dc-5ad25844fdab admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:29.189632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1026/2069] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:28 2022] POST /identity/v3/users => generated 290 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:29.190337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c06f60-cd2d-47b8-80ba-bad38e524e4a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:29.203687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c06f60-cd2d-47b8-80ba-bad38e524e4a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:29.209820 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4ef57-9234-49f2-9fd6-94a73667af0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:29.210454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4ef57-9234-49f2-9fd6-94a73667af0f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:29.210732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4ef57-9234-49f2-9fd6-94a73667af0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:29.211084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d4ef57-9234-49f2-9fd6-94a73667af0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:29.211791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4ef57-9234-49f2-9fd6-94a73667af0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:29.213723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d4ef57-9234-49f2-9fd6-94a73667af0f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:29.221066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:29.227233 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1044/2070] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:29.233198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ee2b9-cfd1-439b-a4dc-5ad25844fdab admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:29.245814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8ee2b9-cfd1-439b-a4dc-5ad25844fdab admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:29.252103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1fd4-e0dc-4356-a15d-1ce68cedad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:29.252897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1fd4-e0dc-4356-a15d-1ce68cedad16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:29.253264 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1fd4-e0dc-4356-a15d-1ce68cedad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:29.253647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac1fd4-e0dc-4356-a15d-1ce68cedad16 admin admin] PATH_INFO: `/v3/projects/868d31e497d84e338193feaff7119c07/users/b6b2160c38464620a418feec6937fc95/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:29.265665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:29.275249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac1fd4-e0dc-4356-a15d-1ce68cedad16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=868d31e497d84e338193feaff7119c07, user_id=b6b2160c38464620a418feec6937fc95, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:29.279860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac1fd4-e0dc-4356-a15d-1ce68cedad16 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:29.309386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1027/2071] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:29 2022] PUT /identity/v3/projects/868d31e497d84e338193feaff7119c07/users/b6b2160c38464620a418feec6937fc95/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:29.312029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4ef57-9234-49f2-9fd6-94a73667af0f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:29.324172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d4ef57-9234-49f2-9fd6-94a73667af0f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:29.393097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a90872-1f55-40b0-baec-d5b75fd43d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:29.393784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a90872-1f55-40b0-baec-d5b75fd43d27 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:29.394052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a90872-1f55-40b0-baec-d5b75fd43d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:29.394326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a90872-1f55-40b0-baec-d5b75fd43d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:29.395060 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a90872-1f55-40b0-baec-d5b75fd43d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:29.396679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a90872-1f55-40b0-baec-d5b75fd43d27 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:29.419492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1045/2072] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:29.420743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1fd4-e0dc-4356-a15d-1ce68cedad16 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:29.442541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac1fd4-e0dc-4356-a15d-1ce68cedad16 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:29.454442 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894ccc4-d907-43df-ab85-6a60b797f1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:29.455140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894ccc4-d907-43df-ab85-6a60b797f1fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:29.455422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894ccc4-d907-43df-ab85-6a60b797f1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:29.455705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894ccc4-d907-43df-ab85-6a60b797f1fb admin admin] PATH_INFO: `/v3/projects/868d31e497d84e338193feaff7119c07/users/b6b2160c38464620a418feec6937fc95/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:29.458951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894ccc4-d907-43df-ab85-6a60b797f1fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=868d31e497d84e338193feaff7119c07, user_id=b6b2160c38464620a418feec6937fc95, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:29.461907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894ccc4-d907-43df-ab85-6a60b797f1fb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:29.489806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1028/2073] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:29 2022] PUT /identity/v3/projects/868d31e497d84e338193feaff7119c07/users/b6b2160c38464620a418feec6937fc95/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:29.495955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aba3e9-901d-4163-9c87-50651ee1abff None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:29.496486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aba3e9-901d-4163-9c87-50651ee1abff None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:29.496486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aba3e9-901d-4163-9c87-50651ee1abff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:29.547275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-59aba3e9-901d-4163-9c87-50651ee1abff None None] MFA Rules not processed for user `b6b2160c38464620a418feec6937fc95`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:29.549679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-59aba3e9-901d-4163-9c87-50651ee1abff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:29.732749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1046/2074] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:29 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:29.828567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894ccc4-d907-43df-ab85-6a60b797f1fb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:29.834544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7894ccc4-d907-43df-ab85-6a60b797f1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:29.908401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894ccc4-d907-43df-ab85-6a60b797f1fb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:29.912478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ea36a-9dea-4474-a4b0-0f023d86ab07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:29.913242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ea36a-9dea-4474-a4b0-0f023d86ab07 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:29.913663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ea36a-9dea-4474-a4b0-0f023d86ab07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:29.914030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ea36a-9dea-4474-a4b0-0f023d86ab07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:29.925042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ea36a-9dea-4474-a4b0-0f023d86ab07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:29.927021 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ea36a-9dea-4474-a4b0-0f023d86ab07 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:29.949917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1029/2075] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:29 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:30.032420 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aba3e9-901d-4163-9c87-50651ee1abff None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:30.034050 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-59aba3e9-901d-4163-9c87-50651ee1abff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:30.053942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aba3e9-901d-4163-9c87-50651ee1abff None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:30.059696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef18a70-5f7e-49c3-b1c3-1daac98c85b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:30.060680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18a70-5f7e-49c3-b1c3-1daac98c85b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:30.061165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18a70-5f7e-49c3-b1c3-1daac98c85b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:30.061680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef18a70-5f7e-49c3-b1c3-1daac98c85b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:30.064431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6ef18a70-5f7e-49c3-b1c3-1daac98c85b2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:30.157663 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef18a70-5f7e-49c3-b1c3-1daac98c85b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:30.159793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef18a70-5f7e-49c3-b1c3-1daac98c85b2 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:30.174734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1047/2076] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:30 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:34.060476 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ea36a-9dea-4474-a4b0-0f023d86ab07 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:34.172831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ea36a-9dea-4474-a4b0-0f023d86ab07 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:34.195934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:34.207560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:34.207560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:34.207560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] PATH_INFO: `/v3/users/d6ed544d3b924732955bcd8ed5d82364` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:34.207560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6ed544d3b924732955bcd8ed5d82364)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:34.207560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:34.258323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6ed544d3b924732955bcd8ed5d82364'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:34.258987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6ed544d3b924732955bcd8ed5d82364'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:34.271239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6ed544d3b924732955bcd8ed5d82364'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:34.277996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6ed544d3b924732955bcd8ed5d82364'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:34.281748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:34.297736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6ed544d3b924732955bcd8ed5d82364'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:34.308854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1030/2077] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:34 2022] DELETE /identity/v3/users/d6ed544d3b924732955bcd8ed5d82364 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:34.311074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561b8c9-73d7-4b66-b711-ede14913771b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:34.311915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561b8c9-73d7-4b66-b711-ede14913771b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:34.311915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a561b8c9-73d7-4b66-b711-ede14913771b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:34.334684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a561b8c9-73d7-4b66-b711-ede14913771b None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:34.336092 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a561b8c9-73d7-4b66-b711-ede14913771b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:34.350657 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:34.410242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1048/2078] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:34.418563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:34.420401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:34.483837 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa86e9-6a08-40f6-8e44-ab34ad88f71a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:34.487827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0641bb2-9de0-4e66-84c0-9d4814dcce40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:34.488455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0641bb2-9de0-4e66-84c0-9d4814dcce40 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:34.488990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0641bb2-9de0-4e66-84c0-9d4814dcce40 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:34.489263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0641bb2-9de0-4e66-84c0-9d4814dcce40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:34.501599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0641bb2-9de0-4e66-84c0-9d4814dcce40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:34.503028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0641bb2-9de0-4e66-84c0-9d4814dcce40 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:34.512965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1031/2079] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:34.812069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561b8c9-73d7-4b66-b711-ede14913771b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:34.813553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a561b8c9-73d7-4b66-b711-ede14913771b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:34.825630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a561b8c9-73d7-4b66-b711-ede14913771b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:34.830864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:34.831533 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:34.831806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:34.832079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] PATH_INFO: `/v3/projects/208db02817e8475682bd8e25a560695e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:34.833431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] RBAC: Authorizing `identity:delete_project(project_id=208db02817e8475682bd8e25a560695e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:34.835364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:34.894781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208db02817e8475682bd8e25a560695e', 'request_id': 'req-0f73eed5-8175-4558-b962-36bb0d2f7795'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:34.903743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208db02817e8475682bd8e25a560695e', 'request_id': 'req-0f73eed5-8175-4558-b962-36bb0d2f7795'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:34.910151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208db02817e8475682bd8e25a560695e', 'request_id': 'req-0f73eed5-8175-4558-b962-36bb0d2f7795'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:34.923980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] The token cache is being invalidate because project 208db02817e8475682bd8e25a560695e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:34.924268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:34.924895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:34.926500 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1049/2080] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:34 2022] DELETE /identity/v3/projects/208db02817e8475682bd8e25a560695e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:34.930669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0641bb2-9de0-4e66-84c0-9d4814dcce40 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:34.940829 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0641bb2-9de0-4e66-84c0-9d4814dcce40 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:35.001327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02c9d3-e93a-457d-8bc2-c5bfe0abf9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:35.001980 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c9d3-e93a-457d-8bc2-c5bfe0abf9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:35.002258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c9d3-e93a-457d-8bc2-c5bfe0abf9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:35.002534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02c9d3-e93a-457d-8bc2-c5bfe0abf9ae admin admin] PATH_INFO: `/v3/users/b6b2160c38464620a418feec6937fc95` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:35.003709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02c9d3-e93a-457d-8bc2-c5bfe0abf9ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6b2160c38464620a418feec6937fc95)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:35.005732 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02c9d3-e93a-457d-8bc2-c5bfe0abf9ae admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:35.063875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6d02c9d3-e93a-457d-8bc2-c5bfe0abf9ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6b2160c38464620a418feec6937fc95'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:35.064547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6d02c9d3-e93a-457d-8bc2-c5bfe0abf9ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6b2160c38464620a418feec6937fc95'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:35.079844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6d02c9d3-e93a-457d-8bc2-c5bfe0abf9ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6b2160c38464620a418feec6937fc95'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:35.092161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6d02c9d3-e93a-457d-8bc2-c5bfe0abf9ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6b2160c38464620a418feec6937fc95'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:35.102294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6d02c9d3-e93a-457d-8bc2-c5bfe0abf9ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6b2160c38464620a418feec6937fc95'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:35.115558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1032/2081] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:34 2022] DELETE /identity/v3/users/b6b2160c38464620a418feec6937fc95 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:35.474773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:35.476804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:35.503213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f73eed5-8175-4558-b962-36bb0d2f7795 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:35.576564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac23997-9a32-46d8-9f2b-27fc14ca4183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:35.577213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac23997-9a32-46d8-9f2b-27fc14ca4183 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:35.577526 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac23997-9a32-46d8-9f2b-27fc14ca4183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:35.577798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac23997-9a32-46d8-9f2b-27fc14ca4183 admin admin] PATH_INFO: `/v3/projects/868d31e497d84e338193feaff7119c07` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:35.578972 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac23997-9a32-46d8-9f2b-27fc14ca4183 admin admin] RBAC: Authorizing `identity:delete_project(project_id=868d31e497d84e338193feaff7119c07)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:35.580936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac23997-9a32-46d8-9f2b-27fc14ca4183 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:35.638402 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:35.640583 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6ac23997-9a32-46d8-9f2b-27fc14ca4183 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '868d31e497d84e338193feaff7119c07', 'request_id': 'req-6ac23997-9a32-46d8-9f2b-27fc14ca4183'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:35.649928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6ac23997-9a32-46d8-9f2b-27fc14ca4183 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '868d31e497d84e338193feaff7119c07', 'request_id': 'req-6ac23997-9a32-46d8-9f2b-27fc14ca4183'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:35.658370 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6ac23997-9a32-46d8-9f2b-27fc14ca4183 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '868d31e497d84e338193feaff7119c07', 'request_id': 'req-6ac23997-9a32-46d8-9f2b-27fc14ca4183'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:35.683734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6ac23997-9a32-46d8-9f2b-27fc14ca4183 admin admin] The token cache is being invalidate because project 868d31e497d84e338193feaff7119c07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:35.684287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6ac23997-9a32-46d8-9f2b-27fc14ca4183 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:35.686479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6ac23997-9a32-46d8-9f2b-27fc14ca4183 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:35.688324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1050/2082] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:35 2022] DELETE /identity/v3/projects/868d31e497d84e338193feaff7119c07 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:35.694268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c36033-6a12-4590-b393-e70792ac97e3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:35.694268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c36033-6a12-4590-b393-e70792ac97e3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:35.694268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c36033-6a12-4590-b393-e70792ac97e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:35.714677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e4c36033-6a12-4590-b393-e70792ac97e3 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:35.715865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e4c36033-6a12-4590-b393-e70792ac97e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:35.729014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:35.786200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1033/2083] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:35.795350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c5da6-bdd4-4944-b99b-9f1f44c050f2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:35.795639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c5da6-bdd4-4944-b99b-9f1f44c050f2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:35.795909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c5da6-bdd4-4944-b99b-9f1f44c050f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:35.816090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-113c5da6-bdd4-4944-b99b-9f1f44c050f2 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:35.817315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-113c5da6-bdd4-4944-b99b-9f1f44c050f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:35.825426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1051/2084] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:35.829719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c36033-6a12-4590-b393-e70792ac97e3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:35.839968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c36033-6a12-4590-b393-e70792ac97e3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:35.845373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb6f62-4664-4798-aab7-2ff83b086036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:35.847219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb6f62-4664-4798-aab7-2ff83b086036 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:35.847501 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb6f62-4664-4798-aab7-2ff83b086036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:35.847766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb6f62-4664-4798-aab7-2ff83b086036 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:35.848471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb6f62-4664-4798-aab7-2ff83b086036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:35.848800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb6f62-4664-4798-aab7-2ff83b086036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:35.850558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb6f62-4664-4798-aab7-2ff83b086036 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:35.865752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1034/2085] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:35.868927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c5da6-bdd4-4944-b99b-9f1f44c050f2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:35.878963 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c5da6-bdd4-4944-b99b-9f1f44c050f2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:35.883912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341a624-6a21-4bde-87c9-e0d1a51c674b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:35.884593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341a624-6a21-4bde-87c9-e0d1a51c674b admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:35.884940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341a624-6a21-4bde-87c9-e0d1a51c674b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:35.885274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a341a624-6a21-4bde-87c9-e0d1a51c674b admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:35.886524 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341a624-6a21-4bde-87c9-e0d1a51c674b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:35.888541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a341a624-6a21-4bde-87c9-e0d1a51c674b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:35.920111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1052/2086] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:35 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:35.921277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb6f62-4664-4798-aab7-2ff83b086036 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:35.931794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb6f62-4664-4798-aab7-2ff83b086036 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:35.998642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d2e31-a3d9-4e91-984b-fe6ec94a4721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:35.999548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d2e31-a3d9-4e91-984b-fe6ec94a4721 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.000000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d2e31-a3d9-4e91-984b-fe6ec94a4721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.000374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1d2e31-a3d9-4e91-984b-fe6ec94a4721 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.001146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d2e31-a3d9-4e91-984b-fe6ec94a4721 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:36.003319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1d2e31-a3d9-4e91-984b-fe6ec94a4721 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:36.035214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1035/2087] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:35 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:36.039247 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341a624-6a21-4bde-87c9-e0d1a51c674b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:36.058275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a341a624-6a21-4bde-87c9-e0d1a51c674b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:36.067274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ae95e-6701-455b-83b8-facf1057436c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:36.068399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ae95e-6701-455b-83b8-facf1057436c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.069129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ae95e-6701-455b-83b8-facf1057436c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.069593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ae95e-6701-455b-83b8-facf1057436c admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.070514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ae95e-6701-455b-83b8-facf1057436c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:36.072926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ae95e-6701-455b-83b8-facf1057436c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:36.090691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1053/2088] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:36.094936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d2e31-a3d9-4e91-984b-fe6ec94a4721 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:36.106118 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1d2e31-a3d9-4e91-984b-fe6ec94a4721 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:36.111385 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344821e2-fcc2-4aec-8ae5-8a53f8c99957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:36.112030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344821e2-fcc2-4aec-8ae5-8a53f8c99957 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.112313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344821e2-fcc2-4aec-8ae5-8a53f8c99957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.112592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344821e2-fcc2-4aec-8ae5-8a53f8c99957 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.113346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344821e2-fcc2-4aec-8ae5-8a53f8c99957 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:36.115276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344821e2-fcc2-4aec-8ae5-8a53f8c99957 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:36.129499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1036/2089] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:36.133323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ae95e-6701-455b-83b8-facf1057436c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:36.144893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ae95e-6701-455b-83b8-facf1057436c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:36.150135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920df456-efb8-4c46-bb2e-efdaac380403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:36.151005 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920df456-efb8-4c46-bb2e-efdaac380403 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.151812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920df456-efb8-4c46-bb2e-efdaac380403 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.152081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920df456-efb8-4c46-bb2e-efdaac380403 admin admin] PATH_INFO: `/v3/projects/987a3f2be60d4177ba99c8e114372754/users/01071af015b7422d9d118f9899480714/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.174330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920df456-efb8-4c46-bb2e-efdaac380403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=987a3f2be60d4177ba99c8e114372754, user_id=01071af015b7422d9d118f9899480714, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:36.178234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920df456-efb8-4c46-bb2e-efdaac380403 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:36.195213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1054/2090] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:36 2022] PUT /identity/v3/projects/987a3f2be60d4177ba99c8e114372754/users/01071af015b7422d9d118f9899480714/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:36.205793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2a88-a806-4a0a-8cc8-9491e22991e0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.206274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2a88-a806-4a0a-8cc8-9491e22991e0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.206558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df2a88-a806-4a0a-8cc8-9491e22991e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.240131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-28df2a88-a806-4a0a-8cc8-9491e22991e0 None None] MFA Rules not processed for user `01071af015b7422d9d118f9899480714`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:36.241916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-28df2a88-a806-4a0a-8cc8-9491e22991e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:36.327542 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1037/2091] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:36.332234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920df456-efb8-4c46-bb2e-efdaac380403 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:36.403916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920df456-efb8-4c46-bb2e-efdaac380403 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:36.408929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41374e-eeae-48b0-bc8d-d849c9b3569b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:36.409577 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41374e-eeae-48b0-bc8d-d849c9b3569b admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.409853 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41374e-eeae-48b0-bc8d-d849c9b3569b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.410119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41374e-eeae-48b0-bc8d-d849c9b3569b admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.410774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41374e-eeae-48b0-bc8d-d849c9b3569b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:36.412705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41374e-eeae-48b0-bc8d-d849c9b3569b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:36.446536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1055/2092] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:36 2022] POST /identity/v3/projects => generated 387 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:36.447749 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2a88-a806-4a0a-8cc8-9491e22991e0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:36.459100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df2a88-a806-4a0a-8cc8-9491e22991e0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:36.468127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:36.524169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c5e5f-ab4e-4ada-95c0-003c3f4fa788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:36.524785 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c5e5f-ab4e-4ada-95c0-003c3f4fa788 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.525122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c5e5f-ab4e-4ada-95c0-003c3f4fa788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.525428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c5e5f-ab4e-4ada-95c0-003c3f4fa788 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.526085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c5e5f-ab4e-4ada-95c0-003c3f4fa788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:36.528622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c5e5f-ab4e-4ada-95c0-003c3f4fa788 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:36.552507 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1038/2093] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:36 2022] POST /identity/v3/users => generated 300 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:36.556577 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41374e-eeae-48b0-bc8d-d849c9b3569b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:36.567817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41374e-eeae-48b0-bc8d-d849c9b3569b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:36.572957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92658785-98ed-4e85-bcd5-cbf9f530691e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:36.574202 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92658785-98ed-4e85-bcd5-cbf9f530691e admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.574485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92658785-98ed-4e85-bcd5-cbf9f530691e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.574756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92658785-98ed-4e85-bcd5-cbf9f530691e admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.575454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92658785-98ed-4e85-bcd5-cbf9f530691e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:36.577077 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92658785-98ed-4e85-bcd5-cbf9f530691e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:36.591846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1056/2094] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:36.592968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c5e5f-ab4e-4ada-95c0-003c3f4fa788 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:36.604595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c5e5f-ab4e-4ada-95c0-003c3f4fa788 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:36.608300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1407ed8-d8bb-4c64-b8b7-d64102e2c2ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:36.609099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1407ed8-d8bb-4c64-b8b7-d64102e2c2ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.609541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1407ed8-d8bb-4c64-b8b7-d64102e2c2ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.610044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1407ed8-d8bb-4c64-b8b7-d64102e2c2ef admin admin] PATH_INFO: `/v3/projects/c2d6d224f1484d83b2e84dedc942cbbe/users/e9c69b08eab348e1999d5f6d8c68fa66/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.626006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1407ed8-d8bb-4c64-b8b7-d64102e2c2ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d6d224f1484d83b2e84dedc942cbbe, user_id=e9c69b08eab348e1999d5f6d8c68fa66, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:36.628701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1407ed8-d8bb-4c64-b8b7-d64102e2c2ef admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:36.643595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1039/2095] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:36 2022] PUT /identity/v3/projects/c2d6d224f1484d83b2e84dedc942cbbe/users/e9c69b08eab348e1999d5f6d8c68fa66/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:36.647654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92658785-98ed-4e85-bcd5-cbf9f530691e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:36.658460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92658785-98ed-4e85-bcd5-cbf9f530691e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:36.718008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:36.725449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7472d986-c925-4424-8081-d942cbbde286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:36.726076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d986-c925-4424-8081-d942cbbde286 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.726428 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d986-c925-4424-8081-d942cbbde286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.726958 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7472d986-c925-4424-8081-d942cbbde286 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.727965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472d986-c925-4424-8081-d942cbbde286 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:36.729877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7472d986-c925-4424-8081-d942cbbde286 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:36.740302 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1057/2096] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:36 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:36.744613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1407ed8-d8bb-4c64-b8b7-d64102e2c2ef admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:36.756081 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1407ed8-d8bb-4c64-b8b7-d64102e2c2ef admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:36.762397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e60dc-2241-45e4-acf0-20e7460c5a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:36.763304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e60dc-2241-45e4-acf0-20e7460c5a3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.763589 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e60dc-2241-45e4-acf0-20e7460c5a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.763868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63e60dc-2241-45e4-acf0-20e7460c5a3b admin admin] PATH_INFO: `/v3/projects/c2d6d224f1484d83b2e84dedc942cbbe/users/e9c69b08eab348e1999d5f6d8c68fa66/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.766555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e60dc-2241-45e4-acf0-20e7460c5a3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2d6d224f1484d83b2e84dedc942cbbe, user_id=e9c69b08eab348e1999d5f6d8c68fa66, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:36.770498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63e60dc-2241-45e4-acf0-20e7460c5a3b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:36.782054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1040/2097] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:36 2022] PUT /identity/v3/projects/c2d6d224f1484d83b2e84dedc942cbbe/users/e9c69b08eab348e1999d5f6d8c68fa66/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:36.793485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9805467-b6ef-41ec-b9d8-33fe519f6803 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.793485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9805467-b6ef-41ec-b9d8-33fe519f6803 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.793770 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9805467-b6ef-41ec-b9d8-33fe519f6803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.822694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d9805467-b6ef-41ec-b9d8-33fe519f6803 None None] MFA Rules not processed for user `e9c69b08eab348e1999d5f6d8c68fa66`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:36.824518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d9805467-b6ef-41ec-b9d8-33fe519f6803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:36.891424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1058/2098] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:36 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:36.904436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e60dc-2241-45e4-acf0-20e7460c5a3b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:36.907082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e63e60dc-2241-45e4-acf0-20e7460c5a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:36.963625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63e60dc-2241-45e4-acf0-20e7460c5a3b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:36.967228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd4bc9-40c0-4531-b2de-3dcb053f8abd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:36.967832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd4bc9-40c0-4531-b2de-3dcb053f8abd service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:36.968110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd4bc9-40c0-4531-b2de-3dcb053f8abd service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:36.968381 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd4bc9-40c0-4531-b2de-3dcb053f8abd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:36.977142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd4bc9-40c0-4531-b2de-3dcb053f8abd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:36.978610 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd4bc9-40c0-4531-b2de-3dcb053f8abd service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:36.987860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1041/2099] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:36 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:37.055570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9805467-b6ef-41ec-b9d8-33fe519f6803 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:37.116426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9805467-b6ef-41ec-b9d8-33fe519f6803 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:37.121410 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:37.122031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:37.122307 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:37.122575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] PATH_INFO: `/v3/users/01071af015b7422d9d118f9899480714` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:37.123727 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01071af015b7422d9d118f9899480714)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:37.125686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:37.170611 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01071af015b7422d9d118f9899480714'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.177516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01071af015b7422d9d118f9899480714'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.189155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:37.191828 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01071af015b7422d9d118f9899480714'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.192921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01071af015b7422d9d118f9899480714'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.202432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01071af015b7422d9d118f9899480714'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.211499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1059/2100] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:37 2022] DELETE /identity/v3/users/01071af015b7422d9d118f9899480714 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:37.217244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b60b05-7d07-4005-8558-1002974f8d2f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:37.217742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b60b05-7d07-4005-8558-1002974f8d2f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:37.217833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b60b05-7d07-4005-8558-1002974f8d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:37.241360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-52b60b05-7d07-4005-8558-1002974f8d2f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:37.242581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-52b60b05-7d07-4005-8558-1002974f8d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:37.305853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1042/2101] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:37.316536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:37.318046 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:37.379926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699833ff-bd16-441b-9dd7-0069d89823f5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:37.383855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e972f4-264f-4ae0-9fa9-b66ca0fce862 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:37.384556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e972f4-264f-4ae0-9fa9-b66ca0fce862 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:37.384843 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e972f4-264f-4ae0-9fa9-b66ca0fce862 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:37.385060 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e972f4-264f-4ae0-9fa9-b66ca0fce862 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:37.394534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e972f4-264f-4ae0-9fa9-b66ca0fce862 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:37.395978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e972f4-264f-4ae0-9fa9-b66ca0fce862 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:37.407542 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1060/2102] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:37.717274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b60b05-7d07-4005-8558-1002974f8d2f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:37.718726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-52b60b05-7d07-4005-8558-1002974f8d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:37.731913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b60b05-7d07-4005-8558-1002974f8d2f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:37.748343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:37.749107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:37.749266 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:37.749704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] PATH_INFO: `/v3/projects/987a3f2be60d4177ba99c8e114372754` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:37.750880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=987a3f2be60d4177ba99c8e114372754)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:37.752780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:37.755892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:37.805844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987a3f2be60d4177ba99c8e114372754', 'request_id': 'req-d91c1240-049e-41be-a25f-3b1ed0f252e7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.813690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987a3f2be60d4177ba99c8e114372754', 'request_id': 'req-d91c1240-049e-41be-a25f-3b1ed0f252e7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.823317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987a3f2be60d4177ba99c8e114372754', 'request_id': 'req-d91c1240-049e-41be-a25f-3b1ed0f252e7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.837457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] The token cache is being invalidate because project 987a3f2be60d4177ba99c8e114372754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:37.837457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.837716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.840139 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1043/2103] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:37 2022] DELETE /identity/v3/projects/987a3f2be60d4177ba99c8e114372754 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:37.843978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e972f4-264f-4ae0-9fa9-b66ca0fce862 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:37.855698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e972f4-264f-4ae0-9fa9-b66ca0fce862 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:37.924844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b8c1ac-c18b-4e36-ad32-91b00f76a277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:37.925517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c1ac-c18b-4e36-ad32-91b00f76a277 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:37.925802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c1ac-c18b-4e36-ad32-91b00f76a277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:37.926074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b8c1ac-c18b-4e36-ad32-91b00f76a277 admin admin] PATH_INFO: `/v3/users/e9c69b08eab348e1999d5f6d8c68fa66` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:37.927234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8c1ac-c18b-4e36-ad32-91b00f76a277 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9c69b08eab348e1999d5f6d8c68fa66)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:37.929190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b8c1ac-c18b-4e36-ad32-91b00f76a277 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:37.977795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c4b8c1ac-c18b-4e36-ad32-91b00f76a277 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9c69b08eab348e1999d5f6d8c68fa66'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.984988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c4b8c1ac-c18b-4e36-ad32-91b00f76a277 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9c69b08eab348e1999d5f6d8c68fa66'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.997189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c4b8c1ac-c18b-4e36-ad32-91b00f76a277 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9c69b08eab348e1999d5f6d8c68fa66'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:37.997874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c4b8c1ac-c18b-4e36-ad32-91b00f76a277 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9c69b08eab348e1999d5f6d8c68fa66'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:38.004718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c4b8c1ac-c18b-4e36-ad32-91b00f76a277 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9c69b08eab348e1999d5f6d8c68fa66'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:38.011052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1061/2104] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:37 2022] DELETE /identity/v3/users/e9c69b08eab348e1999d5f6d8c68fa66 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:38.303758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:38.305235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:38.319821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c1240-049e-41be-a25f-3b1ed0f252e7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:38.378780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f32ac-bbe3-4927-ad68-b964938109bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:38.379415 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f32ac-bbe3-4927-ad68-b964938109bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:38.379693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f32ac-bbe3-4927-ad68-b964938109bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:38.379966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f32ac-bbe3-4927-ad68-b964938109bc admin admin] PATH_INFO: `/v3/projects/c2d6d224f1484d83b2e84dedc942cbbe` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:38.381117 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f32ac-bbe3-4927-ad68-b964938109bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2d6d224f1484d83b2e84dedc942cbbe)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:38.383079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f32ac-bbe3-4927-ad68-b964938109bc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:38.429866 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7d4f32ac-bbe3-4927-ad68-b964938109bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2d6d224f1484d83b2e84dedc942cbbe', 'request_id': 'req-7d4f32ac-bbe3-4927-ad68-b964938109bc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:38.437513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7d4f32ac-bbe3-4927-ad68-b964938109bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2d6d224f1484d83b2e84dedc942cbbe', 'request_id': 'req-7d4f32ac-bbe3-4927-ad68-b964938109bc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:38.446085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7d4f32ac-bbe3-4927-ad68-b964938109bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2d6d224f1484d83b2e84dedc942cbbe', 'request_id': 'req-7d4f32ac-bbe3-4927-ad68-b964938109bc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:38.459420 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7d4f32ac-bbe3-4927-ad68-b964938109bc admin admin] The token cache is being invalidate because project c2d6d224f1484d83b2e84dedc942cbbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:38.459708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7d4f32ac-bbe3-4927-ad68-b964938109bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:38.460369 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7d4f32ac-bbe3-4927-ad68-b964938109bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:38.461949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1044/2105] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:38 2022] DELETE /identity/v3/projects/c2d6d224f1484d83b2e84dedc942cbbe => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:38.466937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f5a12-a7de-4ae0-a658-d6304be900f6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:38.467232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f5a12-a7de-4ae0-a658-d6304be900f6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:38.467511 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f5a12-a7de-4ae0-a658-d6304be900f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:38.481560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:38.490021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ac0f5a12-a7de-4ae0-a658-d6304be900f6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:38.491890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ac0f5a12-a7de-4ae0-a658-d6304be900f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:38.556643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1062/2106] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:38.565173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef076606-6d11-483d-a197-dbcd1463ae08 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:38.565503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef076606-6d11-483d-a197-dbcd1463ae08 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:38.565856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef076606-6d11-483d-a197-dbcd1463ae08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:38.591791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ef076606-6d11-483d-a197-dbcd1463ae08 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:38.593111 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ef076606-6d11-483d-a197-dbcd1463ae08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:38.601664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1045/2107] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:38.606019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f5a12-a7de-4ae0-a658-d6304be900f6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:38.616371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f5a12-a7de-4ae0-a658-d6304be900f6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:38.621741 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e01b6-988f-4899-af4c-e5ee3a11ea5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:38.622351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e01b6-988f-4899-af4c-e5ee3a11ea5d admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:38.622631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e01b6-988f-4899-af4c-e5ee3a11ea5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:38.622901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003e01b6-988f-4899-af4c-e5ee3a11ea5d admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:38.623591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e01b6-988f-4899-af4c-e5ee3a11ea5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:38.623932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e01b6-988f-4899-af4c-e5ee3a11ea5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:38.625557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003e01b6-988f-4899-af4c-e5ee3a11ea5d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:38.638002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1063/2108] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:38.642123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef076606-6d11-483d-a197-dbcd1463ae08 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:38.651436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef076606-6d11-483d-a197-dbcd1463ae08 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:38.656120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f51cbc-69ee-4b5c-adda-482a0a62778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:38.656716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f51cbc-69ee-4b5c-adda-482a0a62778e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:38.656995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f51cbc-69ee-4b5c-adda-482a0a62778e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:38.657269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f51cbc-69ee-4b5c-adda-482a0a62778e admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:38.657950 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f51cbc-69ee-4b5c-adda-482a0a62778e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:38.659859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f51cbc-69ee-4b5c-adda-482a0a62778e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:38.674328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:38.688763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1046/2109] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:38 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:38.692765 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e01b6-988f-4899-af4c-e5ee3a11ea5d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:38.702605 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003e01b6-988f-4899-af4c-e5ee3a11ea5d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:38.759938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f433d02-7e19-43a7-b8cc-db21ad349a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:38.760482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f433d02-7e19-43a7-b8cc-db21ad349a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:38.760806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f433d02-7e19-43a7-b8cc-db21ad349a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:38.761081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f433d02-7e19-43a7-b8cc-db21ad349a35 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:38.761775 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f433d02-7e19-43a7-b8cc-db21ad349a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:38.763692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f433d02-7e19-43a7-b8cc-db21ad349a35 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:38.783881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1064/2110] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:38 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:38.788083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f51cbc-69ee-4b5c-adda-482a0a62778e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:38.798780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f51cbc-69ee-4b5c-adda-482a0a62778e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:38.803315 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69a3cd-3245-45fb-bfa6-8dd22d176c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:38.803912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69a3cd-3245-45fb-bfa6-8dd22d176c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:38.804190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69a3cd-3245-45fb-bfa6-8dd22d176c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:38.804462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb69a3cd-3245-45fb-bfa6-8dd22d176c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:38.805154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69a3cd-3245-45fb-bfa6-8dd22d176c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:38.806790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb69a3cd-3245-45fb-bfa6-8dd22d176c4f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:38.817473 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1047/2111] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:38.821281 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f433d02-7e19-43a7-b8cc-db21ad349a35 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:38.831136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f433d02-7e19-43a7-b8cc-db21ad349a35 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:38.835670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415e076a-c415-4c10-8704-841dfa776007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:38.836273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e076a-c415-4c10-8704-841dfa776007 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:38.836553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e076a-c415-4c10-8704-841dfa776007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:38.836826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415e076a-c415-4c10-8704-841dfa776007 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:38.837546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e076a-c415-4c10-8704-841dfa776007 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:38.839140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415e076a-c415-4c10-8704-841dfa776007 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:38.849876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1065/2112] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:38.853877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69a3cd-3245-45fb-bfa6-8dd22d176c4f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:38.865475 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb69a3cd-3245-45fb-bfa6-8dd22d176c4f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:38.870938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7061c-3003-465e-a079-10b910224646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:38.871593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7061c-3003-465e-a079-10b910224646 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:38.871879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7061c-3003-465e-a079-10b910224646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:38.872153 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7061c-3003-465e-a079-10b910224646 admin admin] PATH_INFO: `/v3/projects/3ec26430ba8e4385bd9aa71fd6b9bc58/users/18beb48873914069acf4f92a40b9ef17/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:38.887769 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7061c-3003-465e-a079-10b910224646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ec26430ba8e4385bd9aa71fd6b9bc58, user_id=18beb48873914069acf4f92a40b9ef17, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:38.890637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7061c-3003-465e-a079-10b910224646 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:38.905056 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1048/2113] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:38 2022] PUT /identity/v3/projects/3ec26430ba8e4385bd9aa71fd6b9bc58/users/18beb48873914069acf4f92a40b9ef17/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:38.916085 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71829d0-04e4-4ed9-87e5-15b1984c9d14 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:38.916374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71829d0-04e4-4ed9-87e5-15b1984c9d14 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:38.916643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71829d0-04e4-4ed9-87e5-15b1984c9d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:38.951401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a71829d0-04e4-4ed9-87e5-15b1984c9d14 None None] MFA Rules not processed for user `18beb48873914069acf4f92a40b9ef17`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:38.952629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a71829d0-04e4-4ed9-87e5-15b1984c9d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:38.983883 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7061c-3003-465e-a079-10b910224646 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:38.986019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-49f7061c-3003-465e-a079-10b910224646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:39.034818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1066/2114] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:39.040391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71829d0-04e4-4ed9-87e5-15b1984c9d14 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:39.048476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:39.128676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7061c-3003-465e-a079-10b910224646 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:39.134518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074bc0b-b3e4-41a6-aa4e-9f3dfd699118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:39.135172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bc0b-b3e4-41a6-aa4e-9f3dfd699118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:39.135448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bc0b-b3e4-41a6-aa4e-9f3dfd699118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:39.135812 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074bc0b-b3e4-41a6-aa4e-9f3dfd699118 admin admin] PATH_INFO: `/v3/users/7f20d69613774f4591e2c81c4e5ffe1c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:39.137441 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074bc0b-b3e4-41a6-aa4e-9f3dfd699118 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f20d69613774f4591e2c81c4e5ffe1c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:39.140795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074bc0b-b3e4-41a6-aa4e-9f3dfd699118 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:39.148397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71829d0-04e4-4ed9-87e5-15b1984c9d14 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:39.156199 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143dd31-9262-49ef-a808-657fb74b0454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:39.157857 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143dd31-9262-49ef-a808-657fb74b0454 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:39.158155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143dd31-9262-49ef-a808-657fb74b0454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:39.158508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b143dd31-9262-49ef-a808-657fb74b0454 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:39.159461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143dd31-9262-49ef-a808-657fb74b0454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:39.163042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b143dd31-9262-49ef-a808-657fb74b0454 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:39.196234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1067/2115] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:39 2022] POST /identity/v3/projects => generated 381 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:39.200222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143dd31-9262-49ef-a808-657fb74b0454 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:39.205208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e074bc0b-b3e4-41a6-aa4e-9f3dfd699118 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f20d69613774f4591e2c81c4e5ffe1c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:39.206388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e074bc0b-b3e4-41a6-aa4e-9f3dfd699118 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f20d69613774f4591e2c81c4e5ffe1c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:39.219648 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e074bc0b-b3e4-41a6-aa4e-9f3dfd699118 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f20d69613774f4591e2c81c4e5ffe1c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:39.226999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e074bc0b-b3e4-41a6-aa4e-9f3dfd699118 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f20d69613774f4591e2c81c4e5ffe1c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:39.235105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e074bc0b-b3e4-41a6-aa4e-9f3dfd699118 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f20d69613774f4591e2c81c4e5ffe1c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:39.241794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1049/2116] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:38 2022] DELETE /identity/v3/users/7f20d69613774f4591e2c81c4e5ffe1c => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:39.247079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfd09c-0c94-4106-a1da-16458413f04e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:39.247363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfd09c-0c94-4106-a1da-16458413f04e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:39.247637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dfd09c-0c94-4106-a1da-16458413f04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:39.266441 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-39dfd09c-0c94-4106-a1da-16458413f04e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:39.267567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-39dfd09c-0c94-4106-a1da-16458413f04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:39.272089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b143dd31-9262-49ef-a808-657fb74b0454 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:39.307064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:39.331644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c04870-eff3-46b6-81af-fedb3cd56c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:39.332314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c04870-eff3-46b6-81af-fedb3cd56c39 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:39.332598 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c04870-eff3-46b6-81af-fedb3cd56c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:39.332875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c04870-eff3-46b6-81af-fedb3cd56c39 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:39.333577 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c04870-eff3-46b6-81af-fedb3cd56c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:39.335657 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c04870-eff3-46b6-81af-fedb3cd56c39 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:39.337548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1050/2117] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:39.348345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfd09c-0c94-4106-a1da-16458413f04e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:39.350165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-39dfd09c-0c94-4106-a1da-16458413f04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:39.360445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1068/2118] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:39 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:04:39.364589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c04870-eff3-46b6-81af-fedb3cd56c39 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:39.366300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a4c04870-eff3-46b6-81af-fedb3cd56c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:39.378176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c04870-eff3-46b6-81af-fedb3cd56c39 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:39.382850 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a57c1d-6282-4984-b787-d8055577582a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:39.383445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a57c1d-6282-4984-b787-d8055577582a admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:39.383722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a57c1d-6282-4984-b787-d8055577582a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:39.383994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a57c1d-6282-4984-b787-d8055577582a admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:39.384680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a57c1d-6282-4984-b787-d8055577582a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:39.386347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a57c1d-6282-4984-b787-d8055577582a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:39.396057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1069/2119] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:39.399983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a57c1d-6282-4984-b787-d8055577582a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:39.409792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a57c1d-6282-4984-b787-d8055577582a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:39.413802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dfd09c-0c94-4106-a1da-16458413f04e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:39.414442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f796a9-97c6-4c4a-9cb6-0d6f869dedba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:39.415073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f796a9-97c6-4c4a-9cb6-0d6f869dedba admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:39.415354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f796a9-97c6-4c4a-9cb6-0d6f869dedba admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:39.415692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f796a9-97c6-4c4a-9cb6-0d6f869dedba admin admin] PATH_INFO: `/v3/projects/502edae7823e4e87b3d4bcdd338ee235/users/507a778b9d9d4ca7b18d5fbfeb5e219a/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:39.418464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a7f1-4d7b-4393-9639-4dac25a71450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:39.419085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a7f1-4d7b-4393-9639-4dac25a71450 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:39.419365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a7f1-4d7b-4393-9639-4dac25a71450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:39.419643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f31a7f1-4d7b-4393-9639-4dac25a71450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:39.428888 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31a7f1-4d7b-4393-9639-4dac25a71450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:39.429714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:39.430664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f31a7f1-4d7b-4393-9639-4dac25a71450 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:39.434400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f796a9-97c6-4c4a-9cb6-0d6f869dedba admin admin] RBAC: Authorizing `identity:create_grant(project_id=502edae7823e4e87b3d4bcdd338ee235, user_id=507a778b9d9d4ca7b18d5fbfeb5e219a, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:39.438480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f796a9-97c6-4c4a-9cb6-0d6f869dedba admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:39.441230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1051/2120] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:04:39.456448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1070/2121] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:39 2022] PUT /identity/v3/projects/502edae7823e4e87b3d4bcdd338ee235/users/507a778b9d9d4ca7b18d5fbfeb5e219a/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:39.460483 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a7f1-4d7b-4393-9639-4dac25a71450 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:39.472120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f31a7f1-4d7b-4393-9639-4dac25a71450 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:39.533808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384295e-1cf0-4b4e-a4e3-a3c95d5bbae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:39.534445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384295e-1cf0-4b4e-a4e3-a3c95d5bbae3 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:39.534799 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384295e-1cf0-4b4e-a4e3-a3c95d5bbae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:39.535147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384295e-1cf0-4b4e-a4e3-a3c95d5bbae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:39.535912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384295e-1cf0-4b4e-a4e3-a3c95d5bbae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:39.537646 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b384295e-1cf0-4b4e-a4e3-a3c95d5bbae3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:39.552405 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1052/2122] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:39 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:39.553603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f796a9-97c6-4c4a-9cb6-0d6f869dedba admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:39.564085 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f796a9-97c6-4c4a-9cb6-0d6f869dedba admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:39.568918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9be27-f66b-4d19-8c6f-05b75535f889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:39.569616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9be27-f66b-4d19-8c6f-05b75535f889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:39.569897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9be27-f66b-4d19-8c6f-05b75535f889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:39.570176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9be27-f66b-4d19-8c6f-05b75535f889 admin admin] PATH_INFO: `/v3/projects/502edae7823e4e87b3d4bcdd338ee235/users/507a778b9d9d4ca7b18d5fbfeb5e219a/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:39.572149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9be27-f66b-4d19-8c6f-05b75535f889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=502edae7823e4e87b3d4bcdd338ee235, user_id=507a778b9d9d4ca7b18d5fbfeb5e219a, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:39.575339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9be27-f66b-4d19-8c6f-05b75535f889 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:39.606305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1071/2123] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:39 2022] PUT /identity/v3/projects/502edae7823e4e87b3d4bcdd338ee235/users/507a778b9d9d4ca7b18d5fbfeb5e219a/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:39.616426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46347df-0d88-4111-897a-4698aa6703d1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:39.616766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46347df-0d88-4111-897a-4698aa6703d1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:39.617027 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46347df-0d88-4111-897a-4698aa6703d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:39.683838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a46347df-0d88-4111-897a-4698aa6703d1 None None] MFA Rules not processed for user `507a778b9d9d4ca7b18d5fbfeb5e219a`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:39.685082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a46347df-0d88-4111-897a-4698aa6703d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:39.846384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9be27-f66b-4d19-8c6f-05b75535f889 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:39.848604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dbc9be27-f66b-4d19-8c6f-05b75535f889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:39.851315 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1053/2124] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:39 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:39.864880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46347df-0d88-4111-897a-4698aa6703d1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:39.866345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a46347df-0d88-4111-897a-4698aa6703d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:39.879497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:39.949486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9be27-f66b-4d19-8c6f-05b75535f889 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:39.954969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:39.955769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:39.956115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:39.956241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46347df-0d88-4111-897a-4698aa6703d1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:39.956512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] PATH_INFO: `/v3/projects/ec25dfc98fe8416ba74a9416932d8eba` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:39.957824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec25dfc98fe8416ba74a9416932d8eba)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:39.959865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:39.959992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa0fe-45af-4bc7-b844-475b60ade9b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:39.960554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa0fe-45af-4bc7-b844-475b60ade9b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:39.960832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa0fe-45af-4bc7-b844-475b60ade9b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:39.961106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9fa0fe-45af-4bc7-b844-475b60ade9b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:39.971490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fa0fe-45af-4bc7-b844-475b60ade9b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:39.972932 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9fa0fe-45af-4bc7-b844-475b60ade9b8 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:39.982632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1054/2125] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:39 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:04:40.010303 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec25dfc98fe8416ba74a9416932d8eba', 'request_id': 'req-c920cfc3-3d17-411c-9de3-8bec55885cc9'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:40.019432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec25dfc98fe8416ba74a9416932d8eba', 'request_id': 'req-c920cfc3-3d17-411c-9de3-8bec55885cc9'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:40.027403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec25dfc98fe8416ba74a9416932d8eba', 'request_id': 'req-c920cfc3-3d17-411c-9de3-8bec55885cc9'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:40.041552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] The token cache is being invalidate because project ec25dfc98fe8416ba74a9416932d8eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:40.042026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:40.042814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:40.044980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1072/2126] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:39 2022] DELETE /identity/v3/projects/ec25dfc98fe8416ba74a9416932d8eba => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:40.061803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa0fe-45af-4bc7-b844-475b60ade9b8 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:40.070935 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9fa0fe-45af-4bc7-b844-475b60ade9b8 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:40.127667 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ea9dc-b78b-482d-b0ec-74db1e0dc235 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:40.128302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ea9dc-b78b-482d-b0ec-74db1e0dc235 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:40.128586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ea9dc-b78b-482d-b0ec-74db1e0dc235 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:40.128857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ea9dc-b78b-482d-b0ec-74db1e0dc235 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:40.130996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-782ea9dc-b78b-482d-b0ec-74db1e0dc235 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:40.205442 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ea9dc-b78b-482d-b0ec-74db1e0dc235 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:40.207360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ea9dc-b78b-482d-b0ec-74db1e0dc235 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:40.218963 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1055/2127] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:04:40.486099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:40.487494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:40.552271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c920cfc3-3d17-411c-9de3-8bec55885cc9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:40.556750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:40.558088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:40.558365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:40.558641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] PATH_INFO: `/v3/users/18beb48873914069acf4f92a40b9ef17` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:40.559819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18beb48873914069acf4f92a40b9ef17)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:40.561914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:40.570276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:40.617088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18beb48873914069acf4f92a40b9ef17'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:40.624623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18beb48873914069acf4f92a40b9ef17'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:40.636713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18beb48873914069acf4f92a40b9ef17'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:40.637387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18beb48873914069acf4f92a40b9ef17'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:40.644964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18beb48873914069acf4f92a40b9ef17'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:40.654299 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1073/2128] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:40 2022] DELETE /identity/v3/users/18beb48873914069acf4f92a40b9ef17 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:40.658738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc43cf7-8bd0-44fc-8155-03267798bc11 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:40.659212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc43cf7-8bd0-44fc-8155-03267798bc11 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:40.659309 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc43cf7-8bd0-44fc-8155-03267798bc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:40.678829 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fdc43cf7-8bd0-44fc-8155-03267798bc11 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:40.680034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fdc43cf7-8bd0-44fc-8155-03267798bc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:40.732638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:40.741715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1056/2129] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:40.751333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:40.752716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:40.809781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4e64b2-9fc6-4934-b07a-a40070d25ec5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:40.813619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50048d-e971-4802-bcfa-0e6303eaeec3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:40.814238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50048d-e971-4802-bcfa-0e6303eaeec3 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:40.814518 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50048d-e971-4802-bcfa-0e6303eaeec3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:40.814788 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50048d-e971-4802-bcfa-0e6303eaeec3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:40.824177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50048d-e971-4802-bcfa-0e6303eaeec3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:40.825654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50048d-e971-4802-bcfa-0e6303eaeec3 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:40.835956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1074/2130] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:41.146841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc43cf7-8bd0-44fc-8155-03267798bc11 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:41.148619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fdc43cf7-8bd0-44fc-8155-03267798bc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:41.170020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc43cf7-8bd0-44fc-8155-03267798bc11 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:41.176516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:41.177261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:41.177718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:41.178114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] PATH_INFO: `/v3/projects/3ec26430ba8e4385bd9aa71fd6b9bc58` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:41.179488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ec26430ba8e4385bd9aa71fd6b9bc58)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:41.181689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:41.240724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ec26430ba8e4385bd9aa71fd6b9bc58', 'request_id': 'req-0dddd77c-90f5-45bf-886f-12e9d5929bcd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.246887 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ec26430ba8e4385bd9aa71fd6b9bc58', 'request_id': 'req-0dddd77c-90f5-45bf-886f-12e9d5929bcd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.255059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ec26430ba8e4385bd9aa71fd6b9bc58', 'request_id': 'req-0dddd77c-90f5-45bf-886f-12e9d5929bcd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.268122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] The token cache is being invalidate because project 3ec26430ba8e4385bd9aa71fd6b9bc58 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:41.268335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.268970 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.270812 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1057/2131] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:41 2022] DELETE /identity/v3/projects/3ec26430ba8e4385bd9aa71fd6b9bc58 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:41.274532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50048d-e971-4802-bcfa-0e6303eaeec3 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:41.287601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50048d-e971-4802-bcfa-0e6303eaeec3 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:41.358252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007997c-d219-4400-a270-41f836b9f677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:41.358901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007997c-d219-4400-a270-41f836b9f677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:41.359296 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007997c-d219-4400-a270-41f836b9f677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:41.359670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007997c-d219-4400-a270-41f836b9f677 admin admin] PATH_INFO: `/v3/users/507a778b9d9d4ca7b18d5fbfeb5e219a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:41.361062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007997c-d219-4400-a270-41f836b9f677 admin admin] RBAC: Authorizing `identity:delete_user(user_id=507a778b9d9d4ca7b18d5fbfeb5e219a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:41.363052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007997c-d219-4400-a270-41f836b9f677 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:41.406444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:41.423992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7007997c-d219-4400-a270-41f836b9f677 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '507a778b9d9d4ca7b18d5fbfeb5e219a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.434316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7007997c-d219-4400-a270-41f836b9f677 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '507a778b9d9d4ca7b18d5fbfeb5e219a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.454909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7007997c-d219-4400-a270-41f836b9f677 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '507a778b9d9d4ca7b18d5fbfeb5e219a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.455622 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7007997c-d219-4400-a270-41f836b9f677 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '507a778b9d9d4ca7b18d5fbfeb5e219a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.466633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7007997c-d219-4400-a270-41f836b9f677 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '507a778b9d9d4ca7b18d5fbfeb5e219a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.473552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1075/2132] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:41 2022] DELETE /identity/v3/users/507a778b9d9d4ca7b18d5fbfeb5e219a => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:41.826621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:41.828163 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:41.844468 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddd77c-90f5-45bf-886f-12e9d5929bcd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:41.904245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1058d34-571e-4d57-908f-1fdbb1f9ed93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:41.904997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1058d34-571e-4d57-908f-1fdbb1f9ed93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:41.905282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1058d34-571e-4d57-908f-1fdbb1f9ed93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:41.905585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1058d34-571e-4d57-908f-1fdbb1f9ed93 admin admin] PATH_INFO: `/v3/projects/502edae7823e4e87b3d4bcdd338ee235` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:41.906740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1058d34-571e-4d57-908f-1fdbb1f9ed93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502edae7823e4e87b3d4bcdd338ee235)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:41.908660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1058d34-571e-4d57-908f-1fdbb1f9ed93 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:41.955536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c1058d34-571e-4d57-908f-1fdbb1f9ed93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502edae7823e4e87b3d4bcdd338ee235', 'request_id': 'req-c1058d34-571e-4d57-908f-1fdbb1f9ed93'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.960991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c1058d34-571e-4d57-908f-1fdbb1f9ed93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502edae7823e4e87b3d4bcdd338ee235', 'request_id': 'req-c1058d34-571e-4d57-908f-1fdbb1f9ed93'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.968507 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c1058d34-571e-4d57-908f-1fdbb1f9ed93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502edae7823e4e87b3d4bcdd338ee235', 'request_id': 'req-c1058d34-571e-4d57-908f-1fdbb1f9ed93'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.979995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c1058d34-571e-4d57-908f-1fdbb1f9ed93 admin admin] The token cache is being invalidate because project 502edae7823e4e87b3d4bcdd338ee235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:41.980277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c1058d34-571e-4d57-908f-1fdbb1f9ed93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.980930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c1058d34-571e-4d57-908f-1fdbb1f9ed93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:41.982454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1058/2133] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:41 2022] DELETE /identity/v3/projects/502edae7823e4e87b3d4bcdd338ee235 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:41.987272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1ad6b-e73e-4fe2-b55e-f5023658c594 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:41.987556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1ad6b-e73e-4fe2-b55e-f5023658c594 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:41.987830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1ad6b-e73e-4fe2-b55e-f5023658c594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:42.007740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4ed1ad6b-e73e-4fe2-b55e-f5023658c594 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:42.008936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4ed1ad6b-e73e-4fe2-b55e-f5023658c594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:42.067088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1076/2134] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:42.075008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec45940-3ab0-44b5-82e4-b8fe91f01886 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:42.075298 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec45940-3ab0-44b5-82e4-b8fe91f01886 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:42.075576 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec45940-3ab0-44b5-82e4-b8fe91f01886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:42.095435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-cec45940-3ab0-44b5-82e4-b8fe91f01886 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:42.096575 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cec45940-3ab0-44b5-82e4-b8fe91f01886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:42.105241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1059/2135] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:42.109545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1ad6b-e73e-4fe2-b55e-f5023658c594 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:42.119435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1ad6b-e73e-4fe2-b55e-f5023658c594 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:42.124134 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316af75-fa75-479f-9a89-46bb237e3afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:42.124740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316af75-fa75-479f-9a89-46bb237e3afb admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:42.125017 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316af75-fa75-479f-9a89-46bb237e3afb admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:42.125288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316af75-fa75-479f-9a89-46bb237e3afb admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:42.126013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316af75-fa75-479f-9a89-46bb237e3afb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:42.126313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316af75-fa75-479f-9a89-46bb237e3afb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:42.127933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b316af75-fa75-479f-9a89-46bb237e3afb admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:42.140433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1077/2136] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 12:04:42.144981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec45940-3ab0-44b5-82e4-b8fe91f01886 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:42.154848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec45940-3ab0-44b5-82e4-b8fe91f01886 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:42.159535 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956d135-6928-4c4c-bcc6-85a4058c88e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:42.160227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956d135-6928-4c4c-bcc6-85a4058c88e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:42.160595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956d135-6928-4c4c-bcc6-85a4058c88e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:42.160931 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a956d135-6928-4c4c-bcc6-85a4058c88e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:42.161704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956d135-6928-4c4c-bcc6-85a4058c88e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:42.163683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a956d135-6928-4c4c-bcc6-85a4058c88e2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:42.168920 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:42.193077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1060/2137] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:42 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:42.197346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316af75-fa75-479f-9a89-46bb237e3afb admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:42.207623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b316af75-fa75-479f-9a89-46bb237e3afb admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:42.272568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171bc2-5f43-454e-a6d3-80b55fdfb621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:42.272924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171bc2-5f43-454e-a6d3-80b55fdfb621 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:42.273109 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171bc2-5f43-454e-a6d3-80b55fdfb621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:42.273425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171bc2-5f43-454e-a6d3-80b55fdfb621 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:42.274092 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171bc2-5f43-454e-a6d3-80b55fdfb621 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:42.276630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171bc2-5f43-454e-a6d3-80b55fdfb621 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:42.311898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1078/2138] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:42 2022] POST /identity/v3/users => generated 288 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:42.315901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956d135-6928-4c4c-bcc6-85a4058c88e2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:42.326579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a956d135-6928-4c4c-bcc6-85a4058c88e2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:42.331276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ce5a0-2c26-4cb5-9566-9056cd464d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:42.331885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ce5a0-2c26-4cb5-9566-9056cd464d33 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:42.332168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ce5a0-2c26-4cb5-9566-9056cd464d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:42.332448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02ce5a0-2c26-4cb5-9566-9056cd464d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:42.333143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ce5a0-2c26-4cb5-9566-9056cd464d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:42.334853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02ce5a0-2c26-4cb5-9566-9056cd464d33 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:42.347518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1061/2139] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:42.350650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171bc2-5f43-454e-a6d3-80b55fdfb621 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:42.362051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171bc2-5f43-454e-a6d3-80b55fdfb621 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:42.367125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bbfc9c-d1cd-468b-808c-969b1cd3231f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:42.367742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbfc9c-d1cd-468b-808c-969b1cd3231f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:42.368028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbfc9c-d1cd-468b-808c-969b1cd3231f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:42.368302 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bbfc9c-d1cd-468b-808c-969b1cd3231f admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:42.369024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbfc9c-d1cd-468b-808c-969b1cd3231f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:42.370706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bbfc9c-d1cd-468b-808c-969b1cd3231f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:42.382846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1079/2140] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:42.386971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ce5a0-2c26-4cb5-9566-9056cd464d33 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:42.397120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02ce5a0-2c26-4cb5-9566-9056cd464d33 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:42.402791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2c0d1-de8d-4d74-904b-6dc086a2da2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:42.403531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2c0d1-de8d-4d74-904b-6dc086a2da2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:42.403813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2c0d1-de8d-4d74-904b-6dc086a2da2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:42.404090 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f2c0d1-de8d-4d74-904b-6dc086a2da2a admin admin] PATH_INFO: `/v3/projects/57f448d0c25c40c6b5b21bf93c3b1ab7/users/086563703a7a46d78878a4226374e6f7/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:42.419447 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2c0d1-de8d-4d74-904b-6dc086a2da2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=57f448d0c25c40c6b5b21bf93c3b1ab7, user_id=086563703a7a46d78878a4226374e6f7, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:42.422175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f2c0d1-de8d-4d74-904b-6dc086a2da2a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:42.435290 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1062/2141] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:42 2022] PUT /identity/v3/projects/57f448d0c25c40c6b5b21bf93c3b1ab7/users/086563703a7a46d78878a4226374e6f7/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:42.446799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fa489-d676-4a35-9daa-65932d4cef0a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:42.447082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fa489-d676-4a35-9daa-65932d4cef0a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:42.447351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0fa489-d676-4a35-9daa-65932d4cef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:42.475053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:42.478746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2a0fa489-d676-4a35-9daa-65932d4cef0a None None] MFA Rules not processed for user `086563703a7a46d78878a4226374e6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:42.480704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2a0fa489-d676-4a35-9daa-65932d4cef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:42.552435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1080/2142] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:42.564109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2c0d1-de8d-4d74-904b-6dc086a2da2a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:42.566597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-85f2c0d1-de8d-4d74-904b-6dc086a2da2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:42.628949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f2c0d1-de8d-4d74-904b-6dc086a2da2a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:42.632584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d4775-41bc-4dc1-92da-ca11a7a27892 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:42.633196 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d4775-41bc-4dc1-92da-ca11a7a27892 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:42.633501 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d4775-41bc-4dc1-92da-ca11a7a27892 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:42.633771 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298d4775-41bc-4dc1-92da-ca11a7a27892 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:42.642747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d4775-41bc-4dc1-92da-ca11a7a27892 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:42.644175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298d4775-41bc-4dc1-92da-ca11a7a27892 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:42.654156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1063/2143] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:44.081839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc8ab7-d751-40ec-816b-7d6a293d3085 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:44.082349 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc8ab7-d751-40ec-816b-7d6a293d3085 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:44.082672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acc8ab7-d751-40ec-816b-7d6a293d3085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:44.102803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2acc8ab7-d751-40ec-816b-7d6a293d3085 None None] MFA Rules not processed for user `086563703a7a46d78878a4226374e6f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:44.104213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2acc8ab7-d751-40ec-816b-7d6a293d3085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:44.111438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1081/2144] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:46.867496 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d4775-41bc-4dc1-92da-ca11a7a27892 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:46.873340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-298d4775-41bc-4dc1-92da-ca11a7a27892 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:46.950314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298d4775-41bc-4dc1-92da-ca11a7a27892 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:46.955910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:46.956607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:46.956882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:46.957181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] PATH_INFO: `/v3/users/99e51f3319eb483f8ac05bdfe68d3695` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:46.958345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=99e51f3319eb483f8ac05bdfe68d3695)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:46.960307 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:47.020054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99e51f3319eb483f8ac05bdfe68d3695'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:47.020750 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99e51f3319eb483f8ac05bdfe68d3695'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:47.027579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:47.035969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99e51f3319eb483f8ac05bdfe68d3695'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:47.044532 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99e51f3319eb483f8ac05bdfe68d3695'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:47.054257 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99e51f3319eb483f8ac05bdfe68d3695'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:47.064498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1064/2145] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:46 2022] DELETE /identity/v3/users/99e51f3319eb483f8ac05bdfe68d3695 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:47.232794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc8ab7-d751-40ec-816b-7d6a293d3085 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:47.235343 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2acc8ab7-d751-40ec-816b-7d6a293d3085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:47.251950 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acc8ab7-d751-40ec-816b-7d6a293d3085 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:47.326058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:47.327485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:47.332910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a33499-21e8-4b6c-8a40-181662e2781b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:47.333675 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a33499-21e8-4b6c-8a40-181662e2781b service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:47.334050 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a33499-21e8-4b6c-8a40-181662e2781b service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:47.334417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a33499-21e8-4b6c-8a40-181662e2781b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:47.336783 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-75a33499-21e8-4b6c-8a40-181662e2781b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:47.427146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a33499-21e8-4b6c-8a40-181662e2781b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:47.428996 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a33499-21e8-4b6c-8a40-181662e2781b service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:47.431035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87132215-d03b-47b0-a005-6fe9d4151b6e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:47.436793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04beb074-eabf-45c1-b0c9-4278ff710f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:47.437456 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beb074-eabf-45c1-b0c9-4278ff710f32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:47.437723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beb074-eabf-45c1-b0c9-4278ff710f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:47.437995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04beb074-eabf-45c1-b0c9-4278ff710f32 admin admin] PATH_INFO: `/v3/projects/ba2711f8cc5d4892849cc10272ec5edf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:47.439445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04beb074-eabf-45c1-b0c9-4278ff710f32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba2711f8cc5d4892849cc10272ec5edf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:47.441400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1082/2146] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:47 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:47.442083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04beb074-eabf-45c1-b0c9-4278ff710f32 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:47.508109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-04beb074-eabf-45c1-b0c9-4278ff710f32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba2711f8cc5d4892849cc10272ec5edf', 'request_id': 'req-04beb074-eabf-45c1-b0c9-4278ff710f32'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:47.515115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-04beb074-eabf-45c1-b0c9-4278ff710f32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba2711f8cc5d4892849cc10272ec5edf', 'request_id': 'req-04beb074-eabf-45c1-b0c9-4278ff710f32'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:47.524942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-04beb074-eabf-45c1-b0c9-4278ff710f32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba2711f8cc5d4892849cc10272ec5edf', 'request_id': 'req-04beb074-eabf-45c1-b0c9-4278ff710f32'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:47.545031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-04beb074-eabf-45c1-b0c9-4278ff710f32 admin admin] The token cache is being invalidate because project ba2711f8cc5d4892849cc10272ec5edf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:47.545745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-04beb074-eabf-45c1-b0c9-4278ff710f32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:47.546972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-04beb074-eabf-45c1-b0c9-4278ff710f32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:47.549097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1065/2147] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:47 2022] DELETE /identity/v3/projects/ba2711f8cc5d4892849cc10272ec5edf => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:47.554647 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49f78b-2ee9-46da-ac5e-3d17c3fed81d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:47.555016 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49f78b-2ee9-46da-ac5e-3d17c3fed81d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:47.555368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49f78b-2ee9-46da-ac5e-3d17c3fed81d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:47.584142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4f49f78b-2ee9-46da-ac5e-3d17c3fed81d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:47.585436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4f49f78b-2ee9-46da-ac5e-3d17c3fed81d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:47.647015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:47.671166 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1083/2148] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:47.679351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4db82-b1fb-4d24-b8a7-a63f4ed187c3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:47.679635 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4db82-b1fb-4d24-b8a7-a63f4ed187c3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:47.679910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b4db82-b1fb-4d24-b8a7-a63f4ed187c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:47.702497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-67b4db82-b1fb-4d24-b8a7-a63f4ed187c3 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:47.703831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-67b4db82-b1fb-4d24-b8a7-a63f4ed187c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:47.712554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1066/2149] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:47.716784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49f78b-2ee9-46da-ac5e-3d17c3fed81d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:47.734758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f49f78b-2ee9-46da-ac5e-3d17c3fed81d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:47.740090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26f0ab-5977-4d72-8ce7-c7527cccc044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:47.740723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26f0ab-5977-4d72-8ce7-c7527cccc044 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:47.740998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26f0ab-5977-4d72-8ce7-c7527cccc044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:47.742195 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba26f0ab-5977-4d72-8ce7-c7527cccc044 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:47.742942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26f0ab-5977-4d72-8ce7-c7527cccc044 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:47.743245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26f0ab-5977-4d72-8ce7-c7527cccc044 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:47.746073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba26f0ab-5977-4d72-8ce7-c7527cccc044 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:47.760039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1084/2150] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:47.764444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4db82-b1fb-4d24-b8a7-a63f4ed187c3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:47.776372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b4db82-b1fb-4d24-b8a7-a63f4ed187c3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:47.781576 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdd8fc-c495-4b91-b849-deb6f5b32cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:47.782199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdd8fc-c495-4b91-b849-deb6f5b32cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:47.782491 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdd8fc-c495-4b91-b849-deb6f5b32cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:47.782738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fdd8fc-c495-4b91-b849-deb6f5b32cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:47.783418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdd8fc-c495-4b91-b849-deb6f5b32cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:47.785373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fdd8fc-c495-4b91-b849-deb6f5b32cfb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:47.823509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1067/2151] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:47 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:47.827768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26f0ab-5977-4d72-8ce7-c7527cccc044 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:47.838704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba26f0ab-5977-4d72-8ce7-c7527cccc044 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:47.905685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa1a2d-32cb-43ab-b2be-519a905bbb42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:47.906401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1a2d-32cb-43ab-b2be-519a905bbb42 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:47.908248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1a2d-32cb-43ab-b2be-519a905bbb42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:47.908638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa1a2d-32cb-43ab-b2be-519a905bbb42 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:47.910005 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa1a2d-32cb-43ab-b2be-519a905bbb42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:47.913849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa1a2d-32cb-43ab-b2be-519a905bbb42 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:47.952472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1085/2152] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:47 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:47.958538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdd8fc-c495-4b91-b849-deb6f5b32cfb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:47.974746 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fdd8fc-c495-4b91-b849-deb6f5b32cfb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:47.980368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daf88d-6991-4a73-bad8-bfbd7620f7e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:47.980928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daf88d-6991-4a73-bad8-bfbd7620f7e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:47.981205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daf88d-6991-4a73-bad8-bfbd7620f7e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:47.981509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00daf88d-6991-4a73-bad8-bfbd7620f7e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:47.982212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daf88d-6991-4a73-bad8-bfbd7620f7e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:47.983815 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00daf88d-6991-4a73-bad8-bfbd7620f7e4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:47.997337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1068/2153] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:47.999475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa1a2d-32cb-43ab-b2be-519a905bbb42 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:48.024889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa1a2d-32cb-43ab-b2be-519a905bbb42 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:48.030297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b8627-1d5a-446d-b9ef-31b96d4e66e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:48.031207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8627-1d5a-446d-b9ef-31b96d4e66e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:48.031726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8627-1d5a-446d-b9ef-31b96d4e66e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:48.032098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b8627-1d5a-446d-b9ef-31b96d4e66e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:48.033042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b8627-1d5a-446d-b9ef-31b96d4e66e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:48.034910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b8627-1d5a-446d-b9ef-31b96d4e66e7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:48.052366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1086/2154] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:47 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:48.052894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daf88d-6991-4a73-bad8-bfbd7620f7e4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:48.064284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00daf88d-6991-4a73-bad8-bfbd7620f7e4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:48.072866 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7c4dd-bd21-4c27-bd43-9df1009fbace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:48.073654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7c4dd-bd21-4c27-bd43-9df1009fbace admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:48.073938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7c4dd-bd21-4c27-bd43-9df1009fbace admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:48.074214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b7c4dd-bd21-4c27-bd43-9df1009fbace admin admin] PATH_INFO: `/v3/projects/186e290418e34b9cb4989824c1a38a6e/users/ab1976a52b244971a158991a59624721/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:48.090454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7c4dd-bd21-4c27-bd43-9df1009fbace admin admin] RBAC: Authorizing `identity:create_grant(project_id=186e290418e34b9cb4989824c1a38a6e, user_id=ab1976a52b244971a158991a59624721, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:48.093358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b7c4dd-bd21-4c27-bd43-9df1009fbace admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:48.102261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:48.110605 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1069/2155] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:48 2022] PUT /identity/v3/projects/186e290418e34b9cb4989824c1a38a6e/users/ab1976a52b244971a158991a59624721/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:48.121135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf02bc-9189-42d7-9fe9-255abd1c51da None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:48.121452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf02bc-9189-42d7-9fe9-255abd1c51da None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:48.121730 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf02bc-9189-42d7-9fe9-255abd1c51da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:48.155235 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-dfbf02bc-9189-42d7-9fe9-255abd1c51da None None] MFA Rules not processed for user `ab1976a52b244971a158991a59624721`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:48.156683 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dfbf02bc-9189-42d7-9fe9-255abd1c51da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:48.233007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1087/2156] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:48.237606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7c4dd-bd21-4c27-bd43-9df1009fbace admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:48.348157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b7c4dd-bd21-4c27-bd43-9df1009fbace admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:48.353531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e2457-05f9-43ed-a379-11e39d80f560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:48.355083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e2457-05f9-43ed-a379-11e39d80f560 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:48.355571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e2457-05f9-43ed-a379-11e39d80f560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:48.356022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019e2457-05f9-43ed-a379-11e39d80f560 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:48.356730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e2457-05f9-43ed-a379-11e39d80f560 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:48.358705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019e2457-05f9-43ed-a379-11e39d80f560 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:48.394155 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1070/2157] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:48 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:48.398051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf02bc-9189-42d7-9fe9-255abd1c51da None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:48.411102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf02bc-9189-42d7-9fe9-255abd1c51da None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:48.466973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:48.491489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b174275-fa0d-428b-bcb8-adee49020f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:48.492132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174275-fa0d-428b-bcb8-adee49020f0b admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:48.492635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174275-fa0d-428b-bcb8-adee49020f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:48.492913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b174275-fa0d-428b-bcb8-adee49020f0b admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:48.493908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b174275-fa0d-428b-bcb8-adee49020f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:48.497343 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b174275-fa0d-428b-bcb8-adee49020f0b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:48.521967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1088/2158] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:48 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:48.525715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e2457-05f9-43ed-a379-11e39d80f560 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:48.536808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019e2457-05f9-43ed-a379-11e39d80f560 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:48.555482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36105bb-7599-482a-a63a-4ce8cc0e2c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:48.556461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36105bb-7599-482a-a63a-4ce8cc0e2c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:48.556743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36105bb-7599-482a-a63a-4ce8cc0e2c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:48.557012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36105bb-7599-482a-a63a-4ce8cc0e2c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:48.557882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36105bb-7599-482a-a63a-4ce8cc0e2c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:48.559605 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36105bb-7599-482a-a63a-4ce8cc0e2c8c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:48.573340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1071/2159] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:04:48.575684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b174275-fa0d-428b-bcb8-adee49020f0b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:48.586596 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b174275-fa0d-428b-bcb8-adee49020f0b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:48.594112 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8690da-f7bb-499a-bc6a-936ec22fdc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:48.594796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8690da-f7bb-499a-bc6a-936ec22fdc71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:48.595137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8690da-f7bb-499a-bc6a-936ec22fdc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:48.595413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8690da-f7bb-499a-bc6a-936ec22fdc71 admin admin] PATH_INFO: `/v3/projects/bc94948d65ce4e9988ee54ace195c58b/users/d2165db578d44d2a9e554da09e44d88b/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:48.611547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8690da-f7bb-499a-bc6a-936ec22fdc71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc94948d65ce4e9988ee54ace195c58b, user_id=d2165db578d44d2a9e554da09e44d88b, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:48.614535 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8690da-f7bb-499a-bc6a-936ec22fdc71 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:48.632349 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1089/2160] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:48 2022] PUT /identity/v3/projects/bc94948d65ce4e9988ee54ace195c58b/users/d2165db578d44d2a9e554da09e44d88b/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:48.636942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36105bb-7599-482a-a63a-4ce8cc0e2c8c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:48.646938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36105bb-7599-482a-a63a-4ce8cc0e2c8c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:48.705072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b452e9b6-2e0d-4852-b747-53fa12630564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:48.705720 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452e9b6-2e0d-4852-b747-53fa12630564 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:48.706001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452e9b6-2e0d-4852-b747-53fa12630564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:48.706274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b452e9b6-2e0d-4852-b747-53fa12630564 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:48.706994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452e9b6-2e0d-4852-b747-53fa12630564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:48.708593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b452e9b6-2e0d-4852-b747-53fa12630564 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:48.719046 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1072/2161] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:48.723109 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8690da-f7bb-499a-bc6a-936ec22fdc71 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:48.733726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8690da-f7bb-499a-bc6a-936ec22fdc71 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:48.738361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f18ec-b3e4-4df0-8b42-5d556a3f720a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:48.739267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f18ec-b3e4-4df0-8b42-5d556a3f720a admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:48.739542 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f18ec-b3e4-4df0-8b42-5d556a3f720a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:48.739816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87f18ec-b3e4-4df0-8b42-5d556a3f720a admin admin] PATH_INFO: `/v3/projects/bc94948d65ce4e9988ee54ace195c58b/users/d2165db578d44d2a9e554da09e44d88b/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:48.741886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f18ec-b3e4-4df0-8b42-5d556a3f720a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc94948d65ce4e9988ee54ace195c58b, user_id=d2165db578d44d2a9e554da09e44d88b, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:48.744459 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87f18ec-b3e4-4df0-8b42-5d556a3f720a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:48.754538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1090/2162] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:48 2022] PUT /identity/v3/projects/bc94948d65ce4e9988ee54ace195c58b/users/d2165db578d44d2a9e554da09e44d88b/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:48.766371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab189f02-8f83-4dca-8281-5605bb2e0b2d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:48.766658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab189f02-8f83-4dca-8281-5605bb2e0b2d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:48.766932 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab189f02-8f83-4dca-8281-5605bb2e0b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:48.795109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ab189f02-8f83-4dca-8281-5605bb2e0b2d None None] MFA Rules not processed for user `d2165db578d44d2a9e554da09e44d88b`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:48.796312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ab189f02-8f83-4dca-8281-5605bb2e0b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:48.853260 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:48.864088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1073/2163] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:48 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:48.875766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f18ec-b3e4-4df0-8b42-5d556a3f720a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:48.877489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c87f18ec-b3e4-4df0-8b42-5d556a3f720a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:48.933724 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87f18ec-b3e4-4df0-8b42-5d556a3f720a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:48.937377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094af661-2bde-47a6-9be3-b995d17160f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:48.937987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094af661-2bde-47a6-9be3-b995d17160f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:48.938295 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094af661-2bde-47a6-9be3-b995d17160f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:48.938566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094af661-2bde-47a6-9be3-b995d17160f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:48.947392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094af661-2bde-47a6-9be3-b995d17160f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:48.949458 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094af661-2bde-47a6-9be3-b995d17160f4 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:48.958781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1091/2164] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:48 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:49.338505 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab189f02-8f83-4dca-8281-5605bb2e0b2d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:49.400006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab189f02-8f83-4dca-8281-5605bb2e0b2d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:49.404499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:49.405128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:49.405440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:49.405718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] PATH_INFO: `/v3/users/ab1976a52b244971a158991a59624721` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:49.406880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1976a52b244971a158991a59624721)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:49.408800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:49.456473 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1976a52b244971a158991a59624721'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:49.457109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1976a52b244971a158991a59624721'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:49.468713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1976a52b244971a158991a59624721'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:49.475615 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1976a52b244971a158991a59624721'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:49.483478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1976a52b244971a158991a59624721'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:49.489512 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1074/2165] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:49 2022] DELETE /identity/v3/users/ab1976a52b244971a158991a59624721 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:49.494078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cee930-d950-4d48-893e-507bd627a440 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:49.494572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cee930-d950-4d48-893e-507bd627a440 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:49.494717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cee930-d950-4d48-893e-507bd627a440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:49.514212 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c4cee930-d950-4d48-893e-507bd627a440 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:49.515344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c4cee930-d950-4d48-893e-507bd627a440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:49.574231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1092/2166] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:49.583810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:49.585457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:49.656983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364826f-c1f5-481d-af39-f9f23359bc80 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:49.661320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3f2ab-b6fe-4ff5-bf7d-073faaa78e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:49.663492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f2ab-b6fe-4ff5-bf7d-073faaa78e95 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:49.663492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f2ab-b6fe-4ff5-bf7d-073faaa78e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:49.663492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3f2ab-b6fe-4ff5-bf7d-073faaa78e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:49.679479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3f2ab-b6fe-4ff5-bf7d-073faaa78e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:49.681075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3f2ab-b6fe-4ff5-bf7d-073faaa78e95 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:49.691620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1075/2167] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:50.085380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cee930-d950-4d48-893e-507bd627a440 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:50.086930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c4cee930-d950-4d48-893e-507bd627a440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:50.100454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cee930-d950-4d48-893e-507bd627a440 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:50.106003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:50.106689 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:50.106988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:50.107263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] PATH_INFO: `/v3/projects/186e290418e34b9cb4989824c1a38a6e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:50.108488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=186e290418e34b9cb4989824c1a38a6e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:50.110604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:50.147545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:50.161636 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '186e290418e34b9cb4989824c1a38a6e', 'request_id': 'req-9216e5d1-9429-491c-a959-128957ccaa48'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.167047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '186e290418e34b9cb4989824c1a38a6e', 'request_id': 'req-9216e5d1-9429-491c-a959-128957ccaa48'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.173113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '186e290418e34b9cb4989824c1a38a6e', 'request_id': 'req-9216e5d1-9429-491c-a959-128957ccaa48'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.185182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] The token cache is being invalidate because project 186e290418e34b9cb4989824c1a38a6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:50.185500 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.186120 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.187654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1093/2168] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:50 2022] DELETE /identity/v3/projects/186e290418e34b9cb4989824c1a38a6e => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:50.191834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3f2ab-b6fe-4ff5-bf7d-073faaa78e95 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:50.202336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3f2ab-b6fe-4ff5-bf7d-073faaa78e95 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:50.213343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:50.259566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108bbeed-1a7c-4fe1-9c65-db38d3b9bf09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:50.260679 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bbeed-1a7c-4fe1-9c65-db38d3b9bf09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:50.260971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bbeed-1a7c-4fe1-9c65-db38d3b9bf09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:50.261247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108bbeed-1a7c-4fe1-9c65-db38d3b9bf09 admin admin] PATH_INFO: `/v3/users/d2165db578d44d2a9e554da09e44d88b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:50.262554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bbeed-1a7c-4fe1-9c65-db38d3b9bf09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2165db578d44d2a9e554da09e44d88b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:50.264714 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108bbeed-1a7c-4fe1-9c65-db38d3b9bf09 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:50.315213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-108bbeed-1a7c-4fe1-9c65-db38d3b9bf09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2165db578d44d2a9e554da09e44d88b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.315863 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-108bbeed-1a7c-4fe1-9c65-db38d3b9bf09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2165db578d44d2a9e554da09e44d88b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.327978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-108bbeed-1a7c-4fe1-9c65-db38d3b9bf09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2165db578d44d2a9e554da09e44d88b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.335264 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-108bbeed-1a7c-4fe1-9c65-db38d3b9bf09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2165db578d44d2a9e554da09e44d88b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.342498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-108bbeed-1a7c-4fe1-9c65-db38d3b9bf09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2165db578d44d2a9e554da09e44d88b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.348391 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1076/2169] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:50 2022] DELETE /identity/v3/users/d2165db578d44d2a9e554da09e44d88b => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:50.625975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:50.627489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:50.653034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216e5d1-9429-491c-a959-128957ccaa48 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:50.713004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:50.713766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:50.714046 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:50.714319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59 admin admin] PATH_INFO: `/v3/projects/bc94948d65ce4e9988ee54ace195c58b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:50.715657 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc94948d65ce4e9988ee54ace195c58b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:50.717618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:50.768629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc94948d65ce4e9988ee54ace195c58b', 'request_id': 'req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.775331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc94948d65ce4e9988ee54ace195c58b', 'request_id': 'req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.782945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc94948d65ce4e9988ee54ace195c58b', 'request_id': 'req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.800968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59 admin admin] The token cache is being invalidate because project bc94948d65ce4e9988ee54ace195c58b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:50.801237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.801895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-f0c7dc71-aad7-4c7a-80f0-e361d6089b59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:50.803481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1094/2170] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:50 2022] DELETE /identity/v3/projects/bc94948d65ce4e9988ee54ace195c58b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:50.809198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0039-d3cc-44eb-a760-f7901857e789 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:50.809521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0039-d3cc-44eb-a760-f7901857e789 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:50.809795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774e0039-d3cc-44eb-a760-f7901857e789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:50.829511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-774e0039-d3cc-44eb-a760-f7901857e789 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:50.830744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-774e0039-d3cc-44eb-a760-f7901857e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:50.909698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1077/2171] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:50.912929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfbfed-e48a-4101-aee8-e885e8dc4551 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:50.913332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfbfed-e48a-4101-aee8-e885e8dc4551 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:50.913677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfbfed-e48a-4101-aee8-e885e8dc4551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:50.936464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-aedfbfed-e48a-4101-aee8-e885e8dc4551 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:50.938023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-aedfbfed-e48a-4101-aee8-e885e8dc4551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:50.946737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1095/2172] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:50.951387 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0039-d3cc-44eb-a760-f7901857e789 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:50.962682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774e0039-d3cc-44eb-a760-f7901857e789 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:50.968725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168e8c3-e67e-4612-ad9f-d0208d0f2960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:50.969755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168e8c3-e67e-4612-ad9f-d0208d0f2960 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:50.969755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168e8c3-e67e-4612-ad9f-d0208d0f2960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:50.969956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168e8c3-e67e-4612-ad9f-d0208d0f2960 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:50.970781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168e8c3-e67e-4612-ad9f-d0208d0f2960 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:50.971088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168e8c3-e67e-4612-ad9f-d0208d0f2960 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:50.973426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168e8c3-e67e-4612-ad9f-d0208d0f2960 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:50.989686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1078/2173] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:50.994340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfbfed-e48a-4101-aee8-e885e8dc4551 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:51.005778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfbfed-e48a-4101-aee8-e885e8dc4551 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:51.011238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64d818-7df2-4971-b52a-57a24cd190f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:51.012614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64d818-7df2-4971-b52a-57a24cd190f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.012896 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64d818-7df2-4971-b52a-57a24cd190f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.013165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64d818-7df2-4971-b52a-57a24cd190f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.013854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64d818-7df2-4971-b52a-57a24cd190f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:51.015750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64d818-7df2-4971-b52a-57a24cd190f3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:51.053748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1096/2174] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:50 2022] POST /identity/v3/projects => generated 401 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:51.055748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168e8c3-e67e-4612-ad9f-d0208d0f2960 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:51.071636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168e8c3-e67e-4612-ad9f-d0208d0f2960 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:51.097720 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:51.148958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3773df-b324-4f7d-a1eb-eb673b60c449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:51.149644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3773df-b324-4f7d-a1eb-eb673b60c449 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.149925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3773df-b324-4f7d-a1eb-eb673b60c449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.150198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3773df-b324-4f7d-a1eb-eb673b60c449 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.151490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3773df-b324-4f7d-a1eb-eb673b60c449 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:51.153793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3773df-b324-4f7d-a1eb-eb673b60c449 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:51.181346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1079/2175] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:51 2022] POST /identity/v3/users => generated 301 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:51.184454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64d818-7df2-4971-b52a-57a24cd190f3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:51.205433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64d818-7df2-4971-b52a-57a24cd190f3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:51.210096 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ae21c-31e5-4498-9cb2-a505b6393582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:51.210703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ae21c-31e5-4498-9cb2-a505b6393582 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.210978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ae21c-31e5-4498-9cb2-a505b6393582 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.211248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ae21c-31e5-4498-9cb2-a505b6393582 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.211931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ae21c-31e5-4498-9cb2-a505b6393582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:51.214089 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87ae21c-31e5-4498-9cb2-a505b6393582 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:51.224055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1097/2176] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:51.228028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3773df-b324-4f7d-a1eb-eb673b60c449 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:51.239168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3773df-b324-4f7d-a1eb-eb673b60c449 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:51.244036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39340a9-a2b7-4e76-b951-1073496ea300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:51.244700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39340a9-a2b7-4e76-b951-1073496ea300 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.245093 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39340a9-a2b7-4e76-b951-1073496ea300 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.245398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39340a9-a2b7-4e76-b951-1073496ea300 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.246096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39340a9-a2b7-4e76-b951-1073496ea300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:51.247701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39340a9-a2b7-4e76-b951-1073496ea300 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:51.263232 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1080/2177] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:51.265379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ae21c-31e5-4498-9cb2-a505b6393582 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:51.277860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ae21c-31e5-4498-9cb2-a505b6393582 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:51.282795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c4703-8ded-43fc-ad26-2ea4ea0c7723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:51.283465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4703-8ded-43fc-ad26-2ea4ea0c7723 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.283742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4703-8ded-43fc-ad26-2ea4ea0c7723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.284022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64c4703-8ded-43fc-ad26-2ea4ea0c7723 admin admin] PATH_INFO: `/v3/projects/e8ec5631370349368a4f986636dd3708/users/0c3aa99ca1364e6aaa88d69d9c7f3d52/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.294969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:51.302617 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4703-8ded-43fc-ad26-2ea4ea0c7723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ec5631370349368a4f986636dd3708, user_id=0c3aa99ca1364e6aaa88d69d9c7f3d52, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:51.306993 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d64c4703-8ded-43fc-ad26-2ea4ea0c7723 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:51.322562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1098/2178] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:51 2022] PUT /identity/v3/projects/e8ec5631370349368a4f986636dd3708/users/0c3aa99ca1364e6aaa88d69d9c7f3d52/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:04:51.332877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de1a42-d5de-48de-93c5-db5ba572429f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.333269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de1a42-d5de-48de-93c5-db5ba572429f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.333757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11de1a42-d5de-48de-93c5-db5ba572429f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.370985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-11de1a42-d5de-48de-93c5-db5ba572429f None None] MFA Rules not processed for user `0c3aa99ca1364e6aaa88d69d9c7f3d52`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:51.372236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-11de1a42-d5de-48de-93c5-db5ba572429f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:51.436845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1081/2179] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:51.441360 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c4703-8ded-43fc-ad26-2ea4ea0c7723 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:51.503045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d64c4703-8ded-43fc-ad26-2ea4ea0c7723 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:51.507688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894cc18-c623-44b7-87b3-a378bbfde182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:51.508298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894cc18-c623-44b7-87b3-a378bbfde182 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.508580 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894cc18-c623-44b7-87b3-a378bbfde182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.508850 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894cc18-c623-44b7-87b3-a378bbfde182 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.509538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894cc18-c623-44b7-87b3-a378bbfde182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:51.511933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894cc18-c623-44b7-87b3-a378bbfde182 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:51.538004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1099/2180] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:51 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:51.542035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de1a42-d5de-48de-93c5-db5ba572429f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:51.552527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11de1a42-d5de-48de-93c5-db5ba572429f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:51.608380 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280ef01-d42d-4d6c-918a-b03f5ddd3e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:51.608987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280ef01-d42d-4d6c-918a-b03f5ddd3e35 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.609271 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280ef01-d42d-4d6c-918a-b03f5ddd3e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.609571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9280ef01-d42d-4d6c-918a-b03f5ddd3e35 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.610235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280ef01-d42d-4d6c-918a-b03f5ddd3e35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:51.612194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9280ef01-d42d-4d6c-918a-b03f5ddd3e35 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:51.635881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1082/2181] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:51 2022] POST /identity/v3/users => generated 306 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:51.639993 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894cc18-c623-44b7-87b3-a378bbfde182 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:51.650142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894cc18-c623-44b7-87b3-a378bbfde182 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:51.655852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916a990-2527-42fe-ac98-14fe1eb7d168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:51.656482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916a990-2527-42fe-ac98-14fe1eb7d168 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.656773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916a990-2527-42fe-ac98-14fe1eb7d168 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.657032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916a990-2527-42fe-ac98-14fe1eb7d168 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.657754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916a990-2527-42fe-ac98-14fe1eb7d168 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:51.659346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916a990-2527-42fe-ac98-14fe1eb7d168 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:51.669846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1100/2182] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:51.673734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280ef01-d42d-4d6c-918a-b03f5ddd3e35 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:51.683503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9280ef01-d42d-4d6c-918a-b03f5ddd3e35 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:51.688149 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08055-4080-485c-b526-5d98e5d46519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:51.688736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08055-4080-485c-b526-5d98e5d46519 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.689016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08055-4080-485c-b526-5d98e5d46519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.689287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08055-4080-485c-b526-5d98e5d46519 admin admin] PATH_INFO: `/v3/projects/34b499ecb868480b9dc60dd8adda00db/users/930927ddce6848e5a2bc487ae8437a92/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.704178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f08055-4080-485c-b526-5d98e5d46519 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b499ecb868480b9dc60dd8adda00db, user_id=930927ddce6848e5a2bc487ae8437a92, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:51.706906 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f08055-4080-485c-b526-5d98e5d46519 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:51.709923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:51.721663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1083/2183] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:51 2022] PUT /identity/v3/projects/34b499ecb868480b9dc60dd8adda00db/users/930927ddce6848e5a2bc487ae8437a92/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:51.725565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916a990-2527-42fe-ac98-14fe1eb7d168 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:51.735285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916a990-2527-42fe-ac98-14fe1eb7d168 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:51.791227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e0c94-8cf3-433a-ba42-03603239a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:51.791835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e0c94-8cf3-433a-ba42-03603239a720 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.792115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e0c94-8cf3-433a-ba42-03603239a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.792392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e0c94-8cf3-433a-ba42-03603239a720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.793080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e0c94-8cf3-433a-ba42-03603239a720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:51.794717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e0c94-8cf3-433a-ba42-03603239a720 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:51.804197 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1101/2184] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:51.808860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08055-4080-485c-b526-5d98e5d46519 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:51.818962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08055-4080-485c-b526-5d98e5d46519 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:51.824196 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf71cf-5099-4dae-bac6-0a186568e1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:51.824848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf71cf-5099-4dae-bac6-0a186568e1d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.825126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf71cf-5099-4dae-bac6-0a186568e1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.825438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf71cf-5099-4dae-bac6-0a186568e1d7 admin admin] PATH_INFO: `/v3/projects/34b499ecb868480b9dc60dd8adda00db/users/930927ddce6848e5a2bc487ae8437a92/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.827382 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf71cf-5099-4dae-bac6-0a186568e1d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34b499ecb868480b9dc60dd8adda00db, user_id=930927ddce6848e5a2bc487ae8437a92, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:51.830106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faf71cf-5099-4dae-bac6-0a186568e1d7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:51.840208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1084/2185] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:51 2022] PUT /identity/v3/projects/34b499ecb868480b9dc60dd8adda00db/users/930927ddce6848e5a2bc487ae8437a92/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:51.851448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d93b11-ae12-4156-8648-4c6ad438779b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:51.851732 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d93b11-ae12-4156-8648-4c6ad438779b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:51.852032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d93b11-ae12-4156-8648-4c6ad438779b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:51.880375 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d4d93b11-ae12-4156-8648-4c6ad438779b None None] MFA Rules not processed for user `930927ddce6848e5a2bc487ae8437a92`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:51.881613 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d4d93b11-ae12-4156-8648-4c6ad438779b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:51.924705 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:51.949262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1102/2186] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:51 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:51.959586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf71cf-5099-4dae-bac6-0a186568e1d7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:51.961280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2faf71cf-5099-4dae-bac6-0a186568e1d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:52.018732 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf71cf-5099-4dae-bac6-0a186568e1d7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:52.022575 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0bbc6-5b83-47ac-907b-97c0dba291f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:52.023189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0bbc6-5b83-47ac-907b-97c0dba291f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:52.023469 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0bbc6-5b83-47ac-907b-97c0dba291f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:52.023742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0bbc6-5b83-47ac-907b-97c0dba291f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:52.033386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0bbc6-5b83-47ac-907b-97c0dba291f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:52.034831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0bbc6-5b83-47ac-907b-97c0dba291f5 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:52.045604 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1085/2187] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:51 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:52.123238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d93b11-ae12-4156-8648-4c6ad438779b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:52.133091 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d93b11-ae12-4156-8648-4c6ad438779b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:52.137423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf1f00-f4ff-459b-9c3a-e5ed6efa10bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:52.138043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf1f00-f4ff-459b-9c3a-e5ed6efa10bf service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:52.138321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf1f00-f4ff-459b-9c3a-e5ed6efa10bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:52.138592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf1f00-f4ff-459b-9c3a-e5ed6efa10bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:52.217022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf1f00-f4ff-459b-9c3a-e5ed6efa10bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:52.218225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaf1f00-f4ff-459b-9c3a-e5ed6efa10bf service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:52.227951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1103/2188] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:56.273084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0bbc6-5b83-47ac-907b-97c0dba291f5 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:56.335390 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0bbc6-5b83-47ac-907b-97c0dba291f5 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:56.340411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:56.341044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:56.341353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:56.341630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] PATH_INFO: `/v3/users/0c3aa99ca1364e6aaa88d69d9c7f3d52` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:56.342790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c3aa99ca1364e6aaa88d69d9c7f3d52)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:56.344707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:56.391352 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c3aa99ca1364e6aaa88d69d9c7f3d52'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:56.392014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c3aa99ca1364e6aaa88d69d9c7f3d52'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:56.404246 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c3aa99ca1364e6aaa88d69d9c7f3d52'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:56.410933 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c3aa99ca1364e6aaa88d69d9c7f3d52'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:56.419207 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c3aa99ca1364e6aaa88d69d9c7f3d52'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:56.425094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1086/2189] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:56 2022] DELETE /identity/v3/users/0c3aa99ca1364e6aaa88d69d9c7f3d52 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:56.429633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf9ecc-da61-467a-bf68-ecf32d07d2c9 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:56.430131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf9ecc-da61-467a-bf68-ecf32d07d2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:56.430220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf9ecc-da61-467a-bf68-ecf32d07d2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:56.448596 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2acf9ecc-da61-467a-bf68-ecf32d07d2c9 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:56.449742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2acf9ecc-da61-467a-bf68-ecf32d07d2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:56.508951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1104/2190] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:56.519507 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:56.520930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:56.528217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:56.580290 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1015a51c-3033-4536-9f29-89b24caa027f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:56.584283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cb49b-e5f9-49e4-9008-c6d74d81afca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:56.584898 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb49b-e5f9-49e4-9008-c6d74d81afca service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:56.585179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb49b-e5f9-49e4-9008-c6d74d81afca service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:56.585528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9cb49b-e5f9-49e4-9008-c6d74d81afca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:56.595003 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cb49b-e5f9-49e4-9008-c6d74d81afca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:56.596443 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9cb49b-e5f9-49e4-9008-c6d74d81afca service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:56.606652 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1087/2191] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:04:56.950179 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf9ecc-da61-467a-bf68-ecf32d07d2c9 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:56.953409 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2acf9ecc-da61-467a-bf68-ecf32d07d2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:56.969395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf9ecc-da61-467a-bf68-ecf32d07d2c9 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:56.995621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:56.995621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:56.995621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:56.995621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] PATH_INFO: `/v3/projects/e8ec5631370349368a4f986636dd3708` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:56.996432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ec5631370349368a4f986636dd3708)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:56.996432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:57.052254 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ec5631370349368a4f986636dd3708', 'request_id': 'req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.067242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ec5631370349368a4f986636dd3708', 'request_id': 'req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.075784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ec5631370349368a4f986636dd3708', 'request_id': 'req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.101941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] The token cache is being invalidate because project e8ec5631370349368a4f986636dd3708 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:57.102270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.103344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.105415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1105/2192] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:56 2022] DELETE /identity/v3/projects/e8ec5631370349368a4f986636dd3708 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:57.109713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cb49b-e5f9-49e4-9008-c6d74d81afca service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:57.120298 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9cb49b-e5f9-49e4-9008-c6d74d81afca service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:57.182921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84be31c-2318-4a78-80cc-c38a0284b4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:57.183675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84be31c-2318-4a78-80cc-c38a0284b4ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:57.184087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84be31c-2318-4a78-80cc-c38a0284b4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:57.184453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84be31c-2318-4a78-80cc-c38a0284b4ee admin admin] PATH_INFO: `/v3/users/930927ddce6848e5a2bc487ae8437a92` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:57.185798 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84be31c-2318-4a78-80cc-c38a0284b4ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=930927ddce6848e5a2bc487ae8437a92)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:57.187779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84be31c-2318-4a78-80cc-c38a0284b4ee admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:57.242850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e84be31c-2318-4a78-80cc-c38a0284b4ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '930927ddce6848e5a2bc487ae8437a92'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.243632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e84be31c-2318-4a78-80cc-c38a0284b4ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '930927ddce6848e5a2bc487ae8437a92'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.258899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e84be31c-2318-4a78-80cc-c38a0284b4ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '930927ddce6848e5a2bc487ae8437a92'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.268233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e84be31c-2318-4a78-80cc-c38a0284b4ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '930927ddce6848e5a2bc487ae8437a92'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.275954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e84be31c-2318-4a78-80cc-c38a0284b4ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '930927ddce6848e5a2bc487ae8437a92'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.282707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1088/2193] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:04:57 2022] DELETE /identity/v3/users/930927ddce6848e5a2bc487ae8437a92 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:57.602279 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:57.605799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:57.621537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:57.628071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdf057-e82b-4f28-aeb0-babfaa8123dc admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:57.693098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f150e9-03a7-44bf-8cfd-635980a68ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:57.693794 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f150e9-03a7-44bf-8cfd-635980a68ef8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:57.694079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f150e9-03a7-44bf-8cfd-635980a68ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:57.694354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f150e9-03a7-44bf-8cfd-635980a68ef8 admin admin] PATH_INFO: `/v3/projects/34b499ecb868480b9dc60dd8adda00db` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:57.695653 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f150e9-03a7-44bf-8cfd-635980a68ef8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34b499ecb868480b9dc60dd8adda00db)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:57.697751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f150e9-03a7-44bf-8cfd-635980a68ef8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:57.747103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e4f150e9-03a7-44bf-8cfd-635980a68ef8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34b499ecb868480b9dc60dd8adda00db', 'request_id': 'req-e4f150e9-03a7-44bf-8cfd-635980a68ef8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.752741 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e4f150e9-03a7-44bf-8cfd-635980a68ef8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34b499ecb868480b9dc60dd8adda00db', 'request_id': 'req-e4f150e9-03a7-44bf-8cfd-635980a68ef8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.759328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e4f150e9-03a7-44bf-8cfd-635980a68ef8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34b499ecb868480b9dc60dd8adda00db', 'request_id': 'req-e4f150e9-03a7-44bf-8cfd-635980a68ef8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.772576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e4f150e9-03a7-44bf-8cfd-635980a68ef8 admin admin] The token cache is being invalidate because project 34b499ecb868480b9dc60dd8adda00db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:04:57.772787 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e4f150e9-03a7-44bf-8cfd-635980a68ef8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.773483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e4f150e9-03a7-44bf-8cfd-635980a68ef8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:04:57.778523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1106/2194] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:04:57 2022] DELETE /identity/v3/projects/34b499ecb868480b9dc60dd8adda00db => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:57.780165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ab90a-5ac7-4bd5-a9a4-1a50984a4c89 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:57.780453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ab90a-5ac7-4bd5-a9a4-1a50984a4c89 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:57.780726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ab90a-5ac7-4bd5-a9a4-1a50984a4c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:57.801754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3e1ab90a-5ac7-4bd5-a9a4-1a50984a4c89 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:57.802983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3e1ab90a-5ac7-4bd5-a9a4-1a50984a4c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:57.824340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:57.866163 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1089/2195] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:57.874487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eaa5a-c706-42d6-9661-1c468fa337e0 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:57.874783 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eaa5a-c706-42d6-9661-1c468fa337e0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:57.875065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679eaa5a-c706-42d6-9661-1c468fa337e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:57.895087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-679eaa5a-c706-42d6-9661-1c468fa337e0 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:57.896286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-679eaa5a-c706-42d6-9661-1c468fa337e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:57.904146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1107/2196] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:57.908285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ab90a-5ac7-4bd5-a9a4-1a50984a4c89 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:57.917860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ab90a-5ac7-4bd5-a9a4-1a50984a4c89 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:57.922373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee59bb3-a8cb-4df3-b1ef-ec9d416bf8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:57.922976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59bb3-a8cb-4df3-b1ef-ec9d416bf8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:57.923256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59bb3-a8cb-4df3-b1ef-ec9d416bf8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:57.923529 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee59bb3-a8cb-4df3-b1ef-ec9d416bf8d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:57.924215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee59bb3-a8cb-4df3-b1ef-ec9d416bf8d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:04:57.924517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee59bb3-a8cb-4df3-b1ef-ec9d416bf8d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:57.926165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee59bb3-a8cb-4df3-b1ef-ec9d416bf8d1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:57.938253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1090/2197] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:04:57.942260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eaa5a-c706-42d6-9661-1c468fa337e0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:57.952216 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679eaa5a-c706-42d6-9661-1c468fa337e0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:57.956931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901692e-e0e0-4e4c-8dc6-f935b911c5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:57.957564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901692e-e0e0-4e4c-8dc6-f935b911c5f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:57.957839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901692e-e0e0-4e4c-8dc6-f935b911c5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:57.958105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3901692e-e0e0-4e4c-8dc6-f935b911c5f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:57.958789 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901692e-e0e0-4e4c-8dc6-f935b911c5f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:57.960668 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3901692e-e0e0-4e4c-8dc6-f935b911c5f2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:57.991638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1108/2198] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:57 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:57.993240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee59bb3-a8cb-4df3-b1ef-ec9d416bf8d1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:58.003551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee59bb3-a8cb-4df3-b1ef-ec9d416bf8d1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:58.060829 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0ddac-b728-45c3-800a-b3591cf696b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:58.061480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0ddac-b728-45c3-800a-b3591cf696b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.061795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0ddac-b728-45c3-800a-b3591cf696b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.062070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0ddac-b728-45c3-800a-b3591cf696b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:58.062774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0ddac-b728-45c3-800a-b3591cf696b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:58.064769 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff0ddac-b728-45c3-800a-b3591cf696b7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:58.086849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1091/2199] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:57 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:04:58.091251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901692e-e0e0-4e4c-8dc6-f935b911c5f2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:58.100851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3901692e-e0e0-4e4c-8dc6-f935b911c5f2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:58.105424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe48f7-d021-486f-8354-94852bb54429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:58.106027 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe48f7-d021-486f-8354-94852bb54429 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.106301 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe48f7-d021-486f-8354-94852bb54429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.106566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe48f7-d021-486f-8354-94852bb54429 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:58.107249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe48f7-d021-486f-8354-94852bb54429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:58.108972 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe48f7-d021-486f-8354-94852bb54429 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:58.120455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1109/2200] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:58.124408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0ddac-b728-45c3-800a-b3591cf696b7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:58.134802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0ddac-b728-45c3-800a-b3591cf696b7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:58.140544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b323a48a-f05f-457e-9e64-13c860f7cd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:58.141162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323a48a-f05f-457e-9e64-13c860f7cd6a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.141848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323a48a-f05f-457e-9e64-13c860f7cd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.141848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b323a48a-f05f-457e-9e64-13c860f7cd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:58.142549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323a48a-f05f-457e-9e64-13c860f7cd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:58.144159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b323a48a-f05f-457e-9e64-13c860f7cd6a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:58.158549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1092/2201] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:58.159828 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe48f7-d021-486f-8354-94852bb54429 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:58.187557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe48f7-d021-486f-8354-94852bb54429 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:58.192552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381071e8-e0fe-4bf6-860a-90279f35ada5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:58.193365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381071e8-e0fe-4bf6-860a-90279f35ada5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.193785 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381071e8-e0fe-4bf6-860a-90279f35ada5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.194068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381071e8-e0fe-4bf6-860a-90279f35ada5 admin admin] PATH_INFO: `/v3/projects/7b97ab63391349129bb8912fcb972f52/users/0cbf96711f2b4d0b8df7596019bf06e4/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:58.211327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381071e8-e0fe-4bf6-860a-90279f35ada5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b97ab63391349129bb8912fcb972f52, user_id=0cbf96711f2b4d0b8df7596019bf06e4, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:58.214386 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381071e8-e0fe-4bf6-860a-90279f35ada5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:58.228693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1110/2202] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:58 2022] PUT /identity/v3/projects/7b97ab63391349129bb8912fcb972f52/users/0cbf96711f2b4d0b8df7596019bf06e4/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:58.241144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f4c92-6cce-490e-b192-b6762b92787a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.241465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f4c92-6cce-490e-b192-b6762b92787a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.241741 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73f4c92-6cce-490e-b192-b6762b92787a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:58.274915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e73f4c92-6cce-490e-b192-b6762b92787a None None] MFA Rules not processed for user `0cbf96711f2b4d0b8df7596019bf06e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:58.276245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e73f4c92-6cce-490e-b192-b6762b92787a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:58.365331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1093/2203] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:58.369008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381071e8-e0fe-4bf6-860a-90279f35ada5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:58.404236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:58.442300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381071e8-e0fe-4bf6-860a-90279f35ada5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:58.447814 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04114-7653-429f-8bb1-49dec6883f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:58.448435 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04114-7653-429f-8bb1-49dec6883f9f admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.448716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04114-7653-429f-8bb1-49dec6883f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.448986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe04114-7653-429f-8bb1-49dec6883f9f admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:58.449693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe04114-7653-429f-8bb1-49dec6883f9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:58.451623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe04114-7653-429f-8bb1-49dec6883f9f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:58.488868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1111/2204] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:04:58 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:58.490986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f4c92-6cce-490e-b192-b6762b92787a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:58.503590 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73f4c92-6cce-490e-b192-b6762b92787a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:58.524728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:04:58.565009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d750d-8892-4a65-adc6-7cc0df44b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:58.565585 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d750d-8892-4a65-adc6-7cc0df44b4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.565865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d750d-8892-4a65-adc6-7cc0df44b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.566140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7d750d-8892-4a65-adc6-7cc0df44b4f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:58.566800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d750d-8892-4a65-adc6-7cc0df44b4f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:58.568740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7d750d-8892-4a65-adc6-7cc0df44b4f4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:58.590354 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1094/2205] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:04:58 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:04:58.595272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04114-7653-429f-8bb1-49dec6883f9f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:58.606158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe04114-7653-429f-8bb1-49dec6883f9f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:58.610980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbf066-a876-4c95-96c4-3acef929b6a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:58.611615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbf066-a876-4c95-96c4-3acef929b6a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.611890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbf066-a876-4c95-96c4-3acef929b6a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.612158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cbf066-a876-4c95-96c4-3acef929b6a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:58.612845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbf066-a876-4c95-96c4-3acef929b6a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:58.614735 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cbf066-a876-4c95-96c4-3acef929b6a3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:58.625495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1112/2206] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:58.629634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d750d-8892-4a65-adc6-7cc0df44b4f4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:58.639279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7d750d-8892-4a65-adc6-7cc0df44b4f4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:58.643788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f021-1a2f-4fb6-ba5d-c7e495847ee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:58.644426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f021-1a2f-4fb6-ba5d-c7e495847ee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.644700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f021-1a2f-4fb6-ba5d-c7e495847ee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.644969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae4f021-1a2f-4fb6-ba5d-c7e495847ee3 admin admin] PATH_INFO: `/v3/projects/e2be53ae8af64f0bb7626626634ab621/users/ad8549b87f114e1e94e4817ea40f1b9d/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:58.659727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4f021-1a2f-4fb6-ba5d-c7e495847ee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2be53ae8af64f0bb7626626634ab621, user_id=ad8549b87f114e1e94e4817ea40f1b9d, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:58.662476 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae4f021-1a2f-4fb6-ba5d-c7e495847ee3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:58.675745 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1095/2207] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:58 2022] PUT /identity/v3/projects/e2be53ae8af64f0bb7626626634ab621/users/ad8549b87f114e1e94e4817ea40f1b9d/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:58.680355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbf066-a876-4c95-96c4-3acef929b6a3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:58.690331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cbf066-a876-4c95-96c4-3acef929b6a3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:58.745852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb82ee-055e-4e1a-9971-6ae8556fce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:58.746508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb82ee-055e-4e1a-9971-6ae8556fce79 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.746766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb82ee-055e-4e1a-9971-6ae8556fce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.747040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb82ee-055e-4e1a-9971-6ae8556fce79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:58.747723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb82ee-055e-4e1a-9971-6ae8556fce79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:58.749328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb82ee-055e-4e1a-9971-6ae8556fce79 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:58.758783 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1113/2208] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:04:58.762919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f021-1a2f-4fb6-ba5d-c7e495847ee3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:58.773423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae4f021-1a2f-4fb6-ba5d-c7e495847ee3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:58.778513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e2ddb-31d9-405c-82fe-9a6e8e320698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:58.779162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e2ddb-31d9-405c-82fe-9a6e8e320698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.779471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e2ddb-31d9-405c-82fe-9a6e8e320698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.779747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e2ddb-31d9-405c-82fe-9a6e8e320698 admin admin] PATH_INFO: `/v3/projects/e2be53ae8af64f0bb7626626634ab621/users/ad8549b87f114e1e94e4817ea40f1b9d/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:58.781753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e2ddb-31d9-405c-82fe-9a6e8e320698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2be53ae8af64f0bb7626626634ab621, user_id=ad8549b87f114e1e94e4817ea40f1b9d, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:58.784408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e2ddb-31d9-405c-82fe-9a6e8e320698 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:58.795119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1096/2209] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:04:58 2022] PUT /identity/v3/projects/e2be53ae8af64f0bb7626626634ab621/users/ad8549b87f114e1e94e4817ea40f1b9d/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:04:58.805021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eba0e2-066c-4f59-bb00-c31443da60ad None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.805333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eba0e2-066c-4f59-bb00-c31443da60ad None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.805613 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eba0e2-066c-4f59-bb00-c31443da60ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:58.832350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f8eba0e2-066c-4f59-bb00-c31443da60ad None None] MFA Rules not processed for user `ad8549b87f114e1e94e4817ea40f1b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:04:58.833501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f8eba0e2-066c-4f59-bb00-c31443da60ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:58.899560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1114/2210] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:04:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:04:58.911096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e2ddb-31d9-405c-82fe-9a6e8e320698 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:04:58.912776 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ed7e2ddb-31d9-405c-82fe-9a6e8e320698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:04:58.970506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e2ddb-31d9-405c-82fe-9a6e8e320698 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:04:58.974155 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2499d-93e8-41bd-83a6-acbcddfa87c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:04:58.974784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2499d-93e8-41bd-83a6-acbcddfa87c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:04:58.975059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2499d-93e8-41bd-83a6-acbcddfa87c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:04:58.975327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2499d-93e8-41bd-83a6-acbcddfa87c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:04:59.029550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2499d-93e8-41bd-83a6-acbcddfa87c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:04:59.031042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2499d-93e8-41bd-83a6-acbcddfa87c3 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:04:59.039981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1097/2211] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:04:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:03.381368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eba0e2-066c-4f59-bb00-c31443da60ad None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:03.383926 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f8eba0e2-066c-4f59-bb00-c31443da60ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:03.403135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eba0e2-066c-4f59-bb00-c31443da60ad None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:03.405053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b99a-08ca-4025-909b-fd4e325bcdab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:03.405720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b99a-08ca-4025-909b-fd4e325bcdab service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:03.405979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b99a-08ca-4025-909b-fd4e325bcdab service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:03.406246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7b99a-08ca-4025-909b-fd4e325bcdab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:03.415939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7b99a-08ca-4025-909b-fd4e325bcdab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:03.417942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de7b99a-08ca-4025-909b-fd4e325bcdab service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:03.427441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1115/2212] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:04.464349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cde91-2582-405c-bb8c-eaeaa81c9bcf None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:04.464847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cde91-2582-405c-bb8c-eaeaa81c9bcf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:04.465004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328cde91-2582-405c-bb8c-eaeaa81c9bcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:04.486819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-328cde91-2582-405c-bb8c-eaeaa81c9bcf None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:04.488033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-328cde91-2582-405c-bb8c-eaeaa81c9bcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:04.513393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:04.545612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1098/2213] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:05:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:04.586589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b99a-08ca-4025-909b-fd4e325bcdab service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:04.588510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2de7b99a-08ca-4025-909b-fd4e325bcdab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:04.602766 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:04.658605 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de7b99a-08ca-4025-909b-fd4e325bcdab service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:04.663577 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bdee0-9fd0-455e-af73-6ebbeb802bca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:04.664192 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bdee0-9fd0-455e-af73-6ebbeb802bca service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:04.664469 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bdee0-9fd0-455e-af73-6ebbeb802bca service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:04.664741 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44bdee0-9fd0-455e-af73-6ebbeb802bca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:04.674447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bdee0-9fd0-455e-af73-6ebbeb802bca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:04.676343 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44bdee0-9fd0-455e-af73-6ebbeb802bca service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:04.686598 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1116/2214] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:05:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:05:05.304047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392ff4d-84cf-4dcc-bf00-57e0be4d86d3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:05.304270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392ff4d-84cf-4dcc-bf00-57e0be4d86d3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:05.304538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4392ff4d-84cf-4dcc-bf00-57e0be4d86d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:05.325744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4392ff4d-84cf-4dcc-bf00-57e0be4d86d3 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:05.327445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4392ff4d-84cf-4dcc-bf00-57e0be4d86d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:05.335161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1099/2215] 10.222.0.42 () {58 vars in 967 bytes} [Mon Aug 1 12:05:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:05.350466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bdee0-9fd0-455e-af73-6ebbeb802bca service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:05.362137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44bdee0-9fd0-455e-af73-6ebbeb802bca service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:05.367379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888be869-af2b-49c9-8c13-c37df7ce591a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:05.368124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888be869-af2b-49c9-8c13-c37df7ce591a service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:05.368403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888be869-af2b-49c9-8c13-c37df7ce591a service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:05.368674 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888be869-af2b-49c9-8c13-c37df7ce591a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:05.377706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888be869-af2b-49c9-8c13-c37df7ce591a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:05.379289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888be869-af2b-49c9-8c13-c37df7ce591a service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:05.387609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1117/2216] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:05:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:05:05.648626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bf81b-eecd-468f-8594-b194f4226eac None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:05.649074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bf81b-eecd-468f-8594-b194f4226eac None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:05.649161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81bf81b-eecd-468f-8594-b194f4226eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:05.669409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f81bf81b-eecd-468f-8594-b194f4226eac None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:05.670583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f81bf81b-eecd-468f-8594-b194f4226eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:05.677862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1100/2217] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:05:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:05.689669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888be869-af2b-49c9-8c13-c37df7ce591a service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:05.700778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888be869-af2b-49c9-8c13-c37df7ce591a service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:05.705804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c6352-e0a9-4c16-bf7c-47cd810b5f96 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:05.706400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c6352-e0a9-4c16-bf7c-47cd810b5f96 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:05.706677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c6352-e0a9-4c16-bf7c-47cd810b5f96 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:05.706948 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c6352-e0a9-4c16-bf7c-47cd810b5f96 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:05.715371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c6352-e0a9-4c16-bf7c-47cd810b5f96 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:05.716932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c6352-e0a9-4c16-bf7c-47cd810b5f96 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:05.724727 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1118/2218] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:05:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:05:06.070214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13f4f5-e891-4c3f-9001-3cc222d02f45 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:06.070583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13f4f5-e891-4c3f-9001-3cc222d02f45 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:06.070963 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc13f4f5-e891-4c3f-9001-3cc222d02f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:06.090341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bc13f4f5-e891-4c3f-9001-3cc222d02f45 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:06.091539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bc13f4f5-e891-4c3f-9001-3cc222d02f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:06.099650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1101/2219] 10.222.0.42 () {58 vars in 967 bytes} [Mon Aug 1 12:05:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:06.112715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c6352-e0a9-4c16-bf7c-47cd810b5f96 service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:06.124056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c6352-e0a9-4c16-bf7c-47cd810b5f96 service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:06.129808 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde83b3-3f93-4f54-9c46-b08d14d608c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:06.130257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde83b3-3f93-4f54-9c46-b08d14d608c6 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:06.130534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde83b3-3f93-4f54-9c46-b08d14d608c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:06.130807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cde83b3-3f93-4f54-9c46-b08d14d608c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:06.139802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde83b3-3f93-4f54-9c46-b08d14d608c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:06.141824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cde83b3-3f93-4f54-9c46-b08d14d608c6 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:06.150844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1119/2220] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:05:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:05:08.289530 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13f4f5-e891-4c3f-9001-3cc222d02f45 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:08.290955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bc13f4f5-e891-4c3f-9001-3cc222d02f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:08.360373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc13f4f5-e891-4c3f-9001-3cc222d02f45 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:08.364997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bf746e-4f91-4d9e-856b-d94df376797a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:08.365665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf746e-4f91-4d9e-856b-d94df376797a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:08.365943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf746e-4f91-4d9e-856b-d94df376797a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:08.366214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bf746e-4f91-4d9e-856b-d94df376797a admin admin] PATH_INFO: `/v3/users/086563703a7a46d78878a4226374e6f7` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:08.367378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf746e-4f91-4d9e-856b-d94df376797a admin admin] RBAC: Authorizing `identity:delete_user(user_id=086563703a7a46d78878a4226374e6f7)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:08.369314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bf746e-4f91-4d9e-856b-d94df376797a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:08.414143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-94bf746e-4f91-4d9e-856b-d94df376797a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '086563703a7a46d78878a4226374e6f7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:08.414705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-94bf746e-4f91-4d9e-856b-d94df376797a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '086563703a7a46d78878a4226374e6f7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:08.428021 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-94bf746e-4f91-4d9e-856b-d94df376797a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '086563703a7a46d78878a4226374e6f7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:08.434671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde83b3-3f93-4f54-9c46-b08d14d608c6 service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:08.435349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-94bf746e-4f91-4d9e-856b-d94df376797a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '086563703a7a46d78878a4226374e6f7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:08.443599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-94bf746e-4f91-4d9e-856b-d94df376797a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '086563703a7a46d78878a4226374e6f7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:08.445471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cde83b3-3f93-4f54-9c46-b08d14d608c6 service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:08.449705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1102/2221] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:05:08 2022] DELETE /identity/v3/users/086563703a7a46d78878a4226374e6f7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:08.452662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:08.452662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:08.452662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:08.452662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] PATH_INFO: `/v3/users/0cbf96711f2b4d0b8df7596019bf06e4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:08.453760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cbf96711f2b4d0b8df7596019bf06e4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:08.453954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8829ddd-efed-4ead-b4ae-0466c8efc04c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:08.454267 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8829ddd-efed-4ead-b4ae-0466c8efc04c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:08.454544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8829ddd-efed-4ead-b4ae-0466c8efc04c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:08.455670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:08.473757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e8829ddd-efed-4ead-b4ae-0466c8efc04c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:08.474976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e8829ddd-efed-4ead-b4ae-0466c8efc04c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:08.510682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:08.512784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cbf96711f2b4d0b8df7596019bf06e4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:08.521918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cbf96711f2b4d0b8df7596019bf06e4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:08.535289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cbf96711f2b4d0b8df7596019bf06e4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:08.536615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cbf96711f2b4d0b8df7596019bf06e4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:08.546559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cbf96711f2b4d0b8df7596019bf06e4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:08.549893 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1103/2222] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:05:08.556384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1120/2223] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:05:08 2022] DELETE /identity/v3/users/0cbf96711f2b4d0b8df7596019bf06e4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:05:08.560793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ee9ee-7608-4a70-80da-22e70135e2fa None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:08.561076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ee9ee-7608-4a70-80da-22e70135e2fa None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:08.561729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25ee9ee-7608-4a70-80da-22e70135e2fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:08.562629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:08.564600 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:08.580408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a25ee9ee-7608-4a70-80da-22e70135e2fa None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:08.581749 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a25ee9ee-7608-4a70-80da-22e70135e2fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:08.605797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:08.626530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b90b0-58b5-4e99-bc98-ba6de1119d2f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:08.630273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16726fa7-c9ce-4fcd-ae30-df3fb4901f7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:08.630893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16726fa7-c9ce-4fcd-ae30-df3fb4901f7b service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:08.631171 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16726fa7-c9ce-4fcd-ae30-df3fb4901f7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:08.631474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16726fa7-c9ce-4fcd-ae30-df3fb4901f7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:08.633395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-16726fa7-c9ce-4fcd-ae30-df3fb4901f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:08.643701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1104/2224] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:08.653652 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ee9ee-7608-4a70-80da-22e70135e2fa None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:08.662988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25ee9ee-7608-4a70-80da-22e70135e2fa None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:08.667472 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48960a8f-c72c-4ff0-b581-f603d22b7d54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:08.668022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48960a8f-c72c-4ff0-b581-f603d22b7d54 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:08.668302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48960a8f-c72c-4ff0-b581-f603d22b7d54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:08.668569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48960a8f-c72c-4ff0-b581-f603d22b7d54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:08.678766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48960a8f-c72c-4ff0-b581-f603d22b7d54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:08.680206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48960a8f-c72c-4ff0-b581-f603d22b7d54 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:08.689962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1105/2225] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:05:08.697947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16726fa7-c9ce-4fcd-ae30-df3fb4901f7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:08.699433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16726fa7-c9ce-4fcd-ae30-df3fb4901f7b service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:08.709476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1121/2226] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:05:09.019731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48960a8f-c72c-4ff0-b581-f603d22b7d54 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:09.021709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-48960a8f-c72c-4ff0-b581-f603d22b7d54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:09.043606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16726fa7-c9ce-4fcd-ae30-df3fb4901f7b service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:09.045841 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-16726fa7-c9ce-4fcd-ae30-df3fb4901f7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:09.065200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48960a8f-c72c-4ff0-b581-f603d22b7d54 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:09.066667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16726fa7-c9ce-4fcd-ae30-df3fb4901f7b service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:09.076649 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:09.077422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.077915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.078495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] PATH_INFO: `/v3/projects/7b97ab63391349129bb8912fcb972f52` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.079883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b97ab63391349129bb8912fcb972f52)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:09.084100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:09.092269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072378c2-01f3-497d-894b-f6c306d6caec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:09.093582 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072378c2-01f3-497d-894b-f6c306d6caec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.095724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072378c2-01f3-497d-894b-f6c306d6caec admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.096217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072378c2-01f3-497d-894b-f6c306d6caec admin admin] PATH_INFO: `/v3/projects/57f448d0c25c40c6b5b21bf93c3b1ab7` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.098796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072378c2-01f3-497d-894b-f6c306d6caec admin admin] RBAC: Authorizing `identity:delete_project(project_id=57f448d0c25c40c6b5b21bf93c3b1ab7)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:09.100814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072378c2-01f3-497d-894b-f6c306d6caec admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:09.162322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b97ab63391349129bb8912fcb972f52', 'request_id': 'req-385365c3-5f89-47a8-902c-44df585ad79c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.172996 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b97ab63391349129bb8912fcb972f52', 'request_id': 'req-385365c3-5f89-47a8-902c-44df585ad79c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.186875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b97ab63391349129bb8912fcb972f52', 'request_id': 'req-385365c3-5f89-47a8-902c-44df585ad79c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.202526 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-072378c2-01f3-497d-894b-f6c306d6caec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57f448d0c25c40c6b5b21bf93c3b1ab7', 'request_id': 'req-072378c2-01f3-497d-894b-f6c306d6caec'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.206927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] The token cache is being invalidate because project 7b97ab63391349129bb8912fcb972f52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:05:09.207638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.208560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-072378c2-01f3-497d-894b-f6c306d6caec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57f448d0c25c40c6b5b21bf93c3b1ab7', 'request_id': 'req-072378c2-01f3-497d-894b-f6c306d6caec'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.208687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.210551 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1122/2227] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:05:09 2022] DELETE /identity/v3/projects/7b97ab63391349129bb8912fcb972f52 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:09.216560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-072378c2-01f3-497d-894b-f6c306d6caec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57f448d0c25c40c6b5b21bf93c3b1ab7', 'request_id': 'req-072378c2-01f3-497d-894b-f6c306d6caec'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.219968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:09.226481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:09.235807 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-072378c2-01f3-497d-894b-f6c306d6caec admin admin] The token cache is being invalidate because project 57f448d0c25c40c6b5b21bf93c3b1ab7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:05:09.236167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-072378c2-01f3-497d-894b-f6c306d6caec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.236881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-072378c2-01f3-497d-894b-f6c306d6caec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.238510 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1106/2228] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:05:09 2022] DELETE /identity/v3/projects/57f448d0c25c40c6b5b21bf93c3b1ab7 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:09.243281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2b60-6f99-4205-9731-3888465e4ec2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.243631 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2b60-6f99-4205-9731-3888465e4ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.243968 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b2b60-6f99-4205-9731-3888465e4ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.267565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4b9b2b60-6f99-4205-9731-3888465e4ec2 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:09.269938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4b9b2b60-6f99-4205-9731-3888465e4ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:09.311481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385365c3-5f89-47a8-902c-44df585ad79c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:09.317979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:09.327806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:09.343666 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1107/2229] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:05:09.390995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:09.392238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.392793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.393335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] PATH_INFO: `/v3/users/ad8549b87f114e1e94e4817ea40f1b9d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.394829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad8549b87f114e1e94e4817ea40f1b9d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:09.397235 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:09.412502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb71f9-dcd4-4655-875e-c34ede0cb854 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.412792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb71f9-dcd4-4655-875e-c34ede0cb854 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.413154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb71f9-dcd4-4655-875e-c34ede0cb854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.438218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-62bb71f9-dcd4-4655-875e-c34ede0cb854 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:09.439168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-62bb71f9-dcd4-4655-875e-c34ede0cb854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:09.450396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1108/2230] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:05:09.455908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb71f9-dcd4-4655-875e-c34ede0cb854 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:09.456611 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad8549b87f114e1e94e4817ea40f1b9d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.465367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad8549b87f114e1e94e4817ea40f1b9d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.466970 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb71f9-dcd4-4655-875e-c34ede0cb854 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:09.474775 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0a17c-7dad-4ec0-9823-d4199870b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:09.475528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a17c-7dad-4ec0-9823-d4199870b1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.475907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a17c-7dad-4ec0-9823-d4199870b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.476329 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d0a17c-7dad-4ec0-9823-d4199870b1e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.477121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0a17c-7dad-4ec0-9823-d4199870b1e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:05:09.477584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0a17c-7dad-4ec0-9823-d4199870b1e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:09.479741 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d0a17c-7dad-4ec0-9823-d4199870b1e6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:09.480638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad8549b87f114e1e94e4817ea40f1b9d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.481938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad8549b87f114e1e94e4817ea40f1b9d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.490525 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad8549b87f114e1e94e4817ea40f1b9d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.495344 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1109/2231] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:05:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 12:05:09.498965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1123/2232] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:05:09 2022] DELETE /identity/v3/users/ad8549b87f114e1e94e4817ea40f1b9d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:05:09.499972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0a17c-7dad-4ec0-9823-d4199870b1e6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:09.502207 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-62d0a17c-7dad-4ec0-9823-d4199870b1e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:09.519183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d0a17c-7dad-4ec0-9823-d4199870b1e6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:09.621145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dea2c7-9701-4e1b-bcb4-c21604280fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:09.621671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dea2c7-9701-4e1b-bcb4-c21604280fbc admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.622073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dea2c7-9701-4e1b-bcb4-c21604280fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.623215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dea2c7-9701-4e1b-bcb4-c21604280fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.623978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dea2c7-9701-4e1b-bcb4-c21604280fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:09.626424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0dea2c7-9701-4e1b-bcb4-c21604280fbc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:09.666904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1110/2233] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:05:09 2022] POST /identity/v3/projects => generated 381 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:05:09.667288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:09.678418 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a06d34-cb5a-4ec2-b2ca-cda57eb70a06 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:09.740377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bfb1f-ae21-4c7c-9bae-6df90eba463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:09.740999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bfb1f-ae21-4c7c-9bae-6df90eba463e admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.741282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bfb1f-ae21-4c7c-9bae-6df90eba463e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.741581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63bfb1f-ae21-4c7c-9bae-6df90eba463e admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.742252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bfb1f-ae21-4c7c-9bae-6df90eba463e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:09.744234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63bfb1f-ae21-4c7c-9bae-6df90eba463e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:09.768239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1124/2234] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:05:09 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:09.772180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dea2c7-9701-4e1b-bcb4-c21604280fbc admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:09.783740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0dea2c7-9701-4e1b-bcb4-c21604280fbc admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:09.788865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f784375-b4ec-4fff-9214-30b301135789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:09.789525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f784375-b4ec-4fff-9214-30b301135789 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.789813 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f784375-b4ec-4fff-9214-30b301135789 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.790086 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f784375-b4ec-4fff-9214-30b301135789 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.790865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f784375-b4ec-4fff-9214-30b301135789 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:09.792571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f784375-b4ec-4fff-9214-30b301135789 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:09.803381 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1111/2235] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:09.808181 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bfb1f-ae21-4c7c-9bae-6df90eba463e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:09.811152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f784375-b4ec-4fff-9214-30b301135789 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:09.812960 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2f784375-b4ec-4fff-9214-30b301135789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:09.819947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63bfb1f-ae21-4c7c-9bae-6df90eba463e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:09.827534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f784375-b4ec-4fff-9214-30b301135789 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:09.828503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e991f7-5504-4e7b-a150-75d94058fba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:09.829134 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e991f7-5504-4e7b-a150-75d94058fba7 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.829461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e991f7-5504-4e7b-a150-75d94058fba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.829738 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e991f7-5504-4e7b-a150-75d94058fba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.830449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e991f7-5504-4e7b-a150-75d94058fba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:09.832363 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e991f7-5504-4e7b-a150-75d94058fba7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:09.834488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce1c7f-a576-4bc2-bf69-84876a446a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:09.838856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1c7f-a576-4bc2-bf69-84876a446a74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.839409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1c7f-a576-4bc2-bf69-84876a446a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.840353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce1c7f-a576-4bc2-bf69-84876a446a74 admin admin] PATH_INFO: `/v3/projects/e2be53ae8af64f0bb7626626634ab621` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.841740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce1c7f-a576-4bc2-bf69-84876a446a74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2be53ae8af64f0bb7626626634ab621)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:09.845339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1125/2236] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:09 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:09.845487 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce1c7f-a576-4bc2-bf69-84876a446a74 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:09.847246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e991f7-5504-4e7b-a150-75d94058fba7 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:09.857101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e991f7-5504-4e7b-a150-75d94058fba7 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:09.861986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6383cc-54b8-47a7-aa0e-c90472d5d2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:09.862657 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6383cc-54b8-47a7-aa0e-c90472d5d2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.862938 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6383cc-54b8-47a7-aa0e-c90472d5d2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.863211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6383cc-54b8-47a7-aa0e-c90472d5d2a9 admin admin] PATH_INFO: `/v3/projects/47cae094391f496484250c2e1abedb90/users/ab917ef751d8403aa41d25e5c5e6c465/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.876769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:09.881383 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6383cc-54b8-47a7-aa0e-c90472d5d2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47cae094391f496484250c2e1abedb90, user_id=ab917ef751d8403aa41d25e5c5e6c465, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:09.884205 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6383cc-54b8-47a7-aa0e-c90472d5d2a9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:09.894817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a0ce1c7f-a576-4bc2-bf69-84876a446a74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2be53ae8af64f0bb7626626634ab621', 'request_id': 'req-a0ce1c7f-a576-4bc2-bf69-84876a446a74'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.898863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1126/2237] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:05:09 2022] PUT /identity/v3/projects/47cae094391f496484250c2e1abedb90/users/ab917ef751d8403aa41d25e5c5e6c465/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:05:09.902899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a0ce1c7f-a576-4bc2-bf69-84876a446a74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2be53ae8af64f0bb7626626634ab621', 'request_id': 'req-a0ce1c7f-a576-4bc2-bf69-84876a446a74'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.903895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeb784-6c2d-4e8a-9598-f9652a54bfd9 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.904179 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeb784-6c2d-4e8a-9598-f9652a54bfd9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.904452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aeb784-6c2d-4e8a-9598-f9652a54bfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.910901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a0ce1c7f-a576-4bc2-bf69-84876a446a74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2be53ae8af64f0bb7626626634ab621', 'request_id': 'req-a0ce1c7f-a576-4bc2-bf69-84876a446a74'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.922842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-08aeb784-6c2d-4e8a-9598-f9652a54bfd9 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:09.924033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-08aeb784-6c2d-4e8a-9598-f9652a54bfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:09.924144 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a0ce1c7f-a576-4bc2-bf69-84876a446a74 admin admin] The token cache is being invalidate because project e2be53ae8af64f0bb7626626634ab621 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:05:09.924413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a0ce1c7f-a576-4bc2-bf69-84876a446a74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.925070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a0ce1c7f-a576-4bc2-bf69-84876a446a74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:09.926626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1112/2238] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:05:09 2022] DELETE /identity/v3/projects/e2be53ae8af64f0bb7626626634ab621 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:05:09.933047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd8ea3-4ccd-46cd-8763-7954e0fb8dcc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:09.933364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd8ea3-4ccd-46cd-8763-7954e0fb8dcc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:09.933647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cd8ea3-4ccd-46cd-8763-7954e0fb8dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:09.953469 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-97cd8ea3-4ccd-46cd-8763-7954e0fb8dcc None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:09.954601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-97cd8ea3-4ccd-46cd-8763-7954e0fb8dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:09.971360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:09.992281 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1127/2239] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:05:10.002023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aeb784-6c2d-4e8a-9598-f9652a54bfd9 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:10.003382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-08aeb784-6c2d-4e8a-9598-f9652a54bfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:10.016747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1113/2240] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:05:10.024756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4febb31-a738-45bf-9131-d19253f8db27 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:10.025037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4febb31-a738-45bf-9131-d19253f8db27 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:10.025344 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4febb31-a738-45bf-9131-d19253f8db27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:10.044187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d4febb31-a738-45bf-9131-d19253f8db27 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:10.045504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d4febb31-a738-45bf-9131-d19253f8db27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:10.054020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1114/2241] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:05:10.058581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4febb31-a738-45bf-9131-d19253f8db27 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:10.063745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aeb784-6c2d-4e8a-9598-f9652a54bfd9 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:10.067400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58b641-2388-45e6-ad17-1a42ba60bec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:10.067558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4febb31-a738-45bf-9131-d19253f8db27 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:10.068015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58b641-2388-45e6-ad17-1a42ba60bec0 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:10.068289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58b641-2388-45e6-ad17-1a42ba60bec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:10.068557 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab58b641-2388-45e6-ad17-1a42ba60bec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:10.071950 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81124b-6cd7-409e-9a48-43f69dbe1a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:10.073083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81124b-6cd7-409e-9a48-43f69dbe1a18 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:10.073388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81124b-6cd7-409e-9a48-43f69dbe1a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:10.073663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f81124b-6cd7-409e-9a48-43f69dbe1a18 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:10.074339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81124b-6cd7-409e-9a48-43f69dbe1a18 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:05:10.074636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81124b-6cd7-409e-9a48-43f69dbe1a18 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:10.076240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f81124b-6cd7-409e-9a48-43f69dbe1a18 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:10.078330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58b641-2388-45e6-ad17-1a42ba60bec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:10.079749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab58b641-2388-45e6-ad17-1a42ba60bec0 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:10.089332 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1115/2242] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:05:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 12:05:10.089485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1128/2243] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:05:10.092502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81124b-6cd7-409e-9a48-43f69dbe1a18 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:10.102634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f81124b-6cd7-409e-9a48-43f69dbe1a18 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:10.107828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5162b-9d23-4290-a1cc-3b43eaf9f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:10.108433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5162b-9d23-4290-a1cc-3b43eaf9f17e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:10.108713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5162b-9d23-4290-a1cc-3b43eaf9f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:10.108984 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df5162b-9d23-4290-a1cc-3b43eaf9f17e admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:10.109688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5162b-9d23-4290-a1cc-3b43eaf9f17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:10.111593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df5162b-9d23-4290-a1cc-3b43eaf9f17e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:10.151486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1116/2244] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:05:10 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:10.155362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58b641-2388-45e6-ad17-1a42ba60bec0 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:10.165258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab58b641-2388-45e6-ad17-1a42ba60bec0 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:10.227762 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f3d25-b1e8-433a-b87c-bd743a935f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:10.229220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f3d25-b1e8-433a-b87c-bd743a935f86 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:10.229685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f3d25-b1e8-433a-b87c-bd743a935f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:10.230101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971f3d25-b1e8-433a-b87c-bd743a935f86 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:10.231285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f3d25-b1e8-433a-b87c-bd743a935f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:10.232961 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971f3d25-b1e8-433a-b87c-bd743a935f86 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:10.257252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1129/2245] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:05:10 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:10.261499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5162b-9d23-4290-a1cc-3b43eaf9f17e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:10.273351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df5162b-9d23-4290-a1cc-3b43eaf9f17e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:10.279668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b11e0c-fd21-48f1-87c6-7d9a1d48c91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:10.280340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b11e0c-fd21-48f1-87c6-7d9a1d48c91a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:10.280557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b11e0c-fd21-48f1-87c6-7d9a1d48c91a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:10.280828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b11e0c-fd21-48f1-87c6-7d9a1d48c91a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:10.281601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b11e0c-fd21-48f1-87c6-7d9a1d48c91a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:10.284562 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b11e0c-fd21-48f1-87c6-7d9a1d48c91a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:10.303147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f3d25-b1e8-433a-b87c-bd743a935f86 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:10.306527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1117/2246] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:10.320604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971f3d25-b1e8-433a-b87c-bd743a935f86 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:10.326372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b25ff3-a308-4135-9b9e-00219cfe271d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:10.326991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25ff3-a308-4135-9b9e-00219cfe271d admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:10.327266 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25ff3-a308-4135-9b9e-00219cfe271d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:10.327550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b25ff3-a308-4135-9b9e-00219cfe271d admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:10.328306 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b25ff3-a308-4135-9b9e-00219cfe271d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:10.329949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b25ff3-a308-4135-9b9e-00219cfe271d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:10.340552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1130/2247] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:10.344751 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b11e0c-fd21-48f1-87c6-7d9a1d48c91a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:10.356904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b11e0c-fd21-48f1-87c6-7d9a1d48c91a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:10.362874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97968eec-e7c8-44da-ba5b-f1e93912492a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:10.364288 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97968eec-e7c8-44da-ba5b-f1e93912492a admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:10.364288 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97968eec-e7c8-44da-ba5b-f1e93912492a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:10.364676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97968eec-e7c8-44da-ba5b-f1e93912492a admin admin] PATH_INFO: `/v3/projects/db25a40a48824f2aa24f5751384267de/users/40ca91e1a4794b1086437218cc1a2347/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:10.385377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97968eec-e7c8-44da-ba5b-f1e93912492a admin admin] RBAC: Authorizing `identity:create_grant(project_id=db25a40a48824f2aa24f5751384267de, user_id=40ca91e1a4794b1086437218cc1a2347, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:10.388406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97968eec-e7c8-44da-ba5b-f1e93912492a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:10.416768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1118/2248] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:05:10 2022] PUT /identity/v3/projects/db25a40a48824f2aa24f5751384267de/users/40ca91e1a4794b1086437218cc1a2347/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:10.418624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d66c56-4c6a-49c5-a2ba-bde492ff88f8 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:10.418975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d66c56-4c6a-49c5-a2ba-bde492ff88f8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:10.419343 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d66c56-4c6a-49c5-a2ba-bde492ff88f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:10.451364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:10.460165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-65d66c56-4c6a-49c5-a2ba-bde492ff88f8 None None] MFA Rules not processed for user `40ca91e1a4794b1086437218cc1a2347`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:10.462001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-65d66c56-4c6a-49c5-a2ba-bde492ff88f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:10.538711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1131/2249] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:10.551394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97968eec-e7c8-44da-ba5b-f1e93912492a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:10.553386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-97968eec-e7c8-44da-ba5b-f1e93912492a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:10.635516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97968eec-e7c8-44da-ba5b-f1e93912492a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:10.639455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06803ac1-4314-4eef-80fe-a182842ca35a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:10.640653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06803ac1-4314-4eef-80fe-a182842ca35a service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:10.640653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06803ac1-4314-4eef-80fe-a182842ca35a service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:10.640875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06803ac1-4314-4eef-80fe-a182842ca35a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:10.650926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06803ac1-4314-4eef-80fe-a182842ca35a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:10.652528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06803ac1-4314-4eef-80fe-a182842ca35a service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:10.664332 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1119/2250] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:10.702503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d66c56-4c6a-49c5-a2ba-bde492ff88f8 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:10.794803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d66c56-4c6a-49c5-a2ba-bde492ff88f8 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:10.806354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4266b4b7-724e-4079-9ccd-400a3b38702a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:10.808432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266b4b7-724e-4079-9ccd-400a3b38702a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:10.808989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266b4b7-724e-4079-9ccd-400a3b38702a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:10.809576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4266b4b7-724e-4079-9ccd-400a3b38702a admin admin] PATH_INFO: `/v3/users/40ca91e1a4794b1086437218cc1a2347` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:10.812260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266b4b7-724e-4079-9ccd-400a3b38702a admin admin] RBAC: Authorizing `identity:delete_user(user_id=40ca91e1a4794b1086437218cc1a2347)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:10.815347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4266b4b7-724e-4079-9ccd-400a3b38702a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:10.878417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a017e9-acd9-456b-80a8-9a2c7030340f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:10.878847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a017e9-acd9-456b-80a8-9a2c7030340f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:10.879215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a017e9-acd9-456b-80a8-9a2c7030340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:10.904205 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4266b4b7-724e-4079-9ccd-400a3b38702a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40ca91e1a4794b1086437218cc1a2347'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:10.916020 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4266b4b7-724e-4079-9ccd-400a3b38702a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40ca91e1a4794b1086437218cc1a2347'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:10.922076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-09a017e9-acd9-456b-80a8-9a2c7030340f None None] MFA Rules not processed for user `ab917ef751d8403aa41d25e5c5e6c465`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:10.923539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-09a017e9-acd9-456b-80a8-9a2c7030340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:10.950682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4266b4b7-724e-4079-9ccd-400a3b38702a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40ca91e1a4794b1086437218cc1a2347'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:10.951716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4266b4b7-724e-4079-9ccd-400a3b38702a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40ca91e1a4794b1086437218cc1a2347'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:10.968974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4266b4b7-724e-4079-9ccd-400a3b38702a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40ca91e1a4794b1086437218cc1a2347'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:11.001171 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1132/2251] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:05:10 2022] DELETE /identity/v3/users/40ca91e1a4794b1086437218cc1a2347 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:11.003816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b2d4f-7827-4340-b9e7-ed53db2edeef None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:11.004153 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b2d4f-7827-4340-b9e7-ed53db2edeef None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:11.004377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8b2d4f-7827-4340-b9e7-ed53db2edeef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:11.015047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:11.059473 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1120/2252] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:11.064851 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da20db-b238-4a07-9cca-2b244c8be50c None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:11.065343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da20db-b238-4a07-9cca-2b244c8be50c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:11.065603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9da20db-b238-4a07-9cca-2b244c8be50c None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:11.067513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1121/2253] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 12:05:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:05:11.068303 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3c8b2d4f-7827-4340-b9e7-ed53db2edeef None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:11.069539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3c8b2d4f-7827-4340-b9e7-ed53db2edeef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:11.073500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da20db-b238-4a07-9cca-2b244c8be50c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:11.077931 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b9da20db-b238-4a07-9cca-2b244c8be50c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:11.093144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:11.172620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9da20db-b238-4a07-9cca-2b244c8be50c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:11.176700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1133/2254] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:11.177136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd1205-29ec-4e8c-aee6-dd5e8ea39f19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:11.177689 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd1205-29ec-4e8c-aee6-dd5e8ea39f19 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:11.178108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd1205-29ec-4e8c-aee6-dd5e8ea39f19 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:11.178847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd1205-29ec-4e8c-aee6-dd5e8ea39f19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:11.178967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c795ce8-f1b3-49fe-90cf-e263f924b665 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:11.179079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c795ce8-f1b3-49fe-90cf-e263f924b665 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:11.179323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c795ce8-f1b3-49fe-90cf-e263f924b665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:11.210216 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2c795ce8-f1b3-49fe-90cf-e263f924b665 None None] MFA Rules not processed for user `35b5e545d75d40d0abb9c8d996e3b4a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:11.214916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2c795ce8-f1b3-49fe-90cf-e263f924b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:11.263187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd1205-29ec-4e8c-aee6-dd5e8ea39f19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:11.264803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd1205-29ec-4e8c-aee6-dd5e8ea39f19 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:11.278072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1122/2255] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:11 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:11.279051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd1205-29ec-4e8c-aee6-dd5e8ea39f19 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:11.281397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-94fd1205-29ec-4e8c-aee6-dd5e8ea39f19 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:11.373330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1134/2256] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 12:05:11 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:11.413583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd1205-29ec-4e8c-aee6-dd5e8ea39f19 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:11.418242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe4ce9-f72e-41b5-988d-8debbc25c21d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:11.418886 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe4ce9-f72e-41b5-988d-8debbc25c21d service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:11.419163 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe4ce9-f72e-41b5-988d-8debbc25c21d service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:11.419432 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe4ce9-f72e-41b5-988d-8debbc25c21d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:11.431070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe4ce9-f72e-41b5-988d-8debbc25c21d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:11.433467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe4ce9-f72e-41b5-988d-8debbc25c21d service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:11.457037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c795ce8-f1b3-49fe-90cf-e263f924b665 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:11.460346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2c795ce8-f1b3-49fe-90cf-e263f924b665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:11.463241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1123/2257] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:11.500790 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c795ce8-f1b3-49fe-90cf-e263f924b665 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:11.509759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e71698-7f37-40be-ad6d-43668079c08b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:11.511456 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e71698-7f37-40be-ad6d-43668079c08b service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:11.511985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e71698-7f37-40be-ad6d-43668079c08b service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:11.512424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e71698-7f37-40be-ad6d-43668079c08b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:11.527389 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e71698-7f37-40be-ad6d-43668079c08b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:11.530269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e71698-7f37-40be-ad6d-43668079c08b service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:11.554642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1135/2258] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:11 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:11.829355 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe4ce9-f72e-41b5-988d-8debbc25c21d service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:11.831129 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3efe4ce9-f72e-41b5-988d-8debbc25c21d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:11.871732 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe4ce9-f72e-41b5-988d-8debbc25c21d service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:11.884978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:11.885739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:11.886243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:11.886596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] PATH_INFO: `/v3/projects/db25a40a48824f2aa24f5751384267de` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:11.888380 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] RBAC: Authorizing `identity:delete_project(project_id=db25a40a48824f2aa24f5751384267de)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:11.892493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:11.954025 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:11.971547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db25a40a48824f2aa24f5751384267de', 'request_id': 'req-aa978a52-0d0f-4a4f-847d-6025db67772a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:11.979026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db25a40a48824f2aa24f5751384267de', 'request_id': 'req-aa978a52-0d0f-4a4f-847d-6025db67772a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:11.987322 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db25a40a48824f2aa24f5751384267de', 'request_id': 'req-aa978a52-0d0f-4a4f-847d-6025db67772a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.001946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] The token cache is being invalidate because project db25a40a48824f2aa24f5751384267de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:05:12.002309 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.003384 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.005069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1124/2259] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:05:11 2022] DELETE /identity/v3/projects/db25a40a48824f2aa24f5751384267de => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:12.010199 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352be06-54c3-4ef8-93be-83803eff678b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.010488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352be06-54c3-4ef8-93be-83803eff678b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.010932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352be06-54c3-4ef8-93be-83803eff678b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.030581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6352be06-54c3-4ef8-93be-83803eff678b None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:12.031856 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6352be06-54c3-4ef8-93be-83803eff678b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:12.076709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:12.078176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:12.105846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1136/2260] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:12.112964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffb71b-ed66-4677-8f6f-a723983fb9a2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.113248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffb71b-ed66-4677-8f6f-a723983fb9a2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.113549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffb71b-ed66-4677-8f6f-a723983fb9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.132998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2cffb71b-ed66-4677-8f6f-a723983fb9a2 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:12.134382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2cffb71b-ed66-4677-8f6f-a723983fb9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:12.142864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1137/2261] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:05:12.144077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa978a52-0d0f-4a4f-847d-6025db67772a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:12.146967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffb71b-ed66-4677-8f6f-a723983fb9a2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:12.149082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:12.149806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.150089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.150882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] PATH_INFO: `/v3/users/ee47a1b9e04a4da89084437f432b9fd1` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.152163 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee47a1b9e04a4da89084437f432b9fd1)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:12.154200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:12.156483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffb71b-ed66-4677-8f6f-a723983fb9a2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:12.161103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca72553-30ce-4f64-8069-e87454a550d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:12.161731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72553-30ce-4f64-8069-e87454a550d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.162014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72553-30ce-4f64-8069-e87454a550d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.162287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca72553-30ce-4f64-8069-e87454a550d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.163002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca72553-30ce-4f64-8069-e87454a550d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:05:12.163304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca72553-30ce-4f64-8069-e87454a550d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:12.164898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca72553-30ce-4f64-8069-e87454a550d2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:12.177263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1138/2262] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 12:05:12.181904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca72553-30ce-4f64-8069-e87454a550d2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:12.192934 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca72553-30ce-4f64-8069-e87454a550d2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:12.198066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a807-b830-4c45-9ee1-925e3d87ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:12.198660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a807-b830-4c45-9ee1-925e3d87ee82 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.198943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a807-b830-4c45-9ee1-925e3d87ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.199215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a807-b830-4c45-9ee1-925e3d87ee82 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.199870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04a807-b830-4c45-9ee1-925e3d87ee82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:12.201103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee47a1b9e04a4da89084437f432b9fd1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.201789 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04a807-b830-4c45-9ee1-925e3d87ee82 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:12.201894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee47a1b9e04a4da89084437f432b9fd1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.214195 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee47a1b9e04a4da89084437f432b9fd1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.221054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee47a1b9e04a4da89084437f432b9fd1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.229171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee47a1b9e04a4da89084437f432b9fd1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.230181 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1139/2263] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:05:12 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:05:12.234135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a807-b830-4c45-9ee1-925e3d87ee82 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:12.235689 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2c04a807-b830-4c45-9ee1-925e3d87ee82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:12.238586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1125/2264] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:05:12 2022] DELETE /identity/v3/users/ee47a1b9e04a4da89084437f432b9fd1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:05:12.240598 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:12.304164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a807-b830-4c45-9ee1-925e3d87ee82 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:12.360491 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc30979-0d63-4d25-a2aa-70fbb3dd2e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:12.361109 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc30979-0d63-4d25-a2aa-70fbb3dd2e8e admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.361416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc30979-0d63-4d25-a2aa-70fbb3dd2e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.361684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc30979-0d63-4d25-a2aa-70fbb3dd2e8e admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.362479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc30979-0d63-4d25-a2aa-70fbb3dd2e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:12.364654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc30979-0d63-4d25-a2aa-70fbb3dd2e8e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:12.386446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1140/2265] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:05:12 2022] POST /identity/v3/users => generated 287 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:05:12.391838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:12.402734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b8d6f-c6d4-4a0f-b6f9-7c31ec16ddc4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:12.407581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e36ac-0cc2-46f6-b7ee-a5fdb2e9341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:12.408187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e36ac-0cc2-46f6-b7ee-a5fdb2e9341c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.408459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e36ac-0cc2-46f6-b7ee-a5fdb2e9341c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.408725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e36ac-0cc2-46f6-b7ee-a5fdb2e9341c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.409495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e36ac-0cc2-46f6-b7ee-a5fdb2e9341c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:12.411032 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e36ac-0cc2-46f6-b7ee-a5fdb2e9341c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:12.417713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc30979-0d63-4d25-a2aa-70fbb3dd2e8e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:12.419753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1dc30979-0d63-4d25-a2aa-70fbb3dd2e8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:12.425081 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1126/2266] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:12.426186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e36ac-0cc2-46f6-b7ee-a5fdb2e9341c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:12.433481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc30979-0d63-4d25-a2aa-70fbb3dd2e8e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:12.436230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e36ac-0cc2-46f6-b7ee-a5fdb2e9341c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:12.438743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:12.439553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.439911 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.440474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] PATH_INFO: `/v3/projects/fa70e0f6890b48559c6da747f7ad92b8` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.440894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ce480-4f67-43da-a92a-c8b39470cb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:12.441517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ce480-4f67-43da-a92a-c8b39470cb98 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.441795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ce480-4f67-43da-a92a-c8b39470cb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.441901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa70e0f6890b48559c6da747f7ad92b8)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:12.442063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30ce480-4f67-43da-a92a-c8b39470cb98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.442866 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ce480-4f67-43da-a92a-c8b39470cb98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:12.444342 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:12.444763 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30ce480-4f67-43da-a92a-c8b39470cb98 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:12.455841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1127/2267] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:05:12.459881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ce480-4f67-43da-a92a-c8b39470cb98 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:12.470083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30ce480-4f67-43da-a92a-c8b39470cb98 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:12.475147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d1601-64dc-407a-9588-326ae4a72463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:12.475877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1601-64dc-407a-9588-326ae4a72463 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.476098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1601-64dc-407a-9588-326ae4a72463 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.476417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d1601-64dc-407a-9588-326ae4a72463 admin admin] PATH_INFO: `/v3/projects/d4e7dbba42d54f519d650c4820fd7b1e/users/9290a94672494641a8c03b3293fa16b3/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.488776 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:12.492208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d1601-64dc-407a-9588-326ae4a72463 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4e7dbba42d54f519d650c4820fd7b1e, user_id=9290a94672494641a8c03b3293fa16b3, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:12.497917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa70e0f6890b48559c6da747f7ad92b8', 'request_id': 'req-2a3c175a-45f7-45f1-8e11-3961ac9ba231'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.504010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa70e0f6890b48559c6da747f7ad92b8', 'request_id': 'req-2a3c175a-45f7-45f1-8e11-3961ac9ba231'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.505404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d1601-64dc-407a-9588-326ae4a72463 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:12.513401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa70e0f6890b48559c6da747f7ad92b8', 'request_id': 'req-2a3c175a-45f7-45f1-8e11-3961ac9ba231'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.523154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1128/2268] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:05:12 2022] PUT /identity/v3/projects/d4e7dbba42d54f519d650c4820fd7b1e/users/9290a94672494641a8c03b3293fa16b3/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:12.527853 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] The token cache is being invalidate because project fa70e0f6890b48559c6da747f7ad92b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:05:12.528307 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.529126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.531474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1141/2269] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:05:12 2022] DELETE /identity/v3/projects/fa70e0f6890b48559c6da747f7ad92b8 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:12.534981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33795d18-c4c6-4fa9-9c83-48f4621880a7 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.535258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33795d18-c4c6-4fa9-9c83-48f4621880a7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.535540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33795d18-c4c6-4fa9-9c83-48f4621880a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.536756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:12.538851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:12.567051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-33795d18-c4c6-4fa9-9c83-48f4621880a7 None None] MFA Rules not processed for user `9290a94672494641a8c03b3293fa16b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:12.567619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:12.568462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-33795d18-c4c6-4fa9-9c83-48f4621880a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:12.616436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c175a-45f7-45f1-8e11-3961ac9ba231 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:12.648138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1129/2270] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:12 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:12.660277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33795d18-c4c6-4fa9-9c83-48f4621880a7 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:12.661861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-33795d18-c4c6-4fa9-9c83-48f4621880a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:12.694300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec7c05d-456a-4de2-bd44-41ebd7767f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:12.695214 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7c05d-456a-4de2-bd44-41ebd7767f24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.695488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7c05d-456a-4de2-bd44-41ebd7767f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.695755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7c05d-456a-4de2-bd44-41ebd7767f24 admin admin] PATH_INFO: `/v3/users/36991fe37fae4e64bfe9aee07f425532` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.697005 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7c05d-456a-4de2-bd44-41ebd7767f24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36991fe37fae4e64bfe9aee07f425532)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:12.699703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec7c05d-456a-4de2-bd44-41ebd7767f24 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:12.720909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33795d18-c4c6-4fa9-9c83-48f4621880a7 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:12.725287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d55f4d-38d6-4eaa-aa13-fc570fdae0cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:12.726047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55f4d-38d6-4eaa-aa13-fc570fdae0cd service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.726398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55f4d-38d6-4eaa-aa13-fc570fdae0cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.726624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d55f4d-38d6-4eaa-aa13-fc570fdae0cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:12.737242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d55f4d-38d6-4eaa-aa13-fc570fdae0cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:12.738720 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d55f4d-38d6-4eaa-aa13-fc570fdae0cd service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:12.747876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1130/2271] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:05:12.751580 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3ec7c05d-456a-4de2-bd44-41ebd7767f24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36991fe37fae4e64bfe9aee07f425532'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.759235 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3ec7c05d-456a-4de2-bd44-41ebd7767f24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36991fe37fae4e64bfe9aee07f425532'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.772478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3ec7c05d-456a-4de2-bd44-41ebd7767f24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36991fe37fae4e64bfe9aee07f425532'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.773198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3ec7c05d-456a-4de2-bd44-41ebd7767f24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36991fe37fae4e64bfe9aee07f425532'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.781456 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3ec7c05d-456a-4de2-bd44-41ebd7767f24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36991fe37fae4e64bfe9aee07f425532'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:12.787626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1142/2272] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:05:12 2022] DELETE /identity/v3/users/36991fe37fae4e64bfe9aee07f425532 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:12.970915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d55f4d-38d6-4eaa-aa13-fc570fdae0cd service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:12.982726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d55f4d-38d6-4eaa-aa13-fc570fdae0cd service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:12.999527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c5980-c9b6-4cf7-8f07-baca31a69f83 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:12.999527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c5980-c9b6-4cf7-8f07-baca31a69f83 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:12.999930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c5980-c9b6-4cf7-8f07-baca31a69f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:13.034569 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-574c5980-c9b6-4cf7-8f07-baca31a69f83 None None] MFA Rules not processed for user `ab917ef751d8403aa41d25e5c5e6c465`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:13.036582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-574c5980-c9b6-4cf7-8f07-baca31a69f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:13.090311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9cb013-4dce-418c-9c0a-de9450f519bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:13.091017 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cb013-4dce-418c-9c0a-de9450f519bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:13.091420 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cb013-4dce-418c-9c0a-de9450f519bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:13.091576 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9cb013-4dce-418c-9c0a-de9450f519bb admin admin] PATH_INFO: `/v3/projects/4e035bbe5b384a0ab1c0c42657ae4915` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:13.093073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cb013-4dce-418c-9c0a-de9450f519bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e035bbe5b384a0ab1c0c42657ae4915)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:13.094828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9cb013-4dce-418c-9c0a-de9450f519bb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:13.110355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:13.126387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1143/2273] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:13.127647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:13.149822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ae9cb013-4dce-418c-9c0a-de9450f519bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e035bbe5b384a0ab1c0c42657ae4915', 'request_id': 'req-ae9cb013-4dce-418c-9c0a-de9450f519bb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:13.158068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ae9cb013-4dce-418c-9c0a-de9450f519bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e035bbe5b384a0ab1c0c42657ae4915', 'request_id': 'req-ae9cb013-4dce-418c-9c0a-de9450f519bb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:13.165797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ae9cb013-4dce-418c-9c0a-de9450f519bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e035bbe5b384a0ab1c0c42657ae4915', 'request_id': 'req-ae9cb013-4dce-418c-9c0a-de9450f519bb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:13.178045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ae9cb013-4dce-418c-9c0a-de9450f519bb admin admin] The token cache is being invalidate because project 4e035bbe5b384a0ab1c0c42657ae4915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:05:13.178415 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ae9cb013-4dce-418c-9c0a-de9450f519bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:13.179048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ae9cb013-4dce-418c-9c0a-de9450f519bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:13.181218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1131/2274] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:05:12 2022] DELETE /identity/v3/projects/4e035bbe5b384a0ab1c0c42657ae4915 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:13.187734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff5208-eda2-464e-aeb8-cdbd56a2df6e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:13.188162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff5208-eda2-464e-aeb8-cdbd56a2df6e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:13.188348 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bff5208-eda2-464e-aeb8-cdbd56a2df6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:13.207584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7bff5208-eda2-464e-aeb8-cdbd56a2df6e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:13.208787 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7bff5208-eda2-464e-aeb8-cdbd56a2df6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:13.267863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1144/2275] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:13.275341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce1f3e-a86f-421e-98ff-f6c01f536f33 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:13.275626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce1f3e-a86f-421e-98ff-f6c01f536f33 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:13.275895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcce1f3e-a86f-421e-98ff-f6c01f536f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:13.298432 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bcce1f3e-a86f-421e-98ff-f6c01f536f33 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:13.299606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bcce1f3e-a86f-421e-98ff-f6c01f536f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:13.308115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1132/2276] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:13.312460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff5208-eda2-464e-aeb8-cdbd56a2df6e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:13.322998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bff5208-eda2-464e-aeb8-cdbd56a2df6e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:13.327658 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becff447-0c99-413f-8872-c08c0cc1077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:13.328270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becff447-0c99-413f-8872-c08c0cc1077b admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:13.328550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becff447-0c99-413f-8872-c08c0cc1077b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:13.328822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becff447-0c99-413f-8872-c08c0cc1077b admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:13.329548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becff447-0c99-413f-8872-c08c0cc1077b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:05:13.329854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becff447-0c99-413f-8872-c08c0cc1077b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:13.331462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becff447-0c99-413f-8872-c08c0cc1077b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:13.346618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1145/2277] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:05:13.347691 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce1f3e-a86f-421e-98ff-f6c01f536f33 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:13.357600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcce1f3e-a86f-421e-98ff-f6c01f536f33 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:13.362251 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bf45f-146e-4063-846f-cbbd8527c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:13.362882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bf45f-146e-4063-846f-cbbd8527c307 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:13.363155 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bf45f-146e-4063-846f-cbbd8527c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:13.363422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89bf45f-146e-4063-846f-cbbd8527c307 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:13.364368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bf45f-146e-4063-846f-cbbd8527c307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:13.366549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89bf45f-146e-4063-846f-cbbd8527c307 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:13.394780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1133/2278] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:05:13 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:13.399145 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becff447-0c99-413f-8872-c08c0cc1077b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:13.409314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becff447-0c99-413f-8872-c08c0cc1077b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:13.466981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd1316-542d-4e19-a4d8-efb6e90318ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:13.467596 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd1316-542d-4e19-a4d8-efb6e90318ea admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:13.467876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd1316-542d-4e19-a4d8-efb6e90318ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:13.468149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd1316-542d-4e19-a4d8-efb6e90318ea admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:13.468820 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd1316-542d-4e19-a4d8-efb6e90318ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:13.470765 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd1316-542d-4e19-a4d8-efb6e90318ea admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:13.493447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1146/2279] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:05:13 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:13.497905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bf45f-146e-4063-846f-cbbd8527c307 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:13.508227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89bf45f-146e-4063-846f-cbbd8527c307 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:13.513602 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f968d-3b10-42b9-b6fb-6a3024732b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:13.514236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f968d-3b10-42b9-b6fb-6a3024732b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:13.514518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f968d-3b10-42b9-b6fb-6a3024732b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:13.514786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713f968d-3b10-42b9-b6fb-6a3024732b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:13.515527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f968d-3b10-42b9-b6fb-6a3024732b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:13.517179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713f968d-3b10-42b9-b6fb-6a3024732b1b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:13.528130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1134/2280] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:13.532045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd1316-542d-4e19-a4d8-efb6e90318ea admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:13.542091 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd1316-542d-4e19-a4d8-efb6e90318ea admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:13.546755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eff93c-7823-44f6-b64d-c3c7d92db565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:13.547399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eff93c-7823-44f6-b64d-c3c7d92db565 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:13.547671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eff93c-7823-44f6-b64d-c3c7d92db565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:13.548007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eff93c-7823-44f6-b64d-c3c7d92db565 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:13.548865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eff93c-7823-44f6-b64d-c3c7d92db565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:13.550457 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eff93c-7823-44f6-b64d-c3c7d92db565 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:13.563008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1147/2281] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:13.568507 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f968d-3b10-42b9-b6fb-6a3024732b1b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:13.579219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713f968d-3b10-42b9-b6fb-6a3024732b1b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:13.583875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fd3a8-86b5-40d9-9adf-c911ceed57e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:13.584524 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fd3a8-86b5-40d9-9adf-c911ceed57e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:13.584817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fd3a8-86b5-40d9-9adf-c911ceed57e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:13.585113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8fd3a8-86b5-40d9-9adf-c911ceed57e7 admin admin] PATH_INFO: `/v3/projects/8739f3aaf534492c8803413940a7749e/users/21b556ca7b3b4dacbb113027e50787cd/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:13.600725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fd3a8-86b5-40d9-9adf-c911ceed57e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8739f3aaf534492c8803413940a7749e, user_id=21b556ca7b3b4dacbb113027e50787cd, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:13.603522 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8fd3a8-86b5-40d9-9adf-c911ceed57e7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:13.618924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1135/2282] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:05:13 2022] PUT /identity/v3/projects/8739f3aaf534492c8803413940a7749e/users/21b556ca7b3b4dacbb113027e50787cd/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:05:13.629669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9606758-ce8d-4f8d-8ae3-23f6c0524dd1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:13.630047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9606758-ce8d-4f8d-8ae3-23f6c0524dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:13.630334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9606758-ce8d-4f8d-8ae3-23f6c0524dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:13.661995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b9606758-ce8d-4f8d-8ae3-23f6c0524dd1 None None] MFA Rules not processed for user `21b556ca7b3b4dacbb113027e50787cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:13.663270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b9606758-ce8d-4f8d-8ae3-23f6c0524dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:13.746015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:13.775920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1148/2283] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:13.790791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fd3a8-86b5-40d9-9adf-c911ceed57e7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:13.792767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bb8fd3a8-86b5-40d9-9adf-c911ceed57e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:13.896653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8fd3a8-86b5-40d9-9adf-c911ceed57e7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:13.901036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d23b6b-3b49-45c1-9328-6fce1b3b24b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c358a2d9539c4ae2a5e12aa6f1ed6d61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:13.901783 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d23b6b-3b49-45c1-9328-6fce1b3b24b2 service glance] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:13.902136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d23b6b-3b49-45c1-9328-6fce1b3b24b2 service glance] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:13.902413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d23b6b-3b49-45c1-9328-6fce1b3b24b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:13.910946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d23b6b-3b49-45c1-9328-6fce1b3b24b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:13.912386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d23b6b-3b49-45c1-9328-6fce1b3b24b2 service glance] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:13.923226 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1136/2284] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:13 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:15.871848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9606758-ce8d-4f8d-8ae3-23f6c0524dd1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:15.873361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b9606758-ce8d-4f8d-8ae3-23f6c0524dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:15.944284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9606758-ce8d-4f8d-8ae3-23f6c0524dd1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:15.948877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:15.949540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:15.949816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:15.950080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] PATH_INFO: `/v3/users/9290a94672494641a8c03b3293fa16b3` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:15.951232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9290a94672494641a8c03b3293fa16b3)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:15.953150 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:16.004872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9290a94672494641a8c03b3293fa16b3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:16.013026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9290a94672494641a8c03b3293fa16b3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:16.027184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9290a94672494641a8c03b3293fa16b3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:16.027903 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9290a94672494641a8c03b3293fa16b3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:16.037275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9290a94672494641a8c03b3293fa16b3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:16.048866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1149/2285] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:05:15 2022] DELETE /identity/v3/users/9290a94672494641a8c03b3293fa16b3 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:16.051855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023393a-91ea-4fae-abdf-f1626d14d722 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:16.053102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023393a-91ea-4fae-abdf-f1626d14d722 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:16.053766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023393a-91ea-4fae-abdf-f1626d14d722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:16.076540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7023393a-91ea-4fae-abdf-f1626d14d722 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:16.077991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7023393a-91ea-4fae-abdf-f1626d14d722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:16.123119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:16.161962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1137/2286] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:16.201415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:16.202789 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:16.293521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade28ac-17e4-4639-899f-475f1bb0fa53 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:16.298381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ecab31-6b6d-4b40-a91b-bc21a971d2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:16.298514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecab31-6b6d-4b40-a91b-bc21a971d2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:16.298754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecab31-6b6d-4b40-a91b-bc21a971d2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:16.299116 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ecab31-6b6d-4b40-a91b-bc21a971d2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:16.312018 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecab31-6b6d-4b40-a91b-bc21a971d2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:16.313599 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ecab31-6b6d-4b40-a91b-bc21a971d2b3 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:16.330129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1150/2287] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:16.633410 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023393a-91ea-4fae-abdf-f1626d14d722 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:16.636315 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7023393a-91ea-4fae-abdf-f1626d14d722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:16.649452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023393a-91ea-4fae-abdf-f1626d14d722 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:16.654220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c04df2-7b19-4163-ab3b-63d932f525c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:16.654858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c04df2-7b19-4163-ab3b-63d932f525c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:16.655130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c04df2-7b19-4163-ab3b-63d932f525c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:16.655396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c04df2-7b19-4163-ab3b-63d932f525c9 admin admin] PATH_INFO: `/v3/projects/d4e7dbba42d54f519d650c4820fd7b1e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:16.657759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c04df2-7b19-4163-ab3b-63d932f525c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4e7dbba42d54f519d650c4820fd7b1e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:16.660003 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c04df2-7b19-4163-ab3b-63d932f525c9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:16.714722 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-03c04df2-7b19-4163-ab3b-63d932f525c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4e7dbba42d54f519d650c4820fd7b1e', 'request_id': 'req-03c04df2-7b19-4163-ab3b-63d932f525c9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:16.720539 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-03c04df2-7b19-4163-ab3b-63d932f525c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4e7dbba42d54f519d650c4820fd7b1e', 'request_id': 'req-03c04df2-7b19-4163-ab3b-63d932f525c9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:16.729120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-03c04df2-7b19-4163-ab3b-63d932f525c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4e7dbba42d54f519d650c4820fd7b1e', 'request_id': 'req-03c04df2-7b19-4163-ab3b-63d932f525c9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:16.741640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-03c04df2-7b19-4163-ab3b-63d932f525c9 admin admin] The token cache is being invalidate because project d4e7dbba42d54f519d650c4820fd7b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:05:16.742115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-03c04df2-7b19-4163-ab3b-63d932f525c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:16.742791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-03c04df2-7b19-4163-ab3b-63d932f525c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:16.745155 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1138/2288] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:05:16 2022] DELETE /identity/v3/projects/d4e7dbba42d54f519d650c4820fd7b1e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:16.751169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a51c-d3a5-4763-aa5b-d91467ecdb19 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:16.751573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a51c-d3a5-4763-aa5b-d91467ecdb19 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:16.752014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a51c-d3a5-4763-aa5b-d91467ecdb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:16.772555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8d19a51c-d3a5-4763-aa5b-d91467ecdb19 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:16.773896 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8d19a51c-d3a5-4763-aa5b-d91467ecdb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:16.779973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:16.842413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1151/2289] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:16.850809 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38b9b7-a4c5-46ce-ac27-cac3fc3e2c63 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:16.851100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38b9b7-a4c5-46ce-ac27-cac3fc3e2c63 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:16.851377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b38b9b7-a4c5-46ce-ac27-cac3fc3e2c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:16.871826 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7b38b9b7-a4c5-46ce-ac27-cac3fc3e2c63 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:16.873039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7b38b9b7-a4c5-46ce-ac27-cac3fc3e2c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:16.881323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1139/2290] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:05:16.886119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19a51c-d3a5-4763-aa5b-d91467ecdb19 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:16.896039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19a51c-d3a5-4763-aa5b-d91467ecdb19 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:16.900609 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468baf4f-690a-40c6-92e9-e23764a99860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:16.901219 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468baf4f-690a-40c6-92e9-e23764a99860 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:16.901543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468baf4f-690a-40c6-92e9-e23764a99860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:16.901813 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468baf4f-690a-40c6-92e9-e23764a99860 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:16.902499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468baf4f-690a-40c6-92e9-e23764a99860 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:05:16.902795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468baf4f-690a-40c6-92e9-e23764a99860 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:16.904638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468baf4f-690a-40c6-92e9-e23764a99860 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:16.918083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1152/2291] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:05:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:05:16.922538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38b9b7-a4c5-46ce-ac27-cac3fc3e2c63 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:16.932625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b38b9b7-a4c5-46ce-ac27-cac3fc3e2c63 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:16.937494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f5d3-f693-425a-a601-d8ab522f9753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:16.938250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f5d3-f693-425a-a601-d8ab522f9753 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:16.938527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f5d3-f693-425a-a601-d8ab522f9753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:16.938796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f5d3-f693-425a-a601-d8ab522f9753 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:16.939479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8f5d3-f693-425a-a601-d8ab522f9753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:16.941413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8f5d3-f693-425a-a601-d8ab522f9753 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:16.969429 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1140/2292] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:05:16 2022] POST /identity/v3/projects => generated 377 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:16.973746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468baf4f-690a-40c6-92e9-e23764a99860 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:16.984461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468baf4f-690a-40c6-92e9-e23764a99860 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:17.040644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e50cef-ca9f-4302-a868-7d277dedde07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:17.042163 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e50cef-ca9f-4302-a868-7d277dedde07 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.042438 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e50cef-ca9f-4302-a868-7d277dedde07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.042792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e50cef-ca9f-4302-a868-7d277dedde07 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.043785 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e50cef-ca9f-4302-a868-7d277dedde07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:17.046489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e50cef-ca9f-4302-a868-7d277dedde07 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:17.069019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1153/2293] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:05:16 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:17.071525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f5d3-f693-425a-a601-d8ab522f9753 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:17.082094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f5d3-f693-425a-a601-d8ab522f9753 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:17.086697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d6c5-8407-4256-ae3b-c95720a2eb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:17.087306 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d6c5-8407-4256-ae3b-c95720a2eb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.087581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d6c5-8407-4256-ae3b-c95720a2eb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.087893 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d6c5-8407-4256-ae3b-c95720a2eb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.088583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71d6c5-8407-4256-ae3b-c95720a2eb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:17.090402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71d6c5-8407-4256-ae3b-c95720a2eb79 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:17.101249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1141/2294] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:17.106243 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e50cef-ca9f-4302-a868-7d277dedde07 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:17.117811 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e50cef-ca9f-4302-a868-7d277dedde07 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:17.123245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810f7c8-c2e5-45cd-91e1-28c4660c4938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:17.123858 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810f7c8-c2e5-45cd-91e1-28c4660c4938 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.124131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810f7c8-c2e5-45cd-91e1-28c4660c4938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.124397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810f7c8-c2e5-45cd-91e1-28c4660c4938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.125098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810f7c8-c2e5-45cd-91e1-28c4660c4938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:17.126708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0810f7c8-c2e5-45cd-91e1-28c4660c4938 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:17.137720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1154/2295] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:05:17.142479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d6c5-8407-4256-ae3b-c95720a2eb79 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:17.153370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d6c5-8407-4256-ae3b-c95720a2eb79 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:17.158028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b401ac-4de1-41c0-a8eb-2687d810c92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:17.158688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b401ac-4de1-41c0-a8eb-2687d810c92e admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.158971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b401ac-4de1-41c0-a8eb-2687d810c92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.159247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b401ac-4de1-41c0-a8eb-2687d810c92e admin admin] PATH_INFO: `/v3/projects/974412ee904d47f7b81d76c4c23af5aa/users/f26c4223aeb741fb9f70764e1b9ff496/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.176019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b401ac-4de1-41c0-a8eb-2687d810c92e admin admin] RBAC: Authorizing `identity:create_grant(project_id=974412ee904d47f7b81d76c4c23af5aa, user_id=f26c4223aeb741fb9f70764e1b9ff496, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:17.178853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b401ac-4de1-41c0-a8eb-2687d810c92e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:17.192998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1142/2296] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:05:17 2022] PUT /identity/v3/projects/974412ee904d47f7b81d76c4c23af5aa/users/f26c4223aeb741fb9f70764e1b9ff496/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:05:17.203441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9766-ccad-410a-8401-5a48f06b1c6a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.203723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9766-ccad-410a-8401-5a48f06b1c6a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.204020 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae9766-ccad-410a-8401-5a48f06b1c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.232414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9cae9766-ccad-410a-8401-5a48f06b1c6a None None] MFA Rules not processed for user `f26c4223aeb741fb9f70764e1b9ff496`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:17.233600 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9cae9766-ccad-410a-8401-5a48f06b1c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:17.296369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1155/2297] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:17.301112 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b401ac-4de1-41c0-a8eb-2687d810c92e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:17.361448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:17.376215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b401ac-4de1-41c0-a8eb-2687d810c92e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:17.381710 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4a31f-5513-4de6-85c6-e5455e8eb05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:17.383048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4a31f-5513-4de6-85c6-e5455e8eb05b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.383048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4a31f-5513-4de6-85c6-e5455e8eb05b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.383048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4a31f-5513-4de6-85c6-e5455e8eb05b admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.383528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4a31f-5513-4de6-85c6-e5455e8eb05b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:17.386050 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4a31f-5513-4de6-85c6-e5455e8eb05b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:17.423103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1143/2298] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:05:17 2022] POST /identity/v3/projects => generated 377 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:17.427672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9766-ccad-410a-8401-5a48f06b1c6a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:17.438822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae9766-ccad-410a-8401-5a48f06b1c6a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:17.444425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:17.516841 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e3af2-e3ed-4854-860b-892640303901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:17.517503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e3af2-e3ed-4854-860b-892640303901 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.517787 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e3af2-e3ed-4854-860b-892640303901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.518062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4e3af2-e3ed-4854-860b-892640303901 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.518731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e3af2-e3ed-4854-860b-892640303901 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:17.520664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4e3af2-e3ed-4854-860b-892640303901 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:17.543589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1156/2299] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:05:17 2022] POST /identity/v3/users => generated 289 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:05:17.547735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4a31f-5513-4de6-85c6-e5455e8eb05b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:17.558556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4a31f-5513-4de6-85c6-e5455e8eb05b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:17.563322 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2366b49-4e88-4e2e-a4b7-447697ef9c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:17.563928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2366b49-4e88-4e2e-a4b7-447697ef9c9c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.564203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2366b49-4e88-4e2e-a4b7-447697ef9c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.564468 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2366b49-4e88-4e2e-a4b7-447697ef9c9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.565161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2366b49-4e88-4e2e-a4b7-447697ef9c9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:17.566860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2366b49-4e88-4e2e-a4b7-447697ef9c9c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:17.578051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1144/2300] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:17.583084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e3af2-e3ed-4854-860b-892640303901 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:17.594775 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4e3af2-e3ed-4854-860b-892640303901 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:17.599919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02704d84-547f-4926-b7dc-71c18af0dfb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:17.600534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02704d84-547f-4926-b7dc-71c18af0dfb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.600816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02704d84-547f-4926-b7dc-71c18af0dfb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.601120 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02704d84-547f-4926-b7dc-71c18af0dfb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.601855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02704d84-547f-4926-b7dc-71c18af0dfb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:17.604053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02704d84-547f-4926-b7dc-71c18af0dfb2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:17.615225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1157/2301] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:17.619429 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2366b49-4e88-4e2e-a4b7-447697ef9c9c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:17.629400 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2366b49-4e88-4e2e-a4b7-447697ef9c9c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:17.633967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9a1b8-5b26-4afa-bc8a-8e9a9992ad86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:17.634642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9a1b8-5b26-4afa-bc8a-8e9a9992ad86 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.634910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9a1b8-5b26-4afa-bc8a-8e9a9992ad86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.635176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb9a1b8-5b26-4afa-bc8a-8e9a9992ad86 admin admin] PATH_INFO: `/v3/projects/4640784990304555ac6119440e9f72a7/users/3d4e98b7855e46e883dfd166640f5569/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.650656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9a1b8-5b26-4afa-bc8a-8e9a9992ad86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4640784990304555ac6119440e9f72a7, user_id=3d4e98b7855e46e883dfd166640f5569, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:17.653340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb9a1b8-5b26-4afa-bc8a-8e9a9992ad86 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:17.667209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1145/2302] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:05:17 2022] PUT /identity/v3/projects/4640784990304555ac6119440e9f72a7/users/3d4e98b7855e46e883dfd166640f5569/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:17.678469 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfdd29-a805-4bee-9ea5-32f8af90cd56 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.678760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfdd29-a805-4bee-9ea5-32f8af90cd56 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.679039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecfdd29-a805-4bee-9ea5-32f8af90cd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.708115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6ecfdd29-a805-4bee-9ea5-32f8af90cd56 None None] MFA Rules not processed for user `3d4e98b7855e46e883dfd166640f5569`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:17.709361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6ecfdd29-a805-4bee-9ea5-32f8af90cd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:17.774247 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1158/2303] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:17.778788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9a1b8-5b26-4afa-bc8a-8e9a9992ad86 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:17.842051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb9a1b8-5b26-4afa-bc8a-8e9a9992ad86 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:17.846637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be354f-b828-46ea-a0e0-5e21b6e410be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:17.847248 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be354f-b828-46ea-a0e0-5e21b6e410be admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.847528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be354f-b828-46ea-a0e0-5e21b6e410be admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.847803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be354f-b828-46ea-a0e0-5e21b6e410be admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.848463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be354f-b828-46ea-a0e0-5e21b6e410be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:17.850429 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be354f-b828-46ea-a0e0-5e21b6e410be admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:17.878365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1146/2304] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:05:17 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:17.882997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfdd29-a805-4bee-9ea5-32f8af90cd56 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:17.893959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecfdd29-a805-4bee-9ea5-32f8af90cd56 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:17.954397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049ec9-9aa5-4324-a5ef-d4512c1f4b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:17.955007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049ec9-9aa5-4324-a5ef-d4512c1f4b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:17.955420 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049ec9-9aa5-4324-a5ef-d4512c1f4b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:17.955683 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10049ec9-9aa5-4324-a5ef-d4512c1f4b5a admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:17.956550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10049ec9-9aa5-4324-a5ef-d4512c1f4b5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:17.958661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10049ec9-9aa5-4324-a5ef-d4512c1f4b5a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:17.980774 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1159/2305] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:05:17 2022] POST /identity/v3/users => generated 295 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:17.985212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be354f-b828-46ea-a0e0-5e21b6e410be admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:17.996902 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be354f-b828-46ea-a0e0-5e21b6e410be admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:18.001706 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d4489-dcd1-40b7-a62e-5311e6c8db60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:18.002312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d4489-dcd1-40b7-a62e-5311e6c8db60 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:18.002622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d4489-dcd1-40b7-a62e-5311e6c8db60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:18.002897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d4489-dcd1-40b7-a62e-5311e6c8db60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:18.003593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d4489-dcd1-40b7-a62e-5311e6c8db60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:18.005205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d4489-dcd1-40b7-a62e-5311e6c8db60 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:18.016040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1147/2306] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:18.020384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049ec9-9aa5-4324-a5ef-d4512c1f4b5a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:18.026819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:18.031210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10049ec9-9aa5-4324-a5ef-d4512c1f4b5a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:18.037390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be327b42-c933-42ac-aa25-28e3a111ee76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:18.038087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be327b42-c933-42ac-aa25-28e3a111ee76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:18.038367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be327b42-c933-42ac-aa25-28e3a111ee76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:18.038642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be327b42-c933-42ac-aa25-28e3a111ee76 admin admin] PATH_INFO: `/v3/projects/21e22373864543cca683b8eb9ebeff22/users/14027e8e4ad74bf68e94260656414cae/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:18.055100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be327b42-c933-42ac-aa25-28e3a111ee76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e22373864543cca683b8eb9ebeff22, user_id=14027e8e4ad74bf68e94260656414cae, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:18.058459 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be327b42-c933-42ac-aa25-28e3a111ee76 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:18.071785 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1160/2307] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:05:18 2022] PUT /identity/v3/projects/21e22373864543cca683b8eb9ebeff22/users/14027e8e4ad74bf68e94260656414cae/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:18.075849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d4489-dcd1-40b7-a62e-5311e6c8db60 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:18.086589 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d4489-dcd1-40b7-a62e-5311e6c8db60 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:18.146916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed9a308-81bf-4d92-9807-83ef34d176f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:18.147483 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9a308-81bf-4d92-9807-83ef34d176f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:18.147768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9a308-81bf-4d92-9807-83ef34d176f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:18.148042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed9a308-81bf-4d92-9807-83ef34d176f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:18.148735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9a308-81bf-4d92-9807-83ef34d176f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:18.150886 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed9a308-81bf-4d92-9807-83ef34d176f7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:18.160659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1148/2308] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:18 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:05:18.165073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be327b42-c933-42ac-aa25-28e3a111ee76 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:18.176020 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be327b42-c933-42ac-aa25-28e3a111ee76 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:18.180662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3527d-8be0-4b80-978f-4edafb6bc2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:18.181345 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3527d-8be0-4b80-978f-4edafb6bc2c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:18.181630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3527d-8be0-4b80-978f-4edafb6bc2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:18.181901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3527d-8be0-4b80-978f-4edafb6bc2c5 admin admin] PATH_INFO: `/v3/projects/21e22373864543cca683b8eb9ebeff22/users/14027e8e4ad74bf68e94260656414cae/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:18.183852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3527d-8be0-4b80-978f-4edafb6bc2c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21e22373864543cca683b8eb9ebeff22, user_id=14027e8e4ad74bf68e94260656414cae, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:18.186547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c3527d-8be0-4b80-978f-4edafb6bc2c5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:18.196991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1161/2309] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:05:18 2022] PUT /identity/v3/projects/21e22373864543cca683b8eb9ebeff22/users/14027e8e4ad74bf68e94260656414cae/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:18.207553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676801b-5a7b-4bf3-a4af-f70085fddc62 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:18.207845 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676801b-5a7b-4bf3-a4af-f70085fddc62 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:18.208133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1676801b-5a7b-4bf3-a4af-f70085fddc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:18.234817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:18.238061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1676801b-5a7b-4bf3-a4af-f70085fddc62 None None] MFA Rules not processed for user `14027e8e4ad74bf68e94260656414cae`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:18.240252 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1676801b-5a7b-4bf3-a4af-f70085fddc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:18.312405 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1149/2310] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:18.324206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3527d-8be0-4b80-978f-4edafb6bc2c5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:18.325976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d0c3527d-8be0-4b80-978f-4edafb6bc2c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:18.385315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3527d-8be0-4b80-978f-4edafb6bc2c5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:18.389196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c19e4-a798-49e8-898e-cb70edf7a000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:18.389848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c19e4-a798-49e8-898e-cb70edf7a000 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:18.390127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c19e4-a798-49e8-898e-cb70edf7a000 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:18.390397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c19e4-a798-49e8-898e-cb70edf7a000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:18.457117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c19e4-a798-49e8-898e-cb70edf7a000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:18.458536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c19e4-a798-49e8-898e-cb70edf7a000 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:18.468753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1162/2311] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:20.057027 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676801b-5a7b-4bf3-a4af-f70085fddc62 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:20.067728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1676801b-5a7b-4bf3-a4af-f70085fddc62 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:20.071415 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24957f9e-7360-45cc-adc8-5fddb53af919 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:20.072061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24957f9e-7360-45cc-adc8-5fddb53af919 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:20.072336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24957f9e-7360-45cc-adc8-5fddb53af919 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:20.072602 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24957f9e-7360-45cc-adc8-5fddb53af919 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:20.137547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24957f9e-7360-45cc-adc8-5fddb53af919 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:20.139031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24957f9e-7360-45cc-adc8-5fddb53af919 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:20.152648 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1150/2312] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:20.790900 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c19e4-a798-49e8-898e-cb70edf7a000 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:20.792818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d15c19e4-a798-49e8-898e-cb70edf7a000 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:20.807072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c19e4-a798-49e8-898e-cb70edf7a000 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:20.811041 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5138858-5b55-4b42-b4bd-bbc7b1a459c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:20.811692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5138858-5b55-4b42-b4bd-bbc7b1a459c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:20.812108 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5138858-5b55-4b42-b4bd-bbc7b1a459c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:20.812413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5138858-5b55-4b42-b4bd-bbc7b1a459c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:20.822498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5138858-5b55-4b42-b4bd-bbc7b1a459c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:20.823919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5138858-5b55-4b42-b4bd-bbc7b1a459c3 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:20.833734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1163/2313] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:24.941604 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24957f9e-7360-45cc-adc8-5fddb53af919 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:25.011690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24957f9e-7360-45cc-adc8-5fddb53af919 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:25.016225 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:25.016854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:25.017128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:25.017426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] PATH_INFO: `/v3/users/f26c4223aeb741fb9f70764e1b9ff496` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:25.018569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f26c4223aeb741fb9f70764e1b9ff496)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:25.020628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:25.062767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:25.069957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f26c4223aeb741fb9f70764e1b9ff496'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.070632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f26c4223aeb741fb9f70764e1b9ff496'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.084150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f26c4223aeb741fb9f70764e1b9ff496'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.091120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f26c4223aeb741fb9f70764e1b9ff496'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.098752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f26c4223aeb741fb9f70764e1b9ff496'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.104971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1151/2314] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:05:24 2022] DELETE /identity/v3/users/f26c4223aeb741fb9f70764e1b9ff496 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:25.109486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333bdfe-fc80-4f8b-a025-eba05df74df7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:25.109939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333bdfe-fc80-4f8b-a025-eba05df74df7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:25.110056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1333bdfe-fc80-4f8b-a025-eba05df74df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:25.129586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1333bdfe-fc80-4f8b-a025-eba05df74df7 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:25.130708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1333bdfe-fc80-4f8b-a025-eba05df74df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:25.193872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1164/2315] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:25.203687 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:25.205093 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:25.262270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57169-bf98-4202-9c50-d90859cc4cca admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:25.265840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365570a-4445-4ee7-853d-daab8f208be9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:25.266446 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365570a-4445-4ee7-853d-daab8f208be9 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:25.266721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365570a-4445-4ee7-853d-daab8f208be9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:25.266988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365570a-4445-4ee7-853d-daab8f208be9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:25.275976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365570a-4445-4ee7-853d-daab8f208be9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:25.277543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365570a-4445-4ee7-853d-daab8f208be9 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:25.287503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1152/2316] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:25.566703 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333bdfe-fc80-4f8b-a025-eba05df74df7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:25.572694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1333bdfe-fc80-4f8b-a025-eba05df74df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:25.590431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1333bdfe-fc80-4f8b-a025-eba05df74df7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:25.596614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:25.597319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:25.597646 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:25.597886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] PATH_INFO: `/v3/projects/974412ee904d47f7b81d76c4c23af5aa` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:25.599105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=974412ee904d47f7b81d76c4c23af5aa)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:25.601028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:25.603772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:25.650336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '974412ee904d47f7b81d76c4c23af5aa', 'request_id': 'req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.656453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '974412ee904d47f7b81d76c4c23af5aa', 'request_id': 'req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.662519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '974412ee904d47f7b81d76c4c23af5aa', 'request_id': 'req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.675285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] The token cache is being invalidate because project 974412ee904d47f7b81d76c4c23af5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:05:25.675601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.676208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.677792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1165/2317] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:05:25 2022] DELETE /identity/v3/projects/974412ee904d47f7b81d76c4c23af5aa => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:25.681767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365570a-4445-4ee7-853d-daab8f208be9 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:25.691848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365570a-4445-4ee7-853d-daab8f208be9 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:25.757688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:25.758335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:25.758620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:25.758883 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] PATH_INFO: `/v3/users/3d4e98b7855e46e883dfd166640f5569` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:25.760071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d4e98b7855e46e883dfd166640f5569)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:25.762106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:25.819540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d4e98b7855e46e883dfd166640f5569'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.820334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d4e98b7855e46e883dfd166640f5569'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.832203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:25.835897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d4e98b7855e46e883dfd166640f5569'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.845911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d4e98b7855e46e883dfd166640f5569'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.855842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d4e98b7855e46e883dfd166640f5569'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:25.863130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1153/2318] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:05:25 2022] DELETE /identity/v3/users/3d4e98b7855e46e883dfd166640f5569 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:26.236827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:26.238991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:26.251965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6d3b42-a295-4ebe-b73f-03f40f4217bc admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:26.312916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:26.313641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:26.313922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:26.314191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] PATH_INFO: `/v3/projects/4640784990304555ac6119440e9f72a7` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:26.315326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4640784990304555ac6119440e9f72a7)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:26.317249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:26.363246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4640784990304555ac6119440e9f72a7', 'request_id': 'req-1370fd0c-4830-4dbf-a780-df1b61e3c26b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.368891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4640784990304555ac6119440e9f72a7', 'request_id': 'req-1370fd0c-4830-4dbf-a780-df1b61e3c26b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.375578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4640784990304555ac6119440e9f72a7', 'request_id': 'req-1370fd0c-4830-4dbf-a780-df1b61e3c26b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.388152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] The token cache is being invalidate because project 4640784990304555ac6119440e9f72a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:05:26.388442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.389066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.390576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1166/2319] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:05:26 2022] DELETE /identity/v3/projects/4640784990304555ac6119440e9f72a7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:05:26.394533 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:26.395926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:26.408611 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b89b1e0-ca25-46b1-ae13-08b78802885f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:26.464371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b79b25-d299-48ce-a40e-ebc0ee804e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:26.465017 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b79b25-d299-48ce-a40e-ebc0ee804e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:26.465314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b79b25-d299-48ce-a40e-ebc0ee804e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:26.465588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b79b25-d299-48ce-a40e-ebc0ee804e7b admin admin] PATH_INFO: `/v3/users/14027e8e4ad74bf68e94260656414cae` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:26.466835 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b79b25-d299-48ce-a40e-ebc0ee804e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=14027e8e4ad74bf68e94260656414cae)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:26.468790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b79b25-d299-48ce-a40e-ebc0ee804e7b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:26.522012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-08b79b25-d299-48ce-a40e-ebc0ee804e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14027e8e4ad74bf68e94260656414cae'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.522714 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-08b79b25-d299-48ce-a40e-ebc0ee804e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14027e8e4ad74bf68e94260656414cae'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.535294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-08b79b25-d299-48ce-a40e-ebc0ee804e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14027e8e4ad74bf68e94260656414cae'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.542095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-08b79b25-d299-48ce-a40e-ebc0ee804e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14027e8e4ad74bf68e94260656414cae'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.549511 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-08b79b25-d299-48ce-a40e-ebc0ee804e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14027e8e4ad74bf68e94260656414cae'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.556801 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1154/2320] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:05:26 2022] DELETE /identity/v3/users/14027e8e4ad74bf68e94260656414cae => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:26.833217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:26.834822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:26.849469 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1370fd0c-4830-4dbf-a780-df1b61e3c26b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:26.869217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:26.911125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e18cdcf-784a-4438-be39-818a97dff356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:26.911825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18cdcf-784a-4438-be39-818a97dff356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:26.912028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18cdcf-784a-4438-be39-818a97dff356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:26.912298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e18cdcf-784a-4438-be39-818a97dff356 admin admin] PATH_INFO: `/v3/projects/21e22373864543cca683b8eb9ebeff22` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:26.913467 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18cdcf-784a-4438-be39-818a97dff356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21e22373864543cca683b8eb9ebeff22)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:26.915367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e18cdcf-784a-4438-be39-818a97dff356 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:26.960870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8e18cdcf-784a-4438-be39-818a97dff356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21e22373864543cca683b8eb9ebeff22', 'request_id': 'req-8e18cdcf-784a-4438-be39-818a97dff356'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.966336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8e18cdcf-784a-4438-be39-818a97dff356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21e22373864543cca683b8eb9ebeff22', 'request_id': 'req-8e18cdcf-784a-4438-be39-818a97dff356'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.972477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8e18cdcf-784a-4438-be39-818a97dff356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21e22373864543cca683b8eb9ebeff22', 'request_id': 'req-8e18cdcf-784a-4438-be39-818a97dff356'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.985952 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8e18cdcf-784a-4438-be39-818a97dff356 admin admin] The token cache is being invalidate because project 21e22373864543cca683b8eb9ebeff22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:05:26.986294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8e18cdcf-784a-4438-be39-818a97dff356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.986915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8e18cdcf-784a-4438-be39-818a97dff356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:26.988505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1167/2321] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:05:26 2022] DELETE /identity/v3/projects/21e22373864543cca683b8eb9ebeff22 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:26.993742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32feb23-38c2-48d1-98ec-2fba3aee6cb6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:26.994033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32feb23-38c2-48d1-98ec-2fba3aee6cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:26.994338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32feb23-38c2-48d1-98ec-2fba3aee6cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:27.014842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f32feb23-38c2-48d1-98ec-2fba3aee6cb6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:27.016049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f32feb23-38c2-48d1-98ec-2fba3aee6cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:27.068478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:27.080227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1155/2322] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:27.089323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12fc40-066b-4a69-9026-317046baaf1c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:27.089323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12fc40-066b-4a69-9026-317046baaf1c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:27.089323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12fc40-066b-4a69-9026-317046baaf1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:27.112653 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ba12fc40-066b-4a69-9026-317046baaf1c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:27.113904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ba12fc40-066b-4a69-9026-317046baaf1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:27.122495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1168/2323] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:27.126769 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32feb23-38c2-48d1-98ec-2fba3aee6cb6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:27.138638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32feb23-38c2-48d1-98ec-2fba3aee6cb6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:27.143365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadae9e-90f0-4c80-a271-d8c5e044a59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:27.144626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadae9e-90f0-4c80-a271-d8c5e044a59b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:27.144908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadae9e-90f0-4c80-a271-d8c5e044a59b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:27.145180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eadae9e-90f0-4c80-a271-d8c5e044a59b admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:27.145916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadae9e-90f0-4c80-a271-d8c5e044a59b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:05:27.146245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadae9e-90f0-4c80-a271-d8c5e044a59b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:27.147876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eadae9e-90f0-4c80-a271-d8c5e044a59b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:27.161690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1156/2324] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:05:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 12:05:27.165691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12fc40-066b-4a69-9026-317046baaf1c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:27.175388 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12fc40-066b-4a69-9026-317046baaf1c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:27.180157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824146f-b9ec-4d1c-9f2c-3e8120793886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:27.181046 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824146f-b9ec-4d1c-9f2c-3e8120793886 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:27.181245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824146f-b9ec-4d1c-9f2c-3e8120793886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:27.181554 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b824146f-b9ec-4d1c-9f2c-3e8120793886 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:27.183447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824146f-b9ec-4d1c-9f2c-3e8120793886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:27.184263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b824146f-b9ec-4d1c-9f2c-3e8120793886 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:27.217565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1169/2325] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:05:27 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:27.218668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadae9e-90f0-4c80-a271-d8c5e044a59b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:27.228514 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eadae9e-90f0-4c80-a271-d8c5e044a59b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:27.314866 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d43bd-ffaf-46e5-8d6c-f390b559eea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:27.316331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d43bd-ffaf-46e5-8d6c-f390b559eea0 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:27.316631 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d43bd-ffaf-46e5-8d6c-f390b559eea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:27.317215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d43bd-ffaf-46e5-8d6c-f390b559eea0 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:27.318071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d43bd-ffaf-46e5-8d6c-f390b559eea0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:27.320992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d43bd-ffaf-46e5-8d6c-f390b559eea0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:27.355132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1157/2326] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:05:27 2022] POST /identity/v3/users => generated 293 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:27.356189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824146f-b9ec-4d1c-9f2c-3e8120793886 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:27.372215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b824146f-b9ec-4d1c-9f2c-3e8120793886 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:27.377361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914182c-616a-4b0f-a633-9edeefe8da37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:27.377992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914182c-616a-4b0f-a633-9edeefe8da37 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:27.378277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914182c-616a-4b0f-a633-9edeefe8da37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:27.378594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914182c-616a-4b0f-a633-9edeefe8da37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:27.379369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914182c-616a-4b0f-a633-9edeefe8da37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:27.381142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5914182c-616a-4b0f-a633-9edeefe8da37 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:27.393434 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1170/2327] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:05:27.397418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d43bd-ffaf-46e5-8d6c-f390b559eea0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:27.409021 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d43bd-ffaf-46e5-8d6c-f390b559eea0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:27.414918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b623ce42-e6fb-4d81-b2bf-a32e56589a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:27.415551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623ce42-e6fb-4d81-b2bf-a32e56589a91 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:27.416936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623ce42-e6fb-4d81-b2bf-a32e56589a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:27.416936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b623ce42-e6fb-4d81-b2bf-a32e56589a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:27.417951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623ce42-e6fb-4d81-b2bf-a32e56589a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:27.419776 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b623ce42-e6fb-4d81-b2bf-a32e56589a91 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:27.431903 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1158/2328] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:05:27.435964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914182c-616a-4b0f-a633-9edeefe8da37 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:27.446832 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5914182c-616a-4b0f-a633-9edeefe8da37 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:27.452291 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfa535-9283-46ce-8319-6a6d7aa77602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:27.452964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfa535-9283-46ce-8319-6a6d7aa77602 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:27.453245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfa535-9283-46ce-8319-6a6d7aa77602 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:27.453553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abfa535-9283-46ce-8319-6a6d7aa77602 admin admin] PATH_INFO: `/v3/projects/2dacab797022491d81fd667e2efcf324/users/717d65adc2ad4321a9421b45736d3cb5/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:27.482599 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfa535-9283-46ce-8319-6a6d7aa77602 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2dacab797022491d81fd667e2efcf324, user_id=717d65adc2ad4321a9421b45736d3cb5, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:27.485584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abfa535-9283-46ce-8319-6a6d7aa77602 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:27.500726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1171/2329] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:05:27 2022] PUT /identity/v3/projects/2dacab797022491d81fd667e2efcf324/users/717d65adc2ad4321a9421b45736d3cb5/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:27.573778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f6b4d-a8b2-4e5a-bc19-c2658d5004b9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:27.574201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f6b4d-a8b2-4e5a-bc19-c2658d5004b9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:27.574432 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99f6b4d-a8b2-4e5a-bc19-c2658d5004b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:27.603576 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e99f6b4d-a8b2-4e5a-bc19-c2658d5004b9 None None] MFA Rules not processed for user `717d65adc2ad4321a9421b45736d3cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:27.605992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e99f6b4d-a8b2-4e5a-bc19-c2658d5004b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:27.693534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1159/2330] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:27.699385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfa535-9283-46ce-8319-6a6d7aa77602 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:27.701951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9abfa535-9283-46ce-8319-6a6d7aa77602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:27.781934 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:27.786297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abfa535-9283-46ce-8319-6a6d7aa77602 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:27.790396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b62573-943b-4880-bffb-1bdcc5c26c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:27.791176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b62573-943b-4880-bffb-1bdcc5c26c6e service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:27.792012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b62573-943b-4880-bffb-1bdcc5c26c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:27.792514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b62573-943b-4880-bffb-1bdcc5c26c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:27.802739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b62573-943b-4880-bffb-1bdcc5c26c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:27.804250 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b62573-943b-4880-bffb-1bdcc5c26c6e service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:27.815139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1172/2331] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:30.368445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f6b4d-a8b2-4e5a-bc19-c2658d5004b9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:30.420154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:30.433064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99f6b4d-a8b2-4e5a-bc19-c2658d5004b9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:30.437571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:30.438210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:30.438485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:30.438754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] PATH_INFO: `/v3/users/717d65adc2ad4321a9421b45736d3cb5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:30.439900 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=717d65adc2ad4321a9421b45736d3cb5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:30.441867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:30.491426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '717d65adc2ad4321a9421b45736d3cb5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:30.492079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '717d65adc2ad4321a9421b45736d3cb5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:30.504398 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '717d65adc2ad4321a9421b45736d3cb5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:30.511172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '717d65adc2ad4321a9421b45736d3cb5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:30.517819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '717d65adc2ad4321a9421b45736d3cb5'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:30.523608 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1160/2332] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:05:30 2022] DELETE /identity/v3/users/717d65adc2ad4321a9421b45736d3cb5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:30.528053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd684410-e7bb-4ace-bd7c-254a11f16dcc None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:30.528558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd684410-e7bb-4ace-bd7c-254a11f16dcc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:30.528661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd684410-e7bb-4ace-bd7c-254a11f16dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:30.548726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-bd684410-e7bb-4ace-bd7c-254a11f16dcc None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:30.549982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bd684410-e7bb-4ace-bd7c-254a11f16dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:30.609566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1173/2333] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:30.620040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:30.621491 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:30.679508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b8cdbf-00e7-40df-8ee3-3bc61515ad09 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:30.683812 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778b4aa-ea0d-49d5-a7f0-3d6b04ccd568 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:30.684427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778b4aa-ea0d-49d5-a7f0-3d6b04ccd568 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:30.684707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778b4aa-ea0d-49d5-a7f0-3d6b04ccd568 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:30.684978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778b4aa-ea0d-49d5-a7f0-3d6b04ccd568 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:30.693941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778b4aa-ea0d-49d5-a7f0-3d6b04ccd568 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:30.695385 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778b4aa-ea0d-49d5-a7f0-3d6b04ccd568 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:30.704841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1161/2334] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:31.082623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd684410-e7bb-4ace-bd7c-254a11f16dcc None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:31.084102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bd684410-e7bb-4ace-bd7c-254a11f16dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:31.097519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd684410-e7bb-4ace-bd7c-254a11f16dcc None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:31.102201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7582d94-87bd-4d98-bcbf-bc36e051471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:31.102844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7582d94-87bd-4d98-bcbf-bc36e051471b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:31.103154 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7582d94-87bd-4d98-bcbf-bc36e051471b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:31.103425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7582d94-87bd-4d98-bcbf-bc36e051471b admin admin] PATH_INFO: `/v3/projects/2dacab797022491d81fd667e2efcf324` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:31.105157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7582d94-87bd-4d98-bcbf-bc36e051471b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2dacab797022491d81fd667e2efcf324)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:31.107128 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7582d94-87bd-4d98-bcbf-bc36e051471b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:31.154905 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d7582d94-87bd-4d98-bcbf-bc36e051471b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2dacab797022491d81fd667e2efcf324', 'request_id': 'req-d7582d94-87bd-4d98-bcbf-bc36e051471b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:31.160277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d7582d94-87bd-4d98-bcbf-bc36e051471b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2dacab797022491d81fd667e2efcf324', 'request_id': 'req-d7582d94-87bd-4d98-bcbf-bc36e051471b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:31.167013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d7582d94-87bd-4d98-bcbf-bc36e051471b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2dacab797022491d81fd667e2efcf324', 'request_id': 'req-d7582d94-87bd-4d98-bcbf-bc36e051471b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:31.178641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d7582d94-87bd-4d98-bcbf-bc36e051471b admin admin] The token cache is being invalidate because project 2dacab797022491d81fd667e2efcf324 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:05:31.178927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d7582d94-87bd-4d98-bcbf-bc36e051471b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:31.179547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d7582d94-87bd-4d98-bcbf-bc36e051471b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:31.181054 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1174/2335] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:05:31 2022] DELETE /identity/v3/projects/2dacab797022491d81fd667e2efcf324 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:31.185891 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11443a25-24e3-4d16-8f9d-8b7d37aff805 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:31.186176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11443a25-24e3-4d16-8f9d-8b7d37aff805 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:31.186450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11443a25-24e3-4d16-8f9d-8b7d37aff805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:31.209940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-11443a25-24e3-4d16-8f9d-8b7d37aff805 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:31.211194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-11443a25-24e3-4d16-8f9d-8b7d37aff805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:31.282311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1162/2336] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:31.290714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a889a-e4e6-40d5-9df8-462ba84e3ccd None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:31.290999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a889a-e4e6-40d5-9df8-462ba84e3ccd None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:31.291299 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a889a-e4e6-40d5-9df8-462ba84e3ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:31.313555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ed9a889a-e4e6-40d5-9df8-462ba84e3ccd None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:31.314807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ed9a889a-e4e6-40d5-9df8-462ba84e3ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:31.323731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1175/2337] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:05:31.328010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11443a25-24e3-4d16-8f9d-8b7d37aff805 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:31.337997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11443a25-24e3-4d16-8f9d-8b7d37aff805 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:31.343421 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f225d2-3c11-4c65-affb-d15dfbfeec0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:31.344013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f225d2-3c11-4c65-affb-d15dfbfeec0a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:31.344313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f225d2-3c11-4c65-affb-d15dfbfeec0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:31.344610 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f225d2-3c11-4c65-affb-d15dfbfeec0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:31.345345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f225d2-3c11-4c65-affb-d15dfbfeec0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:05:31.345648 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f225d2-3c11-4c65-affb-d15dfbfeec0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:31.347245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f225d2-3c11-4c65-affb-d15dfbfeec0a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:31.363776 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1163/2338] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:05:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:05:31.368733 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a889a-e4e6-40d5-9df8-462ba84e3ccd None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:31.379818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a889a-e4e6-40d5-9df8-462ba84e3ccd None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:31.384570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0535c-5b82-4462-8341-29b7986fb17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:31.385953 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0535c-5b82-4462-8341-29b7986fb17e admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:31.386073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0535c-5b82-4462-8341-29b7986fb17e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:31.386335 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c0535c-5b82-4462-8341-29b7986fb17e admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:31.386989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0535c-5b82-4462-8341-29b7986fb17e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:31.388888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c0535c-5b82-4462-8341-29b7986fb17e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:31.416681 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1176/2339] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:05:31 2022] POST /identity/v3/projects => generated 365 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:31.420904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f225d2-3c11-4c65-affb-d15dfbfeec0a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:31.426194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:31.432500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f225d2-3c11-4c65-affb-d15dfbfeec0a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:31.491374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea011588-628c-4db8-b93e-ca611ea4f66e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:31.491994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea011588-628c-4db8-b93e-ca611ea4f66e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:31.492291 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea011588-628c-4db8-b93e-ca611ea4f66e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:31.492549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea011588-628c-4db8-b93e-ca611ea4f66e admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:31.493211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea011588-628c-4db8-b93e-ca611ea4f66e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:31.495171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea011588-628c-4db8-b93e-ca611ea4f66e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:31.515764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1164/2340] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:05:31 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:05:31.520037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0535c-5b82-4462-8341-29b7986fb17e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:31.532472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c0535c-5b82-4462-8341-29b7986fb17e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:31.538569 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70767329-6272-4a7c-972a-e2198080dd05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:31.539220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70767329-6272-4a7c-972a-e2198080dd05 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:31.539498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70767329-6272-4a7c-972a-e2198080dd05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:31.539761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70767329-6272-4a7c-972a-e2198080dd05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:31.540478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70767329-6272-4a7c-972a-e2198080dd05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:31.542168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70767329-6272-4a7c-972a-e2198080dd05 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:31.552636 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1177/2341] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:31.557261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea011588-628c-4db8-b93e-ca611ea4f66e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:31.567235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea011588-628c-4db8-b93e-ca611ea4f66e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:31.571825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ac05e-37e8-4b9d-91ae-07225d25cff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:31.573049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac05e-37e8-4b9d-91ae-07225d25cff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:31.573376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac05e-37e8-4b9d-91ae-07225d25cff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:31.573651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac05e-37e8-4b9d-91ae-07225d25cff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:31.574339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ac05e-37e8-4b9d-91ae-07225d25cff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:31.575939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1ac05e-37e8-4b9d-91ae-07225d25cff8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:31.586350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1165/2342] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:31.590356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70767329-6272-4a7c-972a-e2198080dd05 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:31.600148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70767329-6272-4a7c-972a-e2198080dd05 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:31.604962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43090a0f-787c-4d95-9be1-4db8ae98e4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:31.605678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43090a0f-787c-4d95-9be1-4db8ae98e4b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:31.605963 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43090a0f-787c-4d95-9be1-4db8ae98e4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:31.606239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43090a0f-787c-4d95-9be1-4db8ae98e4b9 admin admin] PATH_INFO: `/v3/projects/fc350fcb3ec84611a16fa2c2c84ddf08/users/4b0690a7d4794baca470eea06fcc4a6d/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:31.622566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43090a0f-787c-4d95-9be1-4db8ae98e4b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc350fcb3ec84611a16fa2c2c84ddf08, user_id=4b0690a7d4794baca470eea06fcc4a6d, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:31.625246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43090a0f-787c-4d95-9be1-4db8ae98e4b9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:31.638754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1178/2343] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:05:31 2022] PUT /identity/v3/projects/fc350fcb3ec84611a16fa2c2c84ddf08/users/4b0690a7d4794baca470eea06fcc4a6d/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:31.648978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a5f67-b363-4c39-85d2-66f7f6271e6a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:31.649262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a5f67-b363-4c39-85d2-66f7f6271e6a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:31.649588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a5f67-b363-4c39-85d2-66f7f6271e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:31.678163 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1b0a5f67-b363-4c39-85d2-66f7f6271e6a None None] MFA Rules not processed for user `4b0690a7d4794baca470eea06fcc4a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:31.679395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1b0a5f67-b363-4c39-85d2-66f7f6271e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:31.744821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1166/2344] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:31 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:31.756043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43090a0f-787c-4d95-9be1-4db8ae98e4b9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:31.757729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-43090a0f-787c-4d95-9be1-4db8ae98e4b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:31.771510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:31.827477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43090a0f-787c-4d95-9be1-4db8ae98e4b9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:31.831474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52614b9-b49d-4773-b112-6e5a49027ec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:31.832208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52614b9-b49d-4773-b112-6e5a49027ec3 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:31.832556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52614b9-b49d-4773-b112-6e5a49027ec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:31.832899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52614b9-b49d-4773-b112-6e5a49027ec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:31.842405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52614b9-b49d-4773-b112-6e5a49027ec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:31.843845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52614b9-b49d-4773-b112-6e5a49027ec3 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:31.852685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1179/2345] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:31 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:35.955481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3bb9d-04b4-4d76-9697-c6609d5da035 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:35.960485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3bb9d-04b4-4d76-9697-c6609d5da035 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:35.961210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b3bb9d-04b4-4d76-9697-c6609d5da035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:35.986969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b3b3bb9d-04b4-4d76-9697-c6609d5da035 None None] MFA Rules not processed for user `10f497bc876d4aa7b4ff9119d618b25a`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:35.990143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b3b3bb9d-04b4-4d76-9697-c6609d5da035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:36.058039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1167/2346] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:41.848632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=21 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:46.046975 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:48.625652 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52614b9-b49d-4773-b112-6e5a49027ec3 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:48.627167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e52614b9-b49d-4773-b112-6e5a49027ec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:48.691889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52614b9-b49d-4773-b112-6e5a49027ec3 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:48.696503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:48.697141 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:48.697452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:48.697729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] PATH_INFO: `/v3/users/21b556ca7b3b4dacbb113027e50787cd` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:48.698895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b556ca7b3b4dacbb113027e50787cd)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:48.701348 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:48.750447 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b556ca7b3b4dacbb113027e50787cd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:48.758853 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b556ca7b3b4dacbb113027e50787cd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:48.772413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b556ca7b3b4dacbb113027e50787cd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:48.773124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b556ca7b3b4dacbb113027e50787cd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:48.780116 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b556ca7b3b4dacbb113027e50787cd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:48.786906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1180/2347] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:05:48 2022] DELETE /identity/v3/users/21b556ca7b3b4dacbb113027e50787cd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:48.791340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31797-a8de-4ac7-88e5-8dcac3a53fcc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:48.791820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31797-a8de-4ac7-88e5-8dcac3a53fcc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:48.791961 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad31797-a8de-4ac7-88e5-8dcac3a53fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:48.812171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9ad31797-a8de-4ac7-88e5-8dcac3a53fcc None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:48.813396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9ad31797-a8de-4ac7-88e5-8dcac3a53fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:48.903410 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1168/2348] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:05:48.913026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:48.914489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:48.972444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f2c04-f8bf-464a-886d-42cc6a37f093 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:48.976147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1166f5-7fb2-4b37-ad31-3a98c4d89c6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:48.976756 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1166f5-7fb2-4b37-ad31-3a98c4d89c6e service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:48.977037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1166f5-7fb2-4b37-ad31-3a98c4d89c6e service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:48.977324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1166f5-7fb2-4b37-ad31-3a98c4d89c6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:48.986852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1166f5-7fb2-4b37-ad31-3a98c4d89c6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:48.988295 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1166f5-7fb2-4b37-ad31-3a98c4d89c6e service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:48.998677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1181/2349] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:05:49.275599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31797-a8de-4ac7-88e5-8dcac3a53fcc None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:49.277211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9ad31797-a8de-4ac7-88e5-8dcac3a53fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:49.294209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad31797-a8de-4ac7-88e5-8dcac3a53fcc None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:49.299911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad281532-23b2-40a9-b54f-4e2b5e7622ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:49.300589 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281532-23b2-40a9-b54f-4e2b5e7622ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:49.300847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281532-23b2-40a9-b54f-4e2b5e7622ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:49.301117 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad281532-23b2-40a9-b54f-4e2b5e7622ac admin admin] PATH_INFO: `/v3/projects/8739f3aaf534492c8803413940a7749e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:49.302510 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad281532-23b2-40a9-b54f-4e2b5e7622ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=8739f3aaf534492c8803413940a7749e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:49.304777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad281532-23b2-40a9-b54f-4e2b5e7622ac admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:49.355517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ad281532-23b2-40a9-b54f-4e2b5e7622ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8739f3aaf534492c8803413940a7749e', 'request_id': 'req-ad281532-23b2-40a9-b54f-4e2b5e7622ac'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:49.364346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ad281532-23b2-40a9-b54f-4e2b5e7622ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8739f3aaf534492c8803413940a7749e', 'request_id': 'req-ad281532-23b2-40a9-b54f-4e2b5e7622ac'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:49.374221 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ad281532-23b2-40a9-b54f-4e2b5e7622ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8739f3aaf534492c8803413940a7749e', 'request_id': 'req-ad281532-23b2-40a9-b54f-4e2b5e7622ac'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:49.385427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ad281532-23b2-40a9-b54f-4e2b5e7622ac admin admin] The token cache is being invalidate because project 8739f3aaf534492c8803413940a7749e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:05:49.385716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ad281532-23b2-40a9-b54f-4e2b5e7622ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:49.386359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ad281532-23b2-40a9-b54f-4e2b5e7622ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:05:49.387879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1169/2350] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:05:49 2022] DELETE /identity/v3/projects/8739f3aaf534492c8803413940a7749e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:49.392740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154e2bc-c4c7-4ea4-a46a-d8abcc400753 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:49.392965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154e2bc-c4c7-4ea4-a46a-d8abcc400753 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:49.393274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154e2bc-c4c7-4ea4-a46a-d8abcc400753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:49.413001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7154e2bc-c4c7-4ea4-a46a-d8abcc400753 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:49.414246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7154e2bc-c4c7-4ea4-a46a-d8abcc400753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:49.433219 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:49.482053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1182/2351] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:49.490102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939550dd-88a0-47a4-9136-9c7a1b73b483 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:49.490389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939550dd-88a0-47a4-9136-9c7a1b73b483 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:49.490665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939550dd-88a0-47a4-9136-9c7a1b73b483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:49.509995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-939550dd-88a0-47a4-9136-9c7a1b73b483 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:49.511187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-939550dd-88a0-47a4-9136-9c7a1b73b483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:49.519042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1170/2352] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:49.523506 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154e2bc-c4c7-4ea4-a46a-d8abcc400753 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:49.534125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154e2bc-c4c7-4ea4-a46a-d8abcc400753 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:49.539015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a342f-9fb5-4240-8114-5263244b080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:49.539708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a342f-9fb5-4240-8114-5263244b080f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:49.539994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a342f-9fb5-4240-8114-5263244b080f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:49.540277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a342f-9fb5-4240-8114-5263244b080f admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:49.541098 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a342f-9fb5-4240-8114-5263244b080f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:05:49.541486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a342f-9fb5-4240-8114-5263244b080f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:49.543156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a342f-9fb5-4240-8114-5263244b080f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:49.555693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1183/2353] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:05:49.560011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939550dd-88a0-47a4-9136-9c7a1b73b483 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:49.569486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939550dd-88a0-47a4-9136-9c7a1b73b483 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:49.574241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332a3f5-aa22-4e06-8865-107c90b3ae6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:49.574881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332a3f5-aa22-4e06-8865-107c90b3ae6e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:49.575159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332a3f5-aa22-4e06-8865-107c90b3ae6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:49.575430 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2332a3f5-aa22-4e06-8865-107c90b3ae6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:49.576100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332a3f5-aa22-4e06-8865-107c90b3ae6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:49.578049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2332a3f5-aa22-4e06-8865-107c90b3ae6e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:49.609626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1171/2354] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:05:49 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:05:49.610897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a342f-9fb5-4240-8114-5263244b080f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:49.621172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a342f-9fb5-4240-8114-5263244b080f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:49.677588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343e6bd-5dd1-4cdd-a99a-cebf94a668cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:49.678263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343e6bd-5dd1-4cdd-a99a-cebf94a668cf admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:49.678365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343e6bd-5dd1-4cdd-a99a-cebf94a668cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:49.678639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7343e6bd-5dd1-4cdd-a99a-cebf94a668cf admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:49.679295 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343e6bd-5dd1-4cdd-a99a-cebf94a668cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:49.681203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7343e6bd-5dd1-4cdd-a99a-cebf94a668cf admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:49.703246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1184/2355] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:05:49 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:05:49.707551 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332a3f5-aa22-4e06-8865-107c90b3ae6e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:49.723241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2332a3f5-aa22-4e06-8865-107c90b3ae6e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:49.728943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69259f99-0ff2-44b7-a8c2-5707be76dbaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:49.732557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69259f99-0ff2-44b7-a8c2-5707be76dbaf admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:49.732851 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69259f99-0ff2-44b7-a8c2-5707be76dbaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:49.733129 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69259f99-0ff2-44b7-a8c2-5707be76dbaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:49.733858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69259f99-0ff2-44b7-a8c2-5707be76dbaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:49.736073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69259f99-0ff2-44b7-a8c2-5707be76dbaf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:49.747288 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1172/2356] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:05:49.751194 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343e6bd-5dd1-4cdd-a99a-cebf94a668cf admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:49.761392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7343e6bd-5dd1-4cdd-a99a-cebf94a668cf admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:49.766027 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab546cd-3e1b-4f15-93b6-bca3b8f74838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:49.766676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab546cd-3e1b-4f15-93b6-bca3b8f74838 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:49.766955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab546cd-3e1b-4f15-93b6-bca3b8f74838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:49.767229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab546cd-3e1b-4f15-93b6-bca3b8f74838 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:49.767918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab546cd-3e1b-4f15-93b6-bca3b8f74838 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:49.769590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab546cd-3e1b-4f15-93b6-bca3b8f74838 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:49.781191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1185/2357] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:05:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:05:49.784916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69259f99-0ff2-44b7-a8c2-5707be76dbaf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:49.795456 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69259f99-0ff2-44b7-a8c2-5707be76dbaf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:49.799983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96308c-16b6-4c79-bc8f-d829a8a3bda0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:49.800623 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96308c-16b6-4c79-bc8f-d829a8a3bda0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:49.800898 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96308c-16b6-4c79-bc8f-d829a8a3bda0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:49.801167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96308c-16b6-4c79-bc8f-d829a8a3bda0 admin admin] PATH_INFO: `/v3/projects/faa404ec295d44d4bb063a15d8d8c85f/users/f5d76151f6364c7d8091396a41d2a44a/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:49.815917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96308c-16b6-4c79-bc8f-d829a8a3bda0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=faa404ec295d44d4bb063a15d8d8c85f, user_id=f5d76151f6364c7d8091396a41d2a44a, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:49.818629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce96308c-16b6-4c79-bc8f-d829a8a3bda0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:49.831527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1173/2358] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:05:49 2022] PUT /identity/v3/projects/faa404ec295d44d4bb063a15d8d8c85f/users/f5d76151f6364c7d8091396a41d2a44a/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:05:49.903374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f1cc5-c107-48de-9002-c50fb863679a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:49.903819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f1cc5-c107-48de-9002-c50fb863679a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:49.904248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f1cc5-c107-48de-9002-c50fb863679a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:49.937322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-302f1cc5-c107-48de-9002-c50fb863679a None None] MFA Rules not processed for user `f5d76151f6364c7d8091396a41d2a44a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:05:49.938553 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-302f1cc5-c107-48de-9002-c50fb863679a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:50.015899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1186/2359] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:05:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:05:50.027195 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96308c-16b6-4c79-bc8f-d829a8a3bda0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:05:50.029802 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ce96308c-16b6-4c79-bc8f-d829a8a3bda0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:05:50.062454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:05:50.108983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96308c-16b6-4c79-bc8f-d829a8a3bda0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:05:50.112721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab586f79-380e-4178-bc49-ba50b4a975b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c358a2d9539c4ae2a5e12aa6f1ed6d61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:05:50.113377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab586f79-380e-4178-bc49-ba50b4a975b8 service glance] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:05:50.113658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab586f79-380e-4178-bc49-ba50b4a975b8 service glance] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:05:50.113928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab586f79-380e-4178-bc49-ba50b4a975b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:05:50.122969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab586f79-380e-4178-bc49-ba50b4a975b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:05:50.125126 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab586f79-380e-4178-bc49-ba50b4a975b8 service glance] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:05:50.134572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1174/2360] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:05:50 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:06:00.013443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:06:00.130150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=17 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:06:00.401671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86620ba1-ee61-478d-8a01-c239a12a08cd None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:00.401956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86620ba1-ee61-478d-8a01-c239a12a08cd None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:00.402234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86620ba1-ee61-478d-8a01-c239a12a08cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:00.423024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-86620ba1-ee61-478d-8a01-c239a12a08cd None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:06:00.424347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-86620ba1-ee61-478d-8a01-c239a12a08cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:00.486328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1187/2361] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 1 12:06:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:06:00.527723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab586f79-380e-4178-bc49-ba50b4a975b8 service glance] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:00.529203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ab586f79-380e-4178-bc49-ba50b4a975b8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:00.607443 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab586f79-380e-4178-bc49-ba50b4a975b8 service glance] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:00.613422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446360d-eb59-4738-ba58-057a48f549e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:00.614040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446360d-eb59-4738-ba58-057a48f549e2 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:00.614317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446360d-eb59-4738-ba58-057a48f549e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:00.614851 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446360d-eb59-4738-ba58-057a48f549e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:00.622903 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446360d-eb59-4738-ba58-057a48f549e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:00.625167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446360d-eb59-4738-ba58-057a48f549e2 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:00.634949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1175/2362] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:06:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:06:05.854480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d8ec0-6034-46b5-8a62-98efa048244b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:05.855057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d8ec0-6034-46b5-8a62-98efa048244b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:05.855057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694d8ec0-6034-46b5-8a62-98efa048244b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:05.874897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-694d8ec0-6034-46b5-8a62-98efa048244b None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:06:05.876119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-694d8ec0-6034-46b5-8a62-98efa048244b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:05.883950 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1188/2363] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 1 12:06:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:06:05.925880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446360d-eb59-4738-ba58-057a48f549e2 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:05.927301 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2446360d-eb59-4738-ba58-057a48f549e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:05.941681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446360d-eb59-4738-ba58-057a48f549e2 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:05.947089 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3a293-1dad-4f7a-bb4b-8722fc8acc10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:05.947687 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3a293-1dad-4f7a-bb4b-8722fc8acc10 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:05.947962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3a293-1dad-4f7a-bb4b-8722fc8acc10 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:05.948232 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3a293-1dad-4f7a-bb4b-8722fc8acc10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:05.957485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3a293-1dad-4f7a-bb4b-8722fc8acc10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:05.959061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3a293-1dad-4f7a-bb4b-8722fc8acc10 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:05.968671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1176/2364] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:06:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:06:12.940627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9d686-12c6-44f8-a9f7-d929e4066c56 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:12.941238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9d686-12c6-44f8-a9f7-d929e4066c56 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:12.941238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9d686-12c6-44f8-a9f7-d929e4066c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:12.960442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-27c9d686-12c6-44f8-a9f7-d929e4066c56 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:06:12.961824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-27c9d686-12c6-44f8-a9f7-d929e4066c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:12.971022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1189/2365] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 1 12:06:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:06:12.997094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3a293-1dad-4f7a-bb4b-8722fc8acc10 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:13.008114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3a293-1dad-4f7a-bb4b-8722fc8acc10 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:13.013619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58587905-9ee0-4558-bbb6-2dd2d07b1af0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:13.014213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58587905-9ee0-4558-bbb6-2dd2d07b1af0 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:13.014493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58587905-9ee0-4558-bbb6-2dd2d07b1af0 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:13.014765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58587905-9ee0-4558-bbb6-2dd2d07b1af0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:13.023310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58587905-9ee0-4558-bbb6-2dd2d07b1af0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:13.024880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58587905-9ee0-4558-bbb6-2dd2d07b1af0 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:13.034759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1177/2366] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:06:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:06:18.082068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084343f-2eb4-4b17-a6ad-16fdcfb71ce5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:18.082614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084343f-2eb4-4b17-a6ad-16fdcfb71ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:18.082614 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084343f-2eb4-4b17-a6ad-16fdcfb71ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:18.102863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c084343f-2eb4-4b17-a6ad-16fdcfb71ce5 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:06:18.104064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c084343f-2eb4-4b17-a6ad-16fdcfb71ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:18.111865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1190/2367] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 1 12:06:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:06:18.138440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58587905-9ee0-4558-bbb6-2dd2d07b1af0 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:18.153508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58587905-9ee0-4558-bbb6-2dd2d07b1af0 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:18.159717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401b566-f06f-40bf-afc6-4824a3a1ba1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:18.160459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401b566-f06f-40bf-afc6-4824a3a1ba1d service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:18.160744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401b566-f06f-40bf-afc6-4824a3a1ba1d service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:18.161017 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401b566-f06f-40bf-afc6-4824a3a1ba1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:18.169504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401b566-f06f-40bf-afc6-4824a3a1ba1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:18.171503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401b566-f06f-40bf-afc6-4824a3a1ba1d service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:18.181069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1178/2368] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:06:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:06:23.390151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15e44c-70da-4822-913a-52f3ea14e65c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:23.390823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15e44c-70da-4822-913a-52f3ea14e65c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:23.390823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b15e44c-70da-4822-913a-52f3ea14e65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:23.411275 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0b15e44c-70da-4822-913a-52f3ea14e65c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:06:23.412448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0b15e44c-70da-4822-913a-52f3ea14e65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:23.422182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1191/2369] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 1 12:06:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:06:23.452885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401b566-f06f-40bf-afc6-4824a3a1ba1d service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:23.465771 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401b566-f06f-40bf-afc6-4824a3a1ba1d service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:23.472454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb86cd1-420f-4213-9da8-b219abb239eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:23.473104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb86cd1-420f-4213-9da8-b219abb239eb service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:23.473422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb86cd1-420f-4213-9da8-b219abb239eb service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:23.473698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb86cd1-420f-4213-9da8-b219abb239eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:23.493180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb86cd1-420f-4213-9da8-b219abb239eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:23.493180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb86cd1-420f-4213-9da8-b219abb239eb service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:23.505412 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1179/2370] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:06:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:06:25.033692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15e44c-70da-4822-913a-52f3ea14e65c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:25.035073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0b15e44c-70da-4822-913a-52f3ea14e65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:25.046742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b15e44c-70da-4822-913a-52f3ea14e65c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:25.051876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:25.052514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:25.052795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:25.053081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] PATH_INFO: `/v3/users/4b0690a7d4794baca470eea06fcc4a6d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:25.054507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b0690a7d4794baca470eea06fcc4a6d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:25.056424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:25.107797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b0690a7d4794baca470eea06fcc4a6d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:25.116064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b0690a7d4794baca470eea06fcc4a6d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:25.128607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b0690a7d4794baca470eea06fcc4a6d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:25.130552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b0690a7d4794baca470eea06fcc4a6d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:25.137502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b0690a7d4794baca470eea06fcc4a6d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:25.143548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1192/2371] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:06:25 2022] DELETE /identity/v3/users/4b0690a7d4794baca470eea06fcc4a6d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:06:25.149009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e6b29-4275-479f-8d60-43d3b749146a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:25.149499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e6b29-4275-479f-8d60-43d3b749146a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:25.150589 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39e6b29-4275-479f-8d60-43d3b749146a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:25.174545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f39e6b29-4275-479f-8d60-43d3b749146a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:06:25.177066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f39e6b29-4275-479f-8d60-43d3b749146a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:25.244062 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1180/2372] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:06:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:06:25.253568 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:25.255003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:25.319196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:06:25.325376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2337a-d94f-4224-bba2-1c22cbf32105 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:25.329560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5c4f88-53ee-4534-86f7-8d63de30ac0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:25.330187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c4f88-53ee-4534-86f7-8d63de30ac0f service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:25.330615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c4f88-53ee-4534-86f7-8d63de30ac0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:25.330890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c4f88-53ee-4534-86f7-8d63de30ac0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:25.340410 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c4f88-53ee-4534-86f7-8d63de30ac0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:25.341884 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5c4f88-53ee-4534-86f7-8d63de30ac0f service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:25.351238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1193/2373] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:06:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:06:25.635330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e6b29-4275-479f-8d60-43d3b749146a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:25.636852 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f39e6b29-4275-479f-8d60-43d3b749146a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:25.651162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39e6b29-4275-479f-8d60-43d3b749146a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:25.656082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:25.656725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:25.656997 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:25.657473 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] PATH_INFO: `/v3/projects/fc350fcb3ec84611a16fa2c2c84ddf08` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:25.658817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc350fcb3ec84611a16fa2c2c84ddf08)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:25.660949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:25.701097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:06:25.718272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc350fcb3ec84611a16fa2c2c84ddf08', 'request_id': 'req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:25.723920 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc350fcb3ec84611a16fa2c2c84ddf08', 'request_id': 'req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:25.732668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc350fcb3ec84611a16fa2c2c84ddf08', 'request_id': 'req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:25.745263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] The token cache is being invalidate because project fc350fcb3ec84611a16fa2c2c84ddf08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:06:25.745581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:25.746243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:25.748036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1181/2374] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:06:25 2022] DELETE /identity/v3/projects/fc350fcb3ec84611a16fa2c2c84ddf08 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:06:27.619504 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41145c3a-38f1-4d6b-a6d9-cdd076adf4db None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:27.620032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41145c3a-38f1-4d6b-a6d9-cdd076adf4db None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:27.620032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41145c3a-38f1-4d6b-a6d9-cdd076adf4db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:27.638837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-41145c3a-38f1-4d6b-a6d9-cdd076adf4db None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:06:27.640021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-41145c3a-38f1-4d6b-a6d9-cdd076adf4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:27.699324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1194/2375] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 1 12:06:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:06:27.727985 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:27.729489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:27.803259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8735d7f0-e1c2-43c4-9b00-a3b80453c81d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:27.808759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb14cd-862c-45fd-aa8b-49a4fcdfe135 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:27.809408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb14cd-862c-45fd-aa8b-49a4fcdfe135 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:27.809698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb14cd-862c-45fd-aa8b-49a4fcdfe135 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:27.809966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb14cd-862c-45fd-aa8b-49a4fcdfe135 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:27.818040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb14cd-862c-45fd-aa8b-49a4fcdfe135 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:27.819620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fb14cd-862c-45fd-aa8b-49a4fcdfe135 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:27.830657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1182/2376] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:06:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:06:30.754672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41145c3a-38f1-4d6b-a6d9-cdd076adf4db None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:30.756146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-41145c3a-38f1-4d6b-a6d9-cdd076adf4db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:30.767879 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41145c3a-38f1-4d6b-a6d9-cdd076adf4db None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:30.772989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:30.773998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:30.774301 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:30.774577 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] PATH_INFO: `/v3/users/f5d76151f6364c7d8091396a41d2a44a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:30.775757 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5d76151f6364c7d8091396a41d2a44a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:30.777714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:30.832536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5d76151f6364c7d8091396a41d2a44a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:30.843258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5d76151f6364c7d8091396a41d2a44a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:30.855572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5d76151f6364c7d8091396a41d2a44a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:30.856258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5d76151f6364c7d8091396a41d2a44a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:30.863238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5d76151f6364c7d8091396a41d2a44a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:30.869563 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1195/2377] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:06:30 2022] DELETE /identity/v3/users/f5d76151f6364c7d8091396a41d2a44a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:06:30.874064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e873a-ca9d-45d8-8549-be376997a727 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:30.874519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e873a-ca9d-45d8-8549-be376997a727 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:30.874644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e873a-ca9d-45d8-8549-be376997a727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:30.895056 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0d0e873a-ca9d-45d8-8549-be376997a727 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:06:30.896647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0d0e873a-ca9d-45d8-8549-be376997a727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:30.958097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1183/2378] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:06:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:06:30.967863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:30.969545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:31.031111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de73c729-7a7b-4f9d-ae08-791c556b0ff0 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:31.034826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9025a-0000-4b9f-820f-8733f9d7f99a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:31.035445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9025a-0000-4b9f-820f-8733f9d7f99a service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:31.035723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9025a-0000-4b9f-820f-8733f9d7f99a service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:31.035997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff9025a-0000-4b9f-820f-8733f9d7f99a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:31.045548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9025a-0000-4b9f-820f-8733f9d7f99a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:31.046965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff9025a-0000-4b9f-820f-8733f9d7f99a service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:31.059577 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1196/2379] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:06:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:06:31.355618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e873a-ca9d-45d8-8549-be376997a727 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:31.357101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0d0e873a-ca9d-45d8-8549-be376997a727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:31.370102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e873a-ca9d-45d8-8549-be376997a727 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:31.374949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef2e8ef-5dff-47d9-af30-f412cae757cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:31.375588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2e8ef-5dff-47d9-af30-f412cae757cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:31.375867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2e8ef-5dff-47d9-af30-f412cae757cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:31.376139 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef2e8ef-5dff-47d9-af30-f412cae757cc admin admin] PATH_INFO: `/v3/projects/faa404ec295d44d4bb063a15d8d8c85f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:31.377349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2e8ef-5dff-47d9-af30-f412cae757cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=faa404ec295d44d4bb063a15d8d8c85f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:31.379844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef2e8ef-5dff-47d9-af30-f412cae757cc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:31.422571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:06:31.433424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7ef2e8ef-5dff-47d9-af30-f412cae757cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faa404ec295d44d4bb063a15d8d8c85f', 'request_id': 'req-7ef2e8ef-5dff-47d9-af30-f412cae757cc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:31.439202 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7ef2e8ef-5dff-47d9-af30-f412cae757cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faa404ec295d44d4bb063a15d8d8c85f', 'request_id': 'req-7ef2e8ef-5dff-47d9-af30-f412cae757cc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:31.446439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7ef2e8ef-5dff-47d9-af30-f412cae757cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faa404ec295d44d4bb063a15d8d8c85f', 'request_id': 'req-7ef2e8ef-5dff-47d9-af30-f412cae757cc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:31.457560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7ef2e8ef-5dff-47d9-af30-f412cae757cc admin admin] The token cache is being invalidate because project faa404ec295d44d4bb063a15d8d8c85f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:06:31.457869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7ef2e8ef-5dff-47d9-af30-f412cae757cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:31.458484 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7ef2e8ef-5dff-47d9-af30-f412cae757cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:06:31.460028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1184/2380] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:06:31 2022] DELETE /identity/v3/projects/faa404ec295d44d4bb063a15d8d8c85f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:06:40.688075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9025a-0000-4b9f-820f-8733f9d7f99a service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:40.689571 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-aff9025a-0000-4b9f-820f-8733f9d7f99a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:40.696636 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:06:40.760255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff9025a-0000-4b9f-820f-8733f9d7f99a service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:40.817731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23db592-fd3d-4580-b623-a5bf7f0c2f5c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:40.818276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db592-fd3d-4580-b623-a5bf7f0c2f5c service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:40.818560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db592-fd3d-4580-b623-a5bf7f0c2f5c service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:40.818831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23db592-fd3d-4580-b623-a5bf7f0c2f5c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:40.820584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a23db592-fd3d-4580-b623-a5bf7f0c2f5c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:40.832023 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23db592-fd3d-4580-b623-a5bf7f0c2f5c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:40.833692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23db592-fd3d-4580-b623-a5bf7f0c2f5c service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:40.843336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1197/2381] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:06:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:06:41.454557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=11,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:06:46.969630 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c83aa-80fd-4850-a4eb-a6f42e37c313 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:46.970228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c83aa-80fd-4850-a4eb-a6f42e37c313 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:46.970228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c83aa-80fd-4850-a4eb-a6f42e37c313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:46.990949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f53c83aa-80fd-4850-a4eb-a6f42e37c313 None None] MFA Rules not processed for user `ab917ef751d8403aa41d25e5c5e6c465`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:06:46.992151 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f53c83aa-80fd-4850-a4eb-a6f42e37c313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:47.045728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1185/2382] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:06:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:06:48.308806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd4bc6-78bc-4457-b813-e8b7c2c007ad None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:48.309243 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd4bc6-78bc-4457-b813-e8b7c2c007ad None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:48.309456 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd4bc6-78bc-4457-b813-e8b7c2c007ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:48.328082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f7dd4bc6-78bc-4457-b813-e8b7c2c007ad None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:06:48.329323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f7dd4bc6-78bc-4457-b813-e8b7c2c007ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:48.388200 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1198/2383] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:06:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:06:48.437926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c83aa-80fd-4850-a4eb-a6f42e37c313 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:06:48.439457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f53c83aa-80fd-4850-a4eb-a6f42e37c313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:06:48.516840 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c83aa-80fd-4850-a4eb-a6f42e37c313 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:06:48.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d76e0-c0c6-4369-9da2-9cf48155c4ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:06:48.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d76e0-c0c6-4369-9da2-9cf48155c4ab service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:06:48.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d76e0-c0c6-4369-9da2-9cf48155c4ab service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:06:48.523787 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d76e0-c0c6-4369-9da2-9cf48155c4ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:06:48.534552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d76e0-c0c6-4369-9da2-9cf48155c4ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:06:48.536778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d76e0-c0c6-4369-9da2-9cf48155c4ab service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:06:48.545890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1186/2384] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:06:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:06:58.381289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=81 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:06:58.542243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=57 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:07:06.255366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a33d5-e03f-4bea-be7b-57586b3cdbd4 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:06.256035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a33d5-e03f-4bea-be7b-57586b3cdbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:06.256035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0a33d5-e03f-4bea-be7b-57586b3cdbd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:06.278211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ce0a33d5-e03f-4bea-be7b-57586b3cdbd4 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:07:06.279445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ce0a33d5-e03f-4bea-be7b-57586b3cdbd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:06.342097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1199/2385] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 1 12:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:07:06.366132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d76e0-c0c6-4369-9da2-9cf48155c4ab service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:07:06.367451 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8a8d76e0-c0c6-4369-9da2-9cf48155c4ab service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:06.439068 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d76e0-c0c6-4369-9da2-9cf48155c4ab service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:07:06.444772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806735a6-1209-4c16-8159-cad44d93bed5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:07:06.445556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806735a6-1209-4c16-8159-cad44d93bed5 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:06.446036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806735a6-1209-4c16-8159-cad44d93bed5 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:06.446527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806735a6-1209-4c16-8159-cad44d93bed5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:06.455175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806735a6-1209-4c16-8159-cad44d93bed5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:07:06.456827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806735a6-1209-4c16-8159-cad44d93bed5 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:07:06.466922 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1187/2386] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:07:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:07:07.163269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded3da5-92a7-469b-be4d-dbc5df8a2da3 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:07.163560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded3da5-92a7-469b-be4d-dbc5df8a2da3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:07.163865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded3da5-92a7-469b-be4d-dbc5df8a2da3 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:07.165278 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1200/2387] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 12:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:07:07.175766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de6af-3453-47b1-855d-ca2e48f8a93a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:07.176105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de6af-3453-47b1-855d-ca2e48f8a93a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:07.176378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155de6af-3453-47b1-855d-ca2e48f8a93a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:07.195986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-155de6af-3453-47b1-855d-ca2e48f8a93a None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:07:07.197176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-155de6af-3453-47b1-855d-ca2e48f8a93a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:07.206260 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1188/2388] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 12:07:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:07:07.218225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded3da5-92a7-469b-be4d-dbc5df8a2da3 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:07:07.219987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1ded3da5-92a7-469b-be4d-dbc5df8a2da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:07.283116 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded3da5-92a7-469b-be4d-dbc5df8a2da3 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:07:07.286721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5a731a-77dd-4bce-9478-1f8c2124496f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c358a2d9539c4ae2a5e12aa6f1ed6d61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:07:07.287340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a731a-77dd-4bce-9478-1f8c2124496f service glance] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:07.287615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a731a-77dd-4bce-9478-1f8c2124496f service glance] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:07.287884 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5a731a-77dd-4bce-9478-1f8c2124496f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:07.298724 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a731a-77dd-4bce-9478-1f8c2124496f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:07:07.303458 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5a731a-77dd-4bce-9478-1f8c2124496f service glance] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:07:07.311436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1201/2389] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:07:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:07:07.379645 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090a3a7-27ff-490e-b298-65efb50d1f8d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:07.380142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090a3a7-27ff-490e-b298-65efb50d1f8d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:07.380142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e090a3a7-27ff-490e-b298-65efb50d1f8d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:07.381493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1189/2390] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 12:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:07:07.386120 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e819-ad2f-4202-8d51-88b08732bd70 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:07.386411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e819-ad2f-4202-8d51-88b08732bd70 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:07.386716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6e819-ad2f-4202-8d51-88b08732bd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:07.406554 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-73c6e819-ad2f-4202-8d51-88b08732bd70 None None] MFA Rules not processed for user `a2afb18a441549e3b853966ea1ad286e`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:07:07.407747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-73c6e819-ad2f-4202-8d51-88b08732bd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:07.457239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1202/2391] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 12:07:07 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:07:07.469548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090a3a7-27ff-490e-b298-65efb50d1f8d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:07:07.471217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e090a3a7-27ff-490e-b298-65efb50d1f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:07.484114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e090a3a7-27ff-490e-b298-65efb50d1f8d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:07:07.487703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17ee905-0274-404f-9ac1-f27d74644138 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:07:07.488300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ee905-0274-404f-9ac1-f27d74644138 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:07.488576 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ee905-0274-404f-9ac1-f27d74644138 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:07.488842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17ee905-0274-404f-9ac1-f27d74644138 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:07.496178 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ee905-0274-404f-9ac1-f27d74644138 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:07:07.497805 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17ee905-0274-404f-9ac1-f27d74644138 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:07:07.506811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1190/2392] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:07:07 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:07:07.595900 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ada427-58eb-40e8-8d52-f4bb45f7707d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:07.596189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ada427-58eb-40e8-8d52-f4bb45f7707d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:07.596465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ada427-58eb-40e8-8d52-f4bb45f7707d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:07.597892 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1203/2393] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 12:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:07:07.602935 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e94b-37a7-4fa3-9939-ffc7db4caea7 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:07.603220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e94b-37a7-4fa3-9939-ffc7db4caea7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:07.603492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c696e94b-37a7-4fa3-9939-ffc7db4caea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:07.625944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c696e94b-37a7-4fa3-9939-ffc7db4caea7 None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:07:07.627162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c696e94b-37a7-4fa3-9939-ffc7db4caea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:07.637072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1191/2394] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 12:07:07 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:07:07.647407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ada427-58eb-40e8-8d52-f4bb45f7707d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:07:07.658200 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ada427-58eb-40e8-8d52-f4bb45f7707d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:07:07.661791 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2fb93-6de6-4547-8697-3115f619378f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:07:07.662387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2fb93-6de6-4547-8697-3115f619378f service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:07.662664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2fb93-6de6-4547-8697-3115f619378f service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:07.662934 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad2fb93-6de6-4547-8697-3115f619378f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:07.672854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2fb93-6de6-4547-8697-3115f619378f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:07:07.674295 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad2fb93-6de6-4547-8697-3115f619378f service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:07:07.685532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1204/2395] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:07:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:07:10.557450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66396179-d264-4687-8baa-c3d86c9ad83a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:10.558007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66396179-d264-4687-8baa-c3d86c9ad83a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:10.558007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66396179-d264-4687-8baa-c3d86c9ad83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:10.577500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-66396179-d264-4687-8baa-c3d86c9ad83a None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:07:10.578733 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-66396179-d264-4687-8baa-c3d86c9ad83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:10.586554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1192/2396] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 1 12:07:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:07:10.608778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2fb93-6de6-4547-8697-3115f619378f service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:07:10.610268 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5ad2fb93-6de6-4547-8697-3115f619378f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:10.625797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad2fb93-6de6-4547-8697-3115f619378f service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:07:10.631582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7aaf7-994c-497b-89fd-0d43fefc5f05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:07:10.632056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7aaf7-994c-497b-89fd-0d43fefc5f05 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:10.632330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7aaf7-994c-497b-89fd-0d43fefc5f05 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:10.632745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb7aaf7-994c-497b-89fd-0d43fefc5f05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:10.642090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7aaf7-994c-497b-89fd-0d43fefc5f05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:07:10.643799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb7aaf7-994c-497b-89fd-0d43fefc5f05 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:07:10.654256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1205/2397] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:07:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:07:11.759704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bce00c-67d8-4798-bc37-e6385e075a08 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:11.760152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bce00c-67d8-4798-bc37-e6385e075a08 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:11.760249 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bce00c-67d8-4798-bc37-e6385e075a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:11.779533 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-22bce00c-67d8-4798-bc37-e6385e075a08 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:07:11.780833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-22bce00c-67d8-4798-bc37-e6385e075a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:11.788650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1193/2398] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:07:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:07:11.800409 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7aaf7-994c-497b-89fd-0d43fefc5f05 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:07:11.812195 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb7aaf7-994c-497b-89fd-0d43fefc5f05 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:07:11.817141 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59510dc-18f0-49d8-bea7-8006acc3c0d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:07:11.817764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59510dc-18f0-49d8-bea7-8006acc3c0d7 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:11.818047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59510dc-18f0-49d8-bea7-8006acc3c0d7 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:11.818318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59510dc-18f0-49d8-bea7-8006acc3c0d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:11.826383 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59510dc-18f0-49d8-bea7-8006acc3c0d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:07:11.827943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59510dc-18f0-49d8-bea7-8006acc3c0d7 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:07:11.835836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1206/2399] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:07:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:07:21.774309 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=52 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:07:21.833002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=94 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:07:29.093363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a886d4c-4e35-4749-9883-91163dfd22ef None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:29.093904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a886d4c-4e35-4749-9883-91163dfd22ef None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:29.093904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a886d4c-4e35-4749-9883-91163dfd22ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:29.112669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7a886d4c-4e35-4749-9883-91163dfd22ef None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:07:29.113877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7a886d4c-4e35-4749-9883-91163dfd22ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:29.121857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1194/2400] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 1 12:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:07:29.142309 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59510dc-18f0-49d8-bea7-8006acc3c0d7 service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:07:29.154574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59510dc-18f0-49d8-bea7-8006acc3c0d7 service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:07:29.159975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406b316-fc16-4035-8a47-46c74cc33fe7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:07:29.160640 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406b316-fc16-4035-8a47-46c74cc33fe7 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:29.160917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406b316-fc16-4035-8a47-46c74cc33fe7 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:29.161187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5406b316-fc16-4035-8a47-46c74cc33fe7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:29.169129 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406b316-fc16-4035-8a47-46c74cc33fe7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:07:29.170729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5406b316-fc16-4035-8a47-46c74cc33fe7 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:07:29.180022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1207/2401] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:07:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:07:36.369395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4065a4d-514e-4fef-94bc-c5aa5b1110aa None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:36.369917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4065a4d-514e-4fef-94bc-c5aa5b1110aa None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:36.369917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4065a4d-514e-4fef-94bc-c5aa5b1110aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:36.388914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f4065a4d-514e-4fef-94bc-c5aa5b1110aa None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:07:36.390163 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f4065a4d-514e-4fef-94bc-c5aa5b1110aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:36.398336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1195/2402] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 1 12:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:07:36.423520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406b316-fc16-4035-8a47-46c74cc33fe7 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:07:36.434390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5406b316-fc16-4035-8a47-46c74cc33fe7 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:07:36.439802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21530853-0a70-49e6-953d-bda5e5867e17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:07:36.440393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21530853-0a70-49e6-953d-bda5e5867e17 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:36.440669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21530853-0a70-49e6-953d-bda5e5867e17 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:36.440933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21530853-0a70-49e6-953d-bda5e5867e17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:36.448874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21530853-0a70-49e6-953d-bda5e5867e17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:07:36.450471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21530853-0a70-49e6-953d-bda5e5867e17 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:07:36.460135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1208/2403] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:07:39.568836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce059f-67a6-49e2-922d-f6cf8f8d3854 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:39.569367 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce059f-67a6-49e2-922d-f6cf8f8d3854 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:39.569454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bce059f-67a6-49e2-922d-f6cf8f8d3854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:39.589211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6bce059f-67a6-49e2-922d-f6cf8f8d3854 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:07:39.590490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6bce059f-67a6-49e2-922d-f6cf8f8d3854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:39.598625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1196/2404] 10.222.0.42 () {58 vars in 967 bytes} [Mon Aug 1 12:07:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:07:39.610645 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21530853-0a70-49e6-953d-bda5e5867e17 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:07:39.622081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21530853-0a70-49e6-953d-bda5e5867e17 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:07:39.627027 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311447d-09e4-4c1b-89f6-ff9457625db5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:07:39.627625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311447d-09e4-4c1b-89f6-ff9457625db5 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:39.627898 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311447d-09e4-4c1b-89f6-ff9457625db5 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:39.628171 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5311447d-09e4-4c1b-89f6-ff9457625db5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:39.637002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311447d-09e4-4c1b-89f6-ff9457625db5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:07:39.638618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5311447d-09e4-4c1b-89f6-ff9457625db5 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:07:39.648490 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1209/2405] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:07:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:07:41.600454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2703c0-83f6-44aa-9926-5d9ce4eeb098 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:41.600947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2703c0-83f6-44aa-9926-5d9ce4eeb098 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:41.601059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2703c0-83f6-44aa-9926-5d9ce4eeb098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:41.620667 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0e2703c0-83f6-44aa-9926-5d9ce4eeb098 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:07:41.621907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0e2703c0-83f6-44aa-9926-5d9ce4eeb098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:07:41.630477 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1197/2406] 10.222.0.36 () {58 vars in 1016 bytes} [Mon Aug 1 12:07:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:07:41.659143 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311447d-09e4-4c1b-89f6-ff9457625db5 service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:07:41.671237 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5311447d-09e4-4c1b-89f6-ff9457625db5 service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:07:41.677256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0c797-29d9-48ea-961f-a85f18c43e21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:07:41.677887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c797-29d9-48ea-961f-a85f18c43e21 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:07:41.678166 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c797-29d9-48ea-961f-a85f18c43e21 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:07:41.678439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a0c797-29d9-48ea-961f-a85f18c43e21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:07:41.686527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0c797-29d9-48ea-961f-a85f18c43e21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:07:41.688102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a0c797-29d9-48ea-961f-a85f18c43e21 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:07:41.698168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1210/2407] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:07:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:07:51.615377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=12 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:07:51.694036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=24 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:08:01.183196 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16511261-2269-4888-9824-4a5512a6c19a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:08:01.183722 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16511261-2269-4888-9824-4a5512a6c19a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:08:01.183722 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16511261-2269-4888-9824-4a5512a6c19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:08:01.202154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-16511261-2269-4888-9824-4a5512a6c19a None None] MFA Rules not processed for user `10f497bc876d4aa7b4ff9119d618b25a`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:08:01.203337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-16511261-2269-4888-9824-4a5512a6c19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:01.256881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1198/2408] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:08:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:08:11.250045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=25 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:08:14.837029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0c797-29d9-48ea-961f-a85f18c43e21 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:08:14.838536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-56a0c797-29d9-48ea-961f-a85f18c43e21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:14.853869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a0c797-29d9-48ea-961f-a85f18c43e21 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:08:14.859077 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:08:14.859734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:08:14.860011 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:08:14.860285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] PATH_INFO: `/v3/users/ab917ef751d8403aa41d25e5c5e6c465` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:08:14.862136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab917ef751d8403aa41d25e5c5e6c465)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:08:14.864152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:08:14.911424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab917ef751d8403aa41d25e5c5e6c465'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:08:14.917833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab917ef751d8403aa41d25e5c5e6c465'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:08:14.929468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab917ef751d8403aa41d25e5c5e6c465'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:08:14.930092 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab917ef751d8403aa41d25e5c5e6c465'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:08:14.936780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab917ef751d8403aa41d25e5c5e6c465'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:08:14.942541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1211/2409] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:08:14 2022] DELETE /identity/v3/users/ab917ef751d8403aa41d25e5c5e6c465 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:08:15.125327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16511261-2269-4888-9824-4a5512a6c19a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:08:15.136656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16511261-2269-4888-9824-4a5512a6c19a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:08:15.199598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:08:15.200239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:08:15.200513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:08:15.200784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] PATH_INFO: `/v3/projects/47cae094391f496484250c2e1abedb90` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:08:15.201952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=47cae094391f496484250c2e1abedb90)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:08:15.204128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:08:15.249327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47cae094391f496484250c2e1abedb90', 'request_id': 'req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:08:15.255339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47cae094391f496484250c2e1abedb90', 'request_id': 'req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:08:15.263250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47cae094391f496484250c2e1abedb90', 'request_id': 'req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:08:15.274911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] The token cache is being invalidate because project 47cae094391f496484250c2e1abedb90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:08:15.275194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:08:15.275824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:08:15.277533 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1199/2410] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:08:15 2022] DELETE /identity/v3/projects/47cae094391f496484250c2e1abedb90 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:08:22.552363 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:08:22.553809 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:22.610835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaf0b2-0ae1-46a0-81ee-95c75de3f131 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:08:22.658508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018de6f-507b-41a2-bbff-22f69ec68a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:08:22.659054 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018de6f-507b-41a2-bbff-22f69ec68a99 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:08:22.659331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018de6f-507b-41a2-bbff-22f69ec68a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:08:22.659599 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9018de6f-507b-41a2-bbff-22f69ec68a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:08:22.661337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9018de6f-507b-41a2-bbff-22f69ec68a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:22.702323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:08:22.732853 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018de6f-507b-41a2-bbff-22f69ec68a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:08:22.734319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9018de6f-507b-41a2-bbff-22f69ec68a99 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:08:22.745424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1212/2411] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:08:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:08:23.919971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:08:23.921536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:23.934285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f6983-4ea8-4dcb-aa01-b2b51d816bbe admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:08:23.937831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055cd8f8-f2b8-4c23-a5e0-b5653b470130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:08:23.938439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cd8f8-f2b8-4c23-a5e0-b5653b470130 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:08:23.938719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cd8f8-f2b8-4c23-a5e0-b5653b470130 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:08:23.938991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055cd8f8-f2b8-4c23-a5e0-b5653b470130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:08:23.940652 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-055cd8f8-f2b8-4c23-a5e0-b5653b470130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:23.953615 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cd8f8-f2b8-4c23-a5e0-b5653b470130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:08:23.955060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055cd8f8-f2b8-4c23-a5e0-b5653b470130 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:08:23.966311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1200/2412] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:08:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:08:32.740329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=14 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:08:33.961055 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:08:47.329608 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018de6f-507b-41a2-bbff-22f69ec68a99 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:08:47.331411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9018de6f-507b-41a2-bbff-22f69ec68a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:47.346277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9018de6f-507b-41a2-bbff-22f69ec68a99 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:08:47.351837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fca0cf-3889-4252-93dd-239a13a72890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:08:47.353083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fca0cf-3889-4252-93dd-239a13a72890 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:08:47.353397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fca0cf-3889-4252-93dd-239a13a72890 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:08:47.353670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fca0cf-3889-4252-93dd-239a13a72890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:08:47.355382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-12fca0cf-3889-4252-93dd-239a13a72890 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:47.411642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fca0cf-3889-4252-93dd-239a13a72890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:08:47.413168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fca0cf-3889-4252-93dd-239a13a72890 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:08:47.422773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1213/2413] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:08:47 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:08:55.674077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3569f-cdd2-48b0-a681-8e962cab62d2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:08:55.674588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3569f-cdd2-48b0-a681-8e962cab62d2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:08:55.674588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3569f-cdd2-48b0-a681-8e962cab62d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:08:55.693971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9da3569f-cdd2-48b0-a681-8e962cab62d2 None None] MFA Rules not processed for user `ea32636c7dbc4cb586e8b9021218b8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:08:55.695175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9da3569f-cdd2-48b0-a681-8e962cab62d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:55.702737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1201/2414] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:08:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:08:55.999688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fca0cf-3889-4252-93dd-239a13a72890 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:08:56.008911 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fca0cf-3889-4252-93dd-239a13a72890 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:08:56.012497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e475d41-03f4-4daa-800e-604aff13fd46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:08:56.013097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e475d41-03f4-4daa-800e-604aff13fd46 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:08:56.013405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e475d41-03f4-4daa-800e-604aff13fd46 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:08:56.013682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e475d41-03f4-4daa-800e-604aff13fd46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:08:56.015398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2e475d41-03f4-4daa-800e-604aff13fd46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:56.024615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e475d41-03f4-4daa-800e-604aff13fd46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:08:56.026110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e475d41-03f4-4daa-800e-604aff13fd46 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:08:56.033921 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1214/2415] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:08:55 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:08:56.364459 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3569f-cdd2-48b0-a681-8e962cab62d2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:08:56.366122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9da3569f-cdd2-48b0-a681-8e962cab62d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:56.439069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3569f-cdd2-48b0-a681-8e962cab62d2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:08:56.444074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266d504-5ee6-43bf-825d-627a40592be6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:08:56.444690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266d504-5ee6-43bf-825d-627a40592be6 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:08:56.444971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266d504-5ee6-43bf-825d-627a40592be6 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:08:56.445244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266d504-5ee6-43bf-825d-627a40592be6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:08:56.447063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7266d504-5ee6-43bf-825d-627a40592be6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:56.458154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266d504-5ee6-43bf-825d-627a40592be6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:08:56.459743 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266d504-5ee6-43bf-825d-627a40592be6 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:08:56.470029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1202/2416] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:08:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:08:58.393390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e475d41-03f4-4daa-800e-604aff13fd46 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:08:58.404102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e475d41-03f4-4daa-800e-604aff13fd46 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:08:58.409004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9e640-b649-453d-83f2-aea434f07103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:08:58.409853 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9e640-b649-453d-83f2-aea434f07103 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:08:58.410138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9e640-b649-453d-83f2-aea434f07103 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:08:58.410406 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a9e640-b649-453d-83f2-aea434f07103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:08:58.412477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-34a9e640-b649-453d-83f2-aea434f07103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:08:58.422735 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9e640-b649-453d-83f2-aea434f07103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:08:58.424183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a9e640-b649-453d-83f2-aea434f07103 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:08:58.433831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1215/2417] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:08:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:09:06.465885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=35 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:09:08.429164 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=40 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:09:09.353789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266d504-5ee6-43bf-825d-627a40592be6 service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:09.366259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266d504-5ee6-43bf-825d-627a40592be6 service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:09.371878 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff9c11-70b3-459a-a09e-c1648cf321c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:09.372492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9c11-70b3-459a-a09e-c1648cf321c7 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:09.372772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9c11-70b3-459a-a09e-c1648cf321c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:09.373038 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cff9c11-70b3-459a-a09e-c1648cf321c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:09.374868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2cff9c11-70b3-459a-a09e-c1648cf321c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:09.387795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9c11-70b3-459a-a09e-c1648cf321c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:09.389404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cff9c11-70b3-459a-a09e-c1648cf321c7 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:09.400042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1203/2418] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:09:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:09:14.143638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9e640-b649-453d-83f2-aea434f07103 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:14.145029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-34a9e640-b649-453d-83f2-aea434f07103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:14.200915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a9e640-b649-453d-83f2-aea434f07103 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:14.204417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1784e0-4fc9-4c53-adba-2f3b587bcdf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:14.205019 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1784e0-4fc9-4c53-adba-2f3b587bcdf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:14.205309 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1784e0-4fc9-4c53-adba-2f3b587bcdf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:14.205593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1784e0-4fc9-4c53-adba-2f3b587bcdf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:14.207297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ed1784e0-4fc9-4c53-adba-2f3b587bcdf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:14.264657 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1784e0-4fc9-4c53-adba-2f3b587bcdf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:14.266110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1784e0-4fc9-4c53-adba-2f3b587bcdf3 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:14.274933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1216/2419] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:09:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:09:19.395373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:09:24.270861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=48 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:09:32.422037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff9c11-70b3-459a-a09e-c1648cf321c7 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:32.423374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2cff9c11-70b3-459a-a09e-c1648cf321c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:32.435613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cff9c11-70b3-459a-a09e-c1648cf321c7 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:32.440261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365e9f7-1e19-43fb-8b71-fc8218cb7915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:32.440863 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365e9f7-1e19-43fb-8b71-fc8218cb7915 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:32.441223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365e9f7-1e19-43fb-8b71-fc8218cb7915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:32.441484 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d365e9f7-1e19-43fb-8b71-fc8218cb7915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:32.443341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d365e9f7-1e19-43fb-8b71-fc8218cb7915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:32.506741 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365e9f7-1e19-43fb-8b71-fc8218cb7915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:32.508345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d365e9f7-1e19-43fb-8b71-fc8218cb7915 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:32.518494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1204/2420] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:09:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:09:33.237630 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1784e0-4fc9-4c53-adba-2f3b587bcdf3 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:33.247846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1784e0-4fc9-4c53-adba-2f3b587bcdf3 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:33.251426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91a5a9-87fc-49bc-97c4-da4eca3b758c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:33.252031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91a5a9-87fc-49bc-97c4-da4eca3b758c service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:33.252310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91a5a9-87fc-49bc-97c4-da4eca3b758c service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:33.252586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf91a5a9-87fc-49bc-97c4-da4eca3b758c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:33.254333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bf91a5a9-87fc-49bc-97c4-da4eca3b758c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:33.319334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91a5a9-87fc-49bc-97c4-da4eca3b758c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:33.320775 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf91a5a9-87fc-49bc-97c4-da4eca3b758c service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:33.330381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1217/2421] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:09:37.056879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365e9f7-1e19-43fb-8b71-fc8218cb7915 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:37.059720 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d365e9f7-1e19-43fb-8b71-fc8218cb7915 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:37.076618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d365e9f7-1e19-43fb-8b71-fc8218cb7915 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:37.082515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbaed79-e935-4301-b65d-d0aa3019b38e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:37.083084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaed79-e935-4301-b65d-d0aa3019b38e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:37.083368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaed79-e935-4301-b65d-d0aa3019b38e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:37.083644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbaed79-e935-4301-b65d-d0aa3019b38e admin admin] PATH_INFO: `/v3/users/10f497bc876d4aa7b4ff9119d618b25a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:37.084811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbaed79-e935-4301-b65d-d0aa3019b38e admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f497bc876d4aa7b4ff9119d618b25a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:37.086793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbaed79-e935-4301-b65d-d0aa3019b38e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:37.138053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0dbaed79-e935-4301-b65d-d0aa3019b38e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f497bc876d4aa7b4ff9119d618b25a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:09:37.138714 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0dbaed79-e935-4301-b65d-d0aa3019b38e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f497bc876d4aa7b4ff9119d618b25a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:09:37.151038 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0dbaed79-e935-4301-b65d-d0aa3019b38e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f497bc876d4aa7b4ff9119d618b25a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:09:37.158005 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0dbaed79-e935-4301-b65d-d0aa3019b38e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f497bc876d4aa7b4ff9119d618b25a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:09:37.167223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0dbaed79-e935-4301-b65d-d0aa3019b38e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f497bc876d4aa7b4ff9119d618b25a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:09:37.174481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1205/2422] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:09:37 2022] DELETE /identity/v3/users/10f497bc876d4aa7b4ff9119d618b25a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:09:37.405664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91a5a9-87fc-49bc-97c4-da4eca3b758c service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:37.419204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf91a5a9-87fc-49bc-97c4-da4eca3b758c service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:37.493482 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:37.494118 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:37.494392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:37.494661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3 admin admin] PATH_INFO: `/v3/projects/3e89187fec5a40298d863d417a4a20f5` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:37.495836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e89187fec5a40298d863d417a4a20f5)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:37.497851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:37.546965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e89187fec5a40298d863d417a4a20f5', 'request_id': 'req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:09:37.552848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e89187fec5a40298d863d417a4a20f5', 'request_id': 'req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:09:37.559450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e89187fec5a40298d863d417a4a20f5', 'request_id': 'req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:09:37.571387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3 admin admin] The token cache is being invalidate because project 3e89187fec5a40298d863d417a4a20f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:09:37.571574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:09:37.572287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6ff269ec-5071-45d9-910e-e9eb0dbe12f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:09:37.573940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1218/2423] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:09:37 2022] DELETE /identity/v3/projects/3e89187fec5a40298d863d417a4a20f5 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:09:37.584709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394800d-6611-4326-be80-6f5d664e5821 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:37.584972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394800d-6611-4326-be80-6f5d664e5821 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:37.585199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c394800d-6611-4326-be80-6f5d664e5821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:37.605181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c394800d-6611-4326-be80-6f5d664e5821 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:09:37.607223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c394800d-6611-4326-be80-6f5d664e5821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:37.670222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1206/2424] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:09:37.678218 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289305c-7b93-49de-bf38-d4e6a4812b54 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:37.678517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289305c-7b93-49de-bf38-d4e6a4812b54 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:37.678955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289305c-7b93-49de-bf38-d4e6a4812b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:37.704776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e289305c-7b93-49de-bf38-d4e6a4812b54 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:09:37.706125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e289305c-7b93-49de-bf38-d4e6a4812b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:37.714168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1219/2425] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:09:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:09:37.719187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394800d-6611-4326-be80-6f5d664e5821 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:37.731355 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c394800d-6611-4326-be80-6f5d664e5821 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:37.736138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f4f93-8c6e-49c6-91ad-da591f14607b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:37.736781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f4f93-8c6e-49c6-91ad-da591f14607b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:37.737018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f4f93-8c6e-49c6-91ad-da591f14607b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:37.737287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2f4f93-8c6e-49c6-91ad-da591f14607b admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:37.737996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f4f93-8c6e-49c6-91ad-da591f14607b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:09:37.738300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f4f93-8c6e-49c6-91ad-da591f14607b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:37.739914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2f4f93-8c6e-49c6-91ad-da591f14607b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:37.747336 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:09:37.757504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1207/2426] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 12:09:37.758944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289305c-7b93-49de-bf38-d4e6a4812b54 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:37.769111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289305c-7b93-49de-bf38-d4e6a4812b54 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:37.774157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcce702-f082-47be-a25c-19257fa8be70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:37.775243 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcce702-f082-47be-a25c-19257fa8be70 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:37.775525 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcce702-f082-47be-a25c-19257fa8be70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:37.775793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcce702-f082-47be-a25c-19257fa8be70 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:37.776461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcce702-f082-47be-a25c-19257fa8be70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:37.779014 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcce702-f082-47be-a25c-19257fa8be70 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:37.796094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:09:37.811629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1220/2427] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:09:37 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:09:37.815490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f4f93-8c6e-49c6-91ad-da591f14607b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:37.826187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2f4f93-8c6e-49c6-91ad-da591f14607b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:37.890827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4473b4-d1f6-467e-85c0-2226bb5b2780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:37.891538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4473b4-d1f6-467e-85c0-2226bb5b2780 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:37.891819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4473b4-d1f6-467e-85c0-2226bb5b2780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:37.892097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4473b4-d1f6-467e-85c0-2226bb5b2780 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:37.892818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4473b4-d1f6-467e-85c0-2226bb5b2780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:37.894791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4473b4-d1f6-467e-85c0-2226bb5b2780 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:37.918297 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1208/2428] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:09:37 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:09:37.922328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcce702-f082-47be-a25c-19257fa8be70 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:37.932899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcce702-f082-47be-a25c-19257fa8be70 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:37.937940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576d829-f2f8-483e-b3d9-c3dcc70485bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:37.938556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576d829-f2f8-483e-b3d9-c3dcc70485bc admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:37.938842 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576d829-f2f8-483e-b3d9-c3dcc70485bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:37.939131 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4576d829-f2f8-483e-b3d9-c3dcc70485bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:37.939978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576d829-f2f8-483e-b3d9-c3dcc70485bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:37.941642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4576d829-f2f8-483e-b3d9-c3dcc70485bc admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:37.955300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1221/2429] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:09:37.956781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4473b4-d1f6-467e-85c0-2226bb5b2780 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:37.969035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4473b4-d1f6-467e-85c0-2226bb5b2780 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:37.973904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced9766-4ca3-4b78-ac14-6ca4001b18eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:37.974603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced9766-4ca3-4b78-ac14-6ca4001b18eb admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:37.974950 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced9766-4ca3-4b78-ac14-6ca4001b18eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:37.975294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced9766-4ca3-4b78-ac14-6ca4001b18eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:37.976059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced9766-4ca3-4b78-ac14-6ca4001b18eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:37.977865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced9766-4ca3-4b78-ac14-6ca4001b18eb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:37.992844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1209/2430] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:09:37 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:09:37.994104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576d829-f2f8-483e-b3d9-c3dcc70485bc admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:38.004295 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4576d829-f2f8-483e-b3d9-c3dcc70485bc admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:38.008927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62a455-00ac-4586-a2f1-65132ef2c791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:38.009618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62a455-00ac-4586-a2f1-65132ef2c791 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:38.009901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62a455-00ac-4586-a2f1-65132ef2c791 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:38.010176 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62a455-00ac-4586-a2f1-65132ef2c791 admin admin] PATH_INFO: `/v3/projects/dcbcd27d32ee4a459ab0f78ba4528cac/users/dbd9848e7862490491f206083cd59882/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:38.025773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62a455-00ac-4586-a2f1-65132ef2c791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbcd27d32ee4a459ab0f78ba4528cac, user_id=dbd9848e7862490491f206083cd59882, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:38.030369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f62a455-00ac-4586-a2f1-65132ef2c791 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:38.046683 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1222/2431] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:09:37 2022] PUT /identity/v3/projects/dcbcd27d32ee4a459ab0f78ba4528cac/users/dbd9848e7862490491f206083cd59882/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:09:38.056991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1501-639b-4121-9800-ce6dc62ec213 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:38.057494 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1501-639b-4121-9800-ce6dc62ec213 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:38.057591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c1501-639b-4121-9800-ce6dc62ec213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:38.087611 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-da6c1501-639b-4121-9800-ce6dc62ec213 None None] MFA Rules not processed for user `dbd9848e7862490491f206083cd59882`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:09:38.089003 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-da6c1501-639b-4121-9800-ce6dc62ec213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:38.153676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1210/2432] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:09:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:09:38.158239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62a455-00ac-4586-a2f1-65132ef2c791 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:38.222022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f62a455-00ac-4586-a2f1-65132ef2c791 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:38.227068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cdf9f-3560-44e9-b9d0-ba5b6fd8bebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:38.227690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cdf9f-3560-44e9-b9d0-ba5b6fd8bebe admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:38.227994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cdf9f-3560-44e9-b9d0-ba5b6fd8bebe admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:38.228269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462cdf9f-3560-44e9-b9d0-ba5b6fd8bebe admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:38.228954 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cdf9f-3560-44e9-b9d0-ba5b6fd8bebe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:38.230929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462cdf9f-3560-44e9-b9d0-ba5b6fd8bebe admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:38.258895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1223/2433] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:09:38 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:09:38.263693 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1501-639b-4121-9800-ce6dc62ec213 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:38.274130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c1501-639b-4121-9800-ce6dc62ec213 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:38.342327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e1ecf-e704-4828-b046-1b10a90c7682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:38.343164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e1ecf-e704-4828-b046-1b10a90c7682 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:38.343446 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e1ecf-e704-4828-b046-1b10a90c7682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:38.343720 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737e1ecf-e704-4828-b046-1b10a90c7682 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:38.344399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e1ecf-e704-4828-b046-1b10a90c7682 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:38.346369 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737e1ecf-e704-4828-b046-1b10a90c7682 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:38.359602 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:09:38.372977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1211/2434] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:09:38 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:09:38.376918 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cdf9f-3560-44e9-b9d0-ba5b6fd8bebe admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:38.388257 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462cdf9f-3560-44e9-b9d0-ba5b6fd8bebe admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:38.394260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6a386-8514-4eed-a5ae-8dda6e34ba57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:38.395178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a386-8514-4eed-a5ae-8dda6e34ba57 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:38.395328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a386-8514-4eed-a5ae-8dda6e34ba57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:38.395709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6a386-8514-4eed-a5ae-8dda6e34ba57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:38.396455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6a386-8514-4eed-a5ae-8dda6e34ba57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:38.398894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e6a386-8514-4eed-a5ae-8dda6e34ba57 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:38.411044 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1224/2435] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:09:38.415214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e1ecf-e704-4828-b046-1b10a90c7682 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:38.426439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737e1ecf-e704-4828-b046-1b10a90c7682 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:38.431270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a3646-6433-45e5-a761-7cc1b67da966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:38.431929 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a3646-6433-45e5-a761-7cc1b67da966 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:38.432280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a3646-6433-45e5-a761-7cc1b67da966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:38.432557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771a3646-6433-45e5-a761-7cc1b67da966 admin admin] PATH_INFO: `/v3/projects/5f8ae036512c47c2b11238a11e810e32/users/2cf1124b5fa8471489eb9b24a2ffca31/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:38.448169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a3646-6433-45e5-a761-7cc1b67da966 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8ae036512c47c2b11238a11e810e32, user_id=2cf1124b5fa8471489eb9b24a2ffca31, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:38.451462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771a3646-6433-45e5-a761-7cc1b67da966 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:38.464690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1212/2436] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:09:38 2022] PUT /identity/v3/projects/5f8ae036512c47c2b11238a11e810e32/users/2cf1124b5fa8471489eb9b24a2ffca31/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:09:38.469093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6a386-8514-4eed-a5ae-8dda6e34ba57 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:38.487519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e6a386-8514-4eed-a5ae-8dda6e34ba57 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:38.553564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac576d4-8450-4e6e-9dc0-9de71b871fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:38.554198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac576d4-8450-4e6e-9dc0-9de71b871fa2 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:38.554481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac576d4-8450-4e6e-9dc0-9de71b871fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:38.554757 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac576d4-8450-4e6e-9dc0-9de71b871fa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:38.555459 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac576d4-8450-4e6e-9dc0-9de71b871fa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:38.557086 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac576d4-8450-4e6e-9dc0-9de71b871fa2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:38.567864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1225/2437] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:09:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:09:38.572753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a3646-6433-45e5-a761-7cc1b67da966 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:38.585013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771a3646-6433-45e5-a761-7cc1b67da966 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:38.590562 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ef6b7-5042-42cb-881b-aa5e9184f43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:38.591294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ef6b7-5042-42cb-881b-aa5e9184f43b admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:38.591644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ef6b7-5042-42cb-881b-aa5e9184f43b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:38.591987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ef6b7-5042-42cb-881b-aa5e9184f43b admin admin] PATH_INFO: `/v3/projects/5f8ae036512c47c2b11238a11e810e32/users/2cf1124b5fa8471489eb9b24a2ffca31/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:38.594187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ef6b7-5042-42cb-881b-aa5e9184f43b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f8ae036512c47c2b11238a11e810e32, user_id=2cf1124b5fa8471489eb9b24a2ffca31, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:38.596895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ef6b7-5042-42cb-881b-aa5e9184f43b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:38.608831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1213/2438] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:09:38 2022] PUT /identity/v3/projects/5f8ae036512c47c2b11238a11e810e32/users/2cf1124b5fa8471489eb9b24a2ffca31/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:09:38.620384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49702b8-f497-4be9-a713-b2e1771bc902 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:38.620672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49702b8-f497-4be9-a713-b2e1771bc902 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:38.620997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49702b8-f497-4be9-a713-b2e1771bc902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:38.648697 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c49702b8-f497-4be9-a713-b2e1771bc902 None None] MFA Rules not processed for user `2cf1124b5fa8471489eb9b24a2ffca31`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:09:38.649953 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c49702b8-f497-4be9-a713-b2e1771bc902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:38.669416 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:09:38.725917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1226/2439] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:09:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:09:38.737526 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ef6b7-5042-42cb-881b-aa5e9184f43b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:38.739241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3b4ef6b7-5042-42cb-881b-aa5e9184f43b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:38.796005 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6be58-2586-41f4-9531-776ef7e88e52 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:38.796292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6be58-2586-41f4-9531-776ef7e88e52 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:38.796600 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee6be58-2586-41f4-9531-776ef7e88e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:38.802969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ef6b7-5042-42cb-881b-aa5e9184f43b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:38.806713 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44159-d5ee-4b25-9548-252644c0320d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:38.807448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44159-d5ee-4b25-9548-252644c0320d service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:38.807731 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44159-d5ee-4b25-9548-252644c0320d service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:38.808085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac44159-d5ee-4b25-9548-252644c0320d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:38.815627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-aee6be58-2586-41f4-9531-776ef7e88e52 None None] MFA Rules not processed for user `f3cc3768b87844298b2b21ba8dc61662`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:09:38.816816 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-aee6be58-2586-41f4-9531-776ef7e88e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:38.818247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac44159-d5ee-4b25-9548-252644c0320d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:38.819682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac44159-d5ee-4b25-9548-252644c0320d service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:38.830050 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1214/2440] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:09:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:09:38.878567 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1227/2441] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:09:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:09:38.913384 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44159-d5ee-4b25-9548-252644c0320d service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:38.923168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac44159-d5ee-4b25-9548-252644c0320d service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:38.926971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0146e32-1953-4d0d-bde3-93a50b2cf7c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:38.927567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0146e32-1953-4d0d-bde3-93a50b2cf7c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:38.927842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0146e32-1953-4d0d-bde3-93a50b2cf7c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:38.928112 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0146e32-1953-4d0d-bde3-93a50b2cf7c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:38.986288 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0146e32-1953-4d0d-bde3-93a50b2cf7c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:38.987741 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0146e32-1953-4d0d-bde3-93a50b2cf7c1 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:39.001746 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1215/2442] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:09:38 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:09:47.534145 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6be58-2586-41f4-9531-776ef7e88e52 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:09:47.535753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-aee6be58-2586-41f4-9531-776ef7e88e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:47.617592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee6be58-2586-41f4-9531-776ef7e88e52 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:09:47.624094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e04c6f-dc63-4e56-9f68-59683a5fab4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:09:47.624712 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e04c6f-dc63-4e56-9f68-59683a5fab4a service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:09:47.624989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e04c6f-dc63-4e56-9f68-59683a5fab4a service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:09:47.625258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e04c6f-dc63-4e56-9f68-59683a5fab4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:09:47.627049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-60e04c6f-dc63-4e56-9f68-59683a5fab4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:09:47.639704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e04c6f-dc63-4e56-9f68-59683a5fab4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:09:47.641317 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e04c6f-dc63-4e56-9f68-59683a5fab4a service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:09:47.652258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1228/2443] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:09:47 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:09:48.992882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=71,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:09:57.647731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=79 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:09.241864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0146e32-1953-4d0d-bde3-93a50b2cf7c1 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:09.303364 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0146e32-1953-4d0d-bde3-93a50b2cf7c1 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:09.307781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:09.308409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:09.308684 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:09.308951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] PATH_INFO: `/v3/users/dbd9848e7862490491f206083cd59882` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:09.310134 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd9848e7862490491f206083cd59882)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:09.312114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:09.357871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd9848e7862490491f206083cd59882'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:09.358524 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd9848e7862490491f206083cd59882'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:09.370711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd9848e7862490491f206083cd59882'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:09.377690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd9848e7862490491f206083cd59882'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:09.384788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd9848e7862490491f206083cd59882'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:09.391066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1216/2444] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:10:09 2022] DELETE /identity/v3/users/dbd9848e7862490491f206083cd59882 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:09.395517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612c02-9c14-448e-b2b6-8b5e3fd55d4e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:09.396013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612c02-9c14-448e-b2b6-8b5e3fd55d4e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:09.396110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a612c02-9c14-448e-b2b6-8b5e3fd55d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:09.414962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4a612c02-9c14-448e-b2b6-8b5e3fd55d4e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:09.416157 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4a612c02-9c14-448e-b2b6-8b5e3fd55d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:09.473913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1229/2445] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:09.483485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:09.484891 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:09.543676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0705ea-4b41-407f-894b-79e88848ea3c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:09.547600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676619bc-f860-491a-865d-6290fba8d3ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:09.548325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676619bc-f860-491a-865d-6290fba8d3ba service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:09.548603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676619bc-f860-491a-865d-6290fba8d3ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:09.548872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676619bc-f860-491a-865d-6290fba8d3ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:09.558788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676619bc-f860-491a-865d-6290fba8d3ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:09.560143 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676619bc-f860-491a-865d-6290fba8d3ba service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:09.569914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1217/2446] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:10:09.833577 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612c02-9c14-448e-b2b6-8b5e3fd55d4e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:09.835100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4a612c02-9c14-448e-b2b6-8b5e3fd55d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:09.847826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a612c02-9c14-448e-b2b6-8b5e3fd55d4e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:09.853585 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:09.854408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:09.854694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:09.854973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] PATH_INFO: `/v3/projects/dcbcd27d32ee4a459ab0f78ba4528cac` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:09.856264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbcd27d32ee4a459ab0f78ba4528cac)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:09.859483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:09.913111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbcd27d32ee4a459ab0f78ba4528cac', 'request_id': 'req-c3b58d9e-c8b6-4168-89e7-9e797f498113'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:09.918900 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbcd27d32ee4a459ab0f78ba4528cac', 'request_id': 'req-c3b58d9e-c8b6-4168-89e7-9e797f498113'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:09.925570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbcd27d32ee4a459ab0f78ba4528cac', 'request_id': 'req-c3b58d9e-c8b6-4168-89e7-9e797f498113'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:09.938531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] The token cache is being invalidate because project dcbcd27d32ee4a459ab0f78ba4528cac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:10:09.938817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:09.939446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:09.940956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1230/2447] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:10:09 2022] DELETE /identity/v3/projects/dcbcd27d32ee4a459ab0f78ba4528cac => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:09.945008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676619bc-f860-491a-865d-6290fba8d3ba service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:09.955037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676619bc-f860-491a-865d-6290fba8d3ba service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:09.972872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:10.012642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc25770-cfc9-4137-8a69-85dead6820ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:10.013261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc25770-cfc9-4137-8a69-85dead6820ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:10.013574 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc25770-cfc9-4137-8a69-85dead6820ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:10.013842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc25770-cfc9-4137-8a69-85dead6820ee admin admin] PATH_INFO: `/v3/users/2cf1124b5fa8471489eb9b24a2ffca31` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:10.015030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc25770-cfc9-4137-8a69-85dead6820ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2cf1124b5fa8471489eb9b24a2ffca31)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:10.016943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc25770-cfc9-4137-8a69-85dead6820ee admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:10.063061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2fc25770-cfc9-4137-8a69-85dead6820ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2cf1124b5fa8471489eb9b24a2ffca31'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:10.063683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2fc25770-cfc9-4137-8a69-85dead6820ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2cf1124b5fa8471489eb9b24a2ffca31'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:10.076833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2fc25770-cfc9-4137-8a69-85dead6820ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2cf1124b5fa8471489eb9b24a2ffca31'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:10.083623 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2fc25770-cfc9-4137-8a69-85dead6820ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2cf1124b5fa8471489eb9b24a2ffca31'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:10.091066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2fc25770-cfc9-4137-8a69-85dead6820ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2cf1124b5fa8471489eb9b24a2ffca31'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:10.097324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1218/2448] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:10:09 2022] DELETE /identity/v3/users/2cf1124b5fa8471489eb9b24a2ffca31 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:10.375917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:10.377473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:10.391920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b58d9e-c8b6-4168-89e7-9e797f498113 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:10.447154 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:10.447799 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:10.448047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:10.448313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b admin admin] PATH_INFO: `/v3/projects/5f8ae036512c47c2b11238a11e810e32` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:10.449483 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f8ae036512c47c2b11238a11e810e32)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:10.451364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:10.479880 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:10.498576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f8ae036512c47c2b11238a11e810e32', 'request_id': 'req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:10.503957 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f8ae036512c47c2b11238a11e810e32', 'request_id': 'req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:10.510109 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f8ae036512c47c2b11238a11e810e32', 'request_id': 'req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:10.521468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b admin admin] The token cache is being invalidate because project 5f8ae036512c47c2b11238a11e810e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:10:10.521739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:10.522362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3308abe2-d68d-4562-ac88-aa22cd1bcc6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:10.523920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1231/2449] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:10:10 2022] DELETE /identity/v3/projects/5f8ae036512c47c2b11238a11e810e32 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:10.528856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1946e4-e119-43a6-8938-cfb5182ece31 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:10.529370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1946e4-e119-43a6-8938-cfb5182ece31 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:10.529474 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1946e4-e119-43a6-8938-cfb5182ece31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:10.549720 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4a1946e4-e119-43a6-8938-cfb5182ece31 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:10.550923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4a1946e4-e119-43a6-8938-cfb5182ece31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:10.608639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1219/2450] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:10.616959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a6978-7012-4b0f-a8ca-b025cb4dfaa6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:10.617248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a6978-7012-4b0f-a8ca-b025cb4dfaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:10.617561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a6978-7012-4b0f-a8ca-b025cb4dfaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:10.636939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-554a6978-7012-4b0f-a8ca-b025cb4dfaa6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:10.638104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-554a6978-7012-4b0f-a8ca-b025cb4dfaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:10.646599 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1232/2451] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:10.650811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1946e4-e119-43a6-8938-cfb5182ece31 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:10.660953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1946e4-e119-43a6-8938-cfb5182ece31 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:10.665515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d902487-0e5d-4073-a701-aa06a30a179b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:10.666115 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d902487-0e5d-4073-a701-aa06a30a179b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:10.666392 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d902487-0e5d-4073-a701-aa06a30a179b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:10.666664 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d902487-0e5d-4073-a701-aa06a30a179b admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:10.667352 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d902487-0e5d-4073-a701-aa06a30a179b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:10:10.667650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d902487-0e5d-4073-a701-aa06a30a179b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:10.669245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d902487-0e5d-4073-a701-aa06a30a179b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:10.681011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1220/2452] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:10:10.685193 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a6978-7012-4b0f-a8ca-b025cb4dfaa6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:10.694353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a6978-7012-4b0f-a8ca-b025cb4dfaa6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:10.698932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527e6fd-261e-4b46-b6c1-70d12ec901e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:10.699529 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527e6fd-261e-4b46-b6c1-70d12ec901e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:10.699803 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527e6fd-261e-4b46-b6c1-70d12ec901e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:10.700073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1527e6fd-261e-4b46-b6c1-70d12ec901e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:10.700727 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527e6fd-261e-4b46-b6c1-70d12ec901e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:10.704030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1527e6fd-261e-4b46-b6c1-70d12ec901e9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:10.733919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1233/2453] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:10:10 2022] POST /identity/v3/projects => generated 379 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:10:10.738082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d902487-0e5d-4073-a701-aa06a30a179b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:10.748230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d902487-0e5d-4073-a701-aa06a30a179b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:10.773729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:10.806823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19f13f-1547-4abe-b63e-1640c3dd3e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:10.807434 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19f13f-1547-4abe-b63e-1640c3dd3e58 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:10.807714 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19f13f-1547-4abe-b63e-1640c3dd3e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:10.807986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d19f13f-1547-4abe-b63e-1640c3dd3e58 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:10.808652 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19f13f-1547-4abe-b63e-1640c3dd3e58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:10.810660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d19f13f-1547-4abe-b63e-1640c3dd3e58 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:10.831448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1221/2454] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:10:10 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:10:10.835679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527e6fd-261e-4b46-b6c1-70d12ec901e9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:10.846509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1527e6fd-261e-4b46-b6c1-70d12ec901e9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:10.851384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10965c6b-df97-4848-9bcd-80f515510b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:10.851990 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10965c6b-df97-4848-9bcd-80f515510b3b admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:10.854249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10965c6b-df97-4848-9bcd-80f515510b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:10.854249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10965c6b-df97-4848-9bcd-80f515510b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:10.854249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10965c6b-df97-4848-9bcd-80f515510b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:10.855013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10965c6b-df97-4848-9bcd-80f515510b3b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:10.865824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1234/2455] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:10.870318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19f13f-1547-4abe-b63e-1640c3dd3e58 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:10.880365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d19f13f-1547-4abe-b63e-1640c3dd3e58 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:10.885067 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09842a7-621b-453e-83e4-09eac1ec8e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:10.885723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09842a7-621b-453e-83e4-09eac1ec8e02 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:10.886000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09842a7-621b-453e-83e4-09eac1ec8e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:10.886273 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09842a7-621b-453e-83e4-09eac1ec8e02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:10.887013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09842a7-621b-453e-83e4-09eac1ec8e02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:10.888608 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09842a7-621b-453e-83e4-09eac1ec8e02 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:10.899984 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1222/2456] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:10.904028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10965c6b-df97-4848-9bcd-80f515510b3b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:10.914680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10965c6b-df97-4848-9bcd-80f515510b3b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:10.919569 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc0ffb-9858-42c0-b830-8a149280c752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:10.920400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc0ffb-9858-42c0-b830-8a149280c752 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:10.920714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc0ffb-9858-42c0-b830-8a149280c752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:10.921037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc0ffb-9858-42c0-b830-8a149280c752 admin admin] PATH_INFO: `/v3/projects/a8c97ae66eb9410780256127a0f23190/users/473c249dfa5947c58d485282e1d0a0f2/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:10.935895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc0ffb-9858-42c0-b830-8a149280c752 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8c97ae66eb9410780256127a0f23190, user_id=473c249dfa5947c58d485282e1d0a0f2, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:10.938723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc0ffb-9858-42c0-b830-8a149280c752 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:10.951992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1235/2457] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:10:10 2022] PUT /identity/v3/projects/a8c97ae66eb9410780256127a0f23190/users/473c249dfa5947c58d485282e1d0a0f2/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:10.963782 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd72e3-75ee-4655-b34a-c14158f651c0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:10.964075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd72e3-75ee-4655-b34a-c14158f651c0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:10.964350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cd72e3-75ee-4655-b34a-c14158f651c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:10.991815 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-36cd72e3-75ee-4655-b34a-c14158f651c0 None None] MFA Rules not processed for user `473c249dfa5947c58d485282e1d0a0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:10.993023 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-36cd72e3-75ee-4655-b34a-c14158f651c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:11.055969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1223/2458] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:11.060383 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc0ffb-9858-42c0-b830-8a149280c752 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:11.120313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc0ffb-9858-42c0-b830-8a149280c752 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:11.125408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b69e7e-f49c-4c2b-8cd2-a78f33815a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:11.126008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b69e7e-f49c-4c2b-8cd2-a78f33815a1f admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:11.126284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b69e7e-f49c-4c2b-8cd2-a78f33815a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:11.126550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b69e7e-f49c-4c2b-8cd2-a78f33815a1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:11.127203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b69e7e-f49c-4c2b-8cd2-a78f33815a1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:11.129073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b69e7e-f49c-4c2b-8cd2-a78f33815a1f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:11.155522 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1236/2459] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:10:11 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:10:11.159697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd72e3-75ee-4655-b34a-c14158f651c0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:11.170128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cd72e3-75ee-4655-b34a-c14158f651c0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:11.227722 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83e425-1012-437b-99e1-7014410cec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:11.228340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83e425-1012-437b-99e1-7014410cec6d admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:11.228621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83e425-1012-437b-99e1-7014410cec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:11.228896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae83e425-1012-437b-99e1-7014410cec6d admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:11.229588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83e425-1012-437b-99e1-7014410cec6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:11.231530 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae83e425-1012-437b-99e1-7014410cec6d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:11.253470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1224/2460] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:10:11 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:10:11.257560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b69e7e-f49c-4c2b-8cd2-a78f33815a1f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:11.268443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b69e7e-f49c-4c2b-8cd2-a78f33815a1f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:11.273279 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e43e-051c-410a-8b3b-ef9fff2ba778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:11.273919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e43e-051c-410a-8b3b-ef9fff2ba778 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:11.274200 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e43e-051c-410a-8b3b-ef9fff2ba778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:11.274473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df2e43e-051c-410a-8b3b-ef9fff2ba778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:11.275160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2e43e-051c-410a-8b3b-ef9fff2ba778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:11.276789 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df2e43e-051c-410a-8b3b-ef9fff2ba778 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:11.287367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1237/2461] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:11.291324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83e425-1012-437b-99e1-7014410cec6d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:11.301521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae83e425-1012-437b-99e1-7014410cec6d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:11.306172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323b654-36a8-43eb-9fbf-412a76481211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:11.306825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323b654-36a8-43eb-9fbf-412a76481211 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:11.307105 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323b654-36a8-43eb-9fbf-412a76481211 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:11.307379 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323b654-36a8-43eb-9fbf-412a76481211 admin admin] PATH_INFO: `/v3/projects/b4afe38173414f2db2c43e299368acb4/users/efec57a36a4c4e2cbcff70e1a86bcee9/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:11.322499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323b654-36a8-43eb-9fbf-412a76481211 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4afe38173414f2db2c43e299368acb4, user_id=efec57a36a4c4e2cbcff70e1a86bcee9, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:11.325810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323b654-36a8-43eb-9fbf-412a76481211 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:11.339899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1225/2462] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:10:11 2022] PUT /identity/v3/projects/b4afe38173414f2db2c43e299368acb4/users/efec57a36a4c4e2cbcff70e1a86bcee9/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:11.343947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e43e-051c-410a-8b3b-ef9fff2ba778 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:11.354137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df2e43e-051c-410a-8b3b-ef9fff2ba778 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:11.375036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:11.413490 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f1b42f-94c4-49c3-89e4-543d9de2c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:11.414027 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b42f-94c4-49c3-89e4-543d9de2c83f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:11.414310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b42f-94c4-49c3-89e4-543d9de2c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:11.414582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f1b42f-94c4-49c3-89e4-543d9de2c83f admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:11.415265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1b42f-94c4-49c3-89e4-543d9de2c83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:11.416888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f1b42f-94c4-49c3-89e4-543d9de2c83f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:11.427008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1238/2463] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:11.431156 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323b654-36a8-43eb-9fbf-412a76481211 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:11.438189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:11.444252 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323b654-36a8-43eb-9fbf-412a76481211 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:11.449378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272511a8-ef52-4453-820d-3fb4cb5fed47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:11.450064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272511a8-ef52-4453-820d-3fb4cb5fed47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:11.450346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272511a8-ef52-4453-820d-3fb4cb5fed47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:11.450649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272511a8-ef52-4453-820d-3fb4cb5fed47 admin admin] PATH_INFO: `/v3/projects/b4afe38173414f2db2c43e299368acb4/users/efec57a36a4c4e2cbcff70e1a86bcee9/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:11.452617 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272511a8-ef52-4453-820d-3fb4cb5fed47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4afe38173414f2db2c43e299368acb4, user_id=efec57a36a4c4e2cbcff70e1a86bcee9, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:11.455377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272511a8-ef52-4453-820d-3fb4cb5fed47 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:11.465531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1226/2464] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:10:11 2022] PUT /identity/v3/projects/b4afe38173414f2db2c43e299368acb4/users/efec57a36a4c4e2cbcff70e1a86bcee9/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:11.475528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd11c9-a45e-43ed-9858-5675747ed19f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:11.476013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd11c9-a45e-43ed-9858-5675747ed19f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:11.476124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd11c9-a45e-43ed-9858-5675747ed19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:11.504437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-17dd11c9-a45e-43ed-9858-5675747ed19f None None] MFA Rules not processed for user `efec57a36a4c4e2cbcff70e1a86bcee9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:11.505692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-17dd11c9-a45e-43ed-9858-5675747ed19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:11.573372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1239/2465] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:11.584424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272511a8-ef52-4453-820d-3fb4cb5fed47 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:11.586310 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-272511a8-ef52-4453-820d-3fb4cb5fed47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:11.643085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272511a8-ef52-4453-820d-3fb4cb5fed47 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:11.646748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf3273-3852-43f1-816a-f74319be48b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:11.647353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf3273-3852-43f1-816a-f74319be48b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:11.647635 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf3273-3852-43f1-816a-f74319be48b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:11.647910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bf3273-3852-43f1-816a-f74319be48b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:11.703215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf3273-3852-43f1-816a-f74319be48b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:11.704593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00bf3273-3852-43f1-816a-f74319be48b4 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:11.713607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1227/2466] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:10:11 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:10:13.057088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd11c9-a45e-43ed-9858-5675747ed19f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:13.058519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-17dd11c9-a45e-43ed-9858-5675747ed19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:13.071437 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd11c9-a45e-43ed-9858-5675747ed19f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:13.075079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd94e752-abdc-4bd1-9e64-66b4b9684083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:13.075686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94e752-abdc-4bd1-9e64-66b4b9684083 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:13.075965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94e752-abdc-4bd1-9e64-66b4b9684083 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:13.076236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd94e752-abdc-4bd1-9e64-66b4b9684083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:13.085049 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94e752-abdc-4bd1-9e64-66b4b9684083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:13.086501 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd94e752-abdc-4bd1-9e64-66b4b9684083 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:13.095847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1240/2467] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:10:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:10:16.850907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf3273-3852-43f1-816a-f74319be48b4 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:16.911426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bf3273-3852-43f1-816a-f74319be48b4 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:16.915938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:16.916564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:16.916841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:16.917113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] PATH_INFO: `/v3/users/473c249dfa5947c58d485282e1d0a0f2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:16.918286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=473c249dfa5947c58d485282e1d0a0f2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:16.920208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:16.962932 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:16.964461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '473c249dfa5947c58d485282e1d0a0f2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:16.965087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '473c249dfa5947c58d485282e1d0a0f2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:16.978186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '473c249dfa5947c58d485282e1d0a0f2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:16.984869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '473c249dfa5947c58d485282e1d0a0f2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:16.992197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '473c249dfa5947c58d485282e1d0a0f2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:16.998029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1228/2468] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:10:16 2022] DELETE /identity/v3/users/473c249dfa5947c58d485282e1d0a0f2 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:17.002989 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4e242-b5ce-4b18-8e14-d6ad1abb813d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:17.003491 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4e242-b5ce-4b18-8e14-d6ad1abb813d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:17.003600 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee4e242-b5ce-4b18-8e14-d6ad1abb813d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:17.022731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-cee4e242-b5ce-4b18-8e14-d6ad1abb813d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:17.024152 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cee4e242-b5ce-4b18-8e14-d6ad1abb813d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:17.082225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1241/2469] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:17.091904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:17.093339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:17.149158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a0e62d-e42a-495e-8f9a-f6bda98dcc13 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:17.153865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934e153-61e6-4038-ac1d-e67aaa28c8a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:17.154481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934e153-61e6-4038-ac1d-e67aaa28c8a2 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:17.154758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934e153-61e6-4038-ac1d-e67aaa28c8a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:17.155033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934e153-61e6-4038-ac1d-e67aaa28c8a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:17.164514 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934e153-61e6-4038-ac1d-e67aaa28c8a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:17.165989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934e153-61e6-4038-ac1d-e67aaa28c8a2 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:17.176127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1229/2470] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:10:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:10:17.443494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4e242-b5ce-4b18-8e14-d6ad1abb813d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:17.445028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cee4e242-b5ce-4b18-8e14-d6ad1abb813d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:17.456982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee4e242-b5ce-4b18-8e14-d6ad1abb813d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:17.461591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:17.462232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:17.462515 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:17.462844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] PATH_INFO: `/v3/projects/a8c97ae66eb9410780256127a0f23190` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:17.464100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8c97ae66eb9410780256127a0f23190)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:17.466142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:17.498839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:17.514316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8c97ae66eb9410780256127a0f23190', 'request_id': 'req-982046fa-104b-4476-856b-c59ba75323a6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:17.520119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8c97ae66eb9410780256127a0f23190', 'request_id': 'req-982046fa-104b-4476-856b-c59ba75323a6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:17.527022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8c97ae66eb9410780256127a0f23190', 'request_id': 'req-982046fa-104b-4476-856b-c59ba75323a6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:17.540262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] The token cache is being invalidate because project a8c97ae66eb9410780256127a0f23190 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:10:17.540634 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:17.541486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:17.543009 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1242/2471] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:10:17 2022] DELETE /identity/v3/projects/a8c97ae66eb9410780256127a0f23190 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:17.546996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934e153-61e6-4038-ac1d-e67aaa28c8a2 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:17.556986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934e153-61e6-4038-ac1d-e67aaa28c8a2 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:17.610868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd466530-2624-4e3e-ac80-9645f7efac8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:17.611992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466530-2624-4e3e-ac80-9645f7efac8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:17.612272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466530-2624-4e3e-ac80-9645f7efac8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:17.612548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd466530-2624-4e3e-ac80-9645f7efac8f admin admin] PATH_INFO: `/v3/users/efec57a36a4c4e2cbcff70e1a86bcee9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:17.613737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd466530-2624-4e3e-ac80-9645f7efac8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=efec57a36a4c4e2cbcff70e1a86bcee9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:17.615686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd466530-2624-4e3e-ac80-9645f7efac8f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:17.660581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-bd466530-2624-4e3e-ac80-9645f7efac8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efec57a36a4c4e2cbcff70e1a86bcee9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:17.661155 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-bd466530-2624-4e3e-ac80-9645f7efac8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efec57a36a4c4e2cbcff70e1a86bcee9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:17.672864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-bd466530-2624-4e3e-ac80-9645f7efac8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efec57a36a4c4e2cbcff70e1a86bcee9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:17.675513 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:17.681712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-bd466530-2624-4e3e-ac80-9645f7efac8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efec57a36a4c4e2cbcff70e1a86bcee9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:17.690037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-bd466530-2624-4e3e-ac80-9645f7efac8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efec57a36a4c4e2cbcff70e1a86bcee9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:17.695923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1230/2472] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:10:17 2022] DELETE /identity/v3/users/efec57a36a4c4e2cbcff70e1a86bcee9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:17.969891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:17.971845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:17.984625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982046fa-104b-4476-856b-c59ba75323a6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:18.041745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:18.042384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.042631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.042902 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a admin admin] PATH_INFO: `/v3/projects/b4afe38173414f2db2c43e299368acb4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.044048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4afe38173414f2db2c43e299368acb4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:18.046006 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:18.091615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4afe38173414f2db2c43e299368acb4', 'request_id': 'req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:18.097829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4afe38173414f2db2c43e299368acb4', 'request_id': 'req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:18.104125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4afe38173414f2db2c43e299368acb4', 'request_id': 'req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:18.116634 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a admin admin] The token cache is being invalidate because project b4afe38173414f2db2c43e299368acb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:10:18.116923 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:18.117579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4c0a4fcb-a46b-42c9-9e2f-ca04c304418a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:18.119134 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1243/2473] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:10:17 2022] DELETE /identity/v3/projects/b4afe38173414f2db2c43e299368acb4 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:18.124991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4567d-ff1c-496e-ac76-ed455ee52d3d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.125508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4567d-ff1c-496e-ac76-ed455ee52d3d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.125608 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4567d-ff1c-496e-ac76-ed455ee52d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.145104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7fb4567d-ff1c-496e-ac76-ed455ee52d3d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:18.146325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7fb4567d-ff1c-496e-ac76-ed455ee52d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:18.203730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1231/2474] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:18.212911 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0a7a-421b-4933-ba01-8c5204044889 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.213261 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0a7a-421b-4933-ba01-8c5204044889 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.213633 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdb0a7a-421b-4933-ba01-8c5204044889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.233962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4fdb0a7a-421b-4933-ba01-8c5204044889 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:18.235168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4fdb0a7a-421b-4933-ba01-8c5204044889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:18.243271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1244/2475] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:18.247456 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4567d-ff1c-496e-ac76-ed455ee52d3d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:18.257069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4567d-ff1c-496e-ac76-ed455ee52d3d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:18.261726 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb6971-46ba-43cb-90f7-a1e097853538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:18.262328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb6971-46ba-43cb-90f7-a1e097853538 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.262607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb6971-46ba-43cb-90f7-a1e097853538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.262879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb6971-46ba-43cb-90f7-a1e097853538 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.263815 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb6971-46ba-43cb-90f7-a1e097853538 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:10:18.264227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb6971-46ba-43cb-90f7-a1e097853538 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:18.266190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb6971-46ba-43cb-90f7-a1e097853538 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:18.278138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1232/2476] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:10:18.282387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0a7a-421b-4933-ba01-8c5204044889 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:18.292186 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdb0a7a-421b-4933-ba01-8c5204044889 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:18.296850 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8aa58b-36a1-4e3e-8d38-34c03dcfb4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:18.297487 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aa58b-36a1-4e3e-8d38-34c03dcfb4a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.297767 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aa58b-36a1-4e3e-8d38-34c03dcfb4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.298039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8aa58b-36a1-4e3e-8d38-34c03dcfb4a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.298734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8aa58b-36a1-4e3e-8d38-34c03dcfb4a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:18.300856 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8aa58b-36a1-4e3e-8d38-34c03dcfb4a5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:18.328289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1245/2477] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:10:18 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:10:18.332933 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb6971-46ba-43cb-90f7-a1e097853538 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:18.342890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb6971-46ba-43cb-90f7-a1e097853538 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:18.400110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b49896-112e-4919-9efa-59a3a2a4e1ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:18.400722 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b49896-112e-4919-9efa-59a3a2a4e1ff admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.401003 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b49896-112e-4919-9efa-59a3a2a4e1ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.401276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b49896-112e-4919-9efa-59a3a2a4e1ff admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.401982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b49896-112e-4919-9efa-59a3a2a4e1ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:18.403915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b49896-112e-4919-9efa-59a3a2a4e1ff admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:18.424830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1233/2478] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:10:18 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:10:18.430493 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8aa58b-36a1-4e3e-8d38-34c03dcfb4a5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:18.441493 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8aa58b-36a1-4e3e-8d38-34c03dcfb4a5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:18.446148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470b48d-17d5-4d1b-bd4f-5a00889991a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:18.446761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b48d-17d5-4d1b-bd4f-5a00889991a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.447041 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b48d-17d5-4d1b-bd4f-5a00889991a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.447316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6470b48d-17d5-4d1b-bd4f-5a00889991a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.448036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470b48d-17d5-4d1b-bd4f-5a00889991a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:18.449700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6470b48d-17d5-4d1b-bd4f-5a00889991a6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:18.460258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1246/2479] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:18.464376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b49896-112e-4919-9efa-59a3a2a4e1ff admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:18.474442 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b49896-112e-4919-9efa-59a3a2a4e1ff admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:18.479179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d9b735-c005-48a1-b624-662cf9afb58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:18.479794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9b735-c005-48a1-b624-662cf9afb58a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.480073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9b735-c005-48a1-b624-662cf9afb58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.480349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d9b735-c005-48a1-b624-662cf9afb58a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.481044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9b735-c005-48a1-b624-662cf9afb58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:18.482700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d9b735-c005-48a1-b624-662cf9afb58a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:18.493976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1234/2480] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:18.498227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470b48d-17d5-4d1b-bd4f-5a00889991a6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:18.508739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6470b48d-17d5-4d1b-bd4f-5a00889991a6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:18.513507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cab43-5fda-4e0d-9167-2a091fe4d2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:18.514190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cab43-5fda-4e0d-9167-2a091fe4d2e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.514475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cab43-5fda-4e0d-9167-2a091fe4d2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.514864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7cab43-5fda-4e0d-9167-2a091fe4d2e4 admin admin] PATH_INFO: `/v3/projects/91190aaee9d8446581960959e317d821/users/e4d23f90a97c4d0c93861cd91f753899/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.517139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:18.532376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cab43-5fda-4e0d-9167-2a091fe4d2e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91190aaee9d8446581960959e317d821, user_id=e4d23f90a97c4d0c93861cd91f753899, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:18.535539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7cab43-5fda-4e0d-9167-2a091fe4d2e4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:18.551855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1247/2481] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:10:18 2022] PUT /identity/v3/projects/91190aaee9d8446581960959e317d821/users/e4d23f90a97c4d0c93861cd91f753899/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:18.562064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db8ed1-5f38-4b44-baa0-1cc19d572146 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.562353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db8ed1-5f38-4b44-baa0-1cc19d572146 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.562631 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93db8ed1-5f38-4b44-baa0-1cc19d572146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.590999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-93db8ed1-5f38-4b44-baa0-1cc19d572146 None None] MFA Rules not processed for user `e4d23f90a97c4d0c93861cd91f753899`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:18.592254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-93db8ed1-5f38-4b44-baa0-1cc19d572146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:18.633217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:18.661152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1235/2482] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:18.672395 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cab43-5fda-4e0d-9167-2a091fe4d2e4 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:18.674104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9d7cab43-5fda-4e0d-9167-2a091fe4d2e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:18.729441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7cab43-5fda-4e0d-9167-2a091fe4d2e4 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:18.732953 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a189bc5-8043-40e7-b823-db53fec5c28f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:18.733584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189bc5-8043-40e7-b823-db53fec5c28f service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.733860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189bc5-8043-40e7-b823-db53fec5c28f service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.734134 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189bc5-8043-40e7-b823-db53fec5c28f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.742442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189bc5-8043-40e7-b823-db53fec5c28f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:18.743861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189bc5-8043-40e7-b823-db53fec5c28f service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:18.752869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1248/2483] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:10:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:10:18.772051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db8ed1-5f38-4b44-baa0-1cc19d572146 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:18.832059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93db8ed1-5f38-4b44-baa0-1cc19d572146 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:18.836676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:18.837324 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.837617 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.837886 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] PATH_INFO: `/v3/users/e4d23f90a97c4d0c93861cd91f753899` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.839055 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4d23f90a97c4d0c93861cd91f753899)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:18.840979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:18.887404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4d23f90a97c4d0c93861cd91f753899'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:18.888064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4d23f90a97c4d0c93861cd91f753899'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:18.899537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4d23f90a97c4d0c93861cd91f753899'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:18.906197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4d23f90a97c4d0c93861cd91f753899'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:18.913633 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4d23f90a97c4d0c93861cd91f753899'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:18.920838 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1236/2484] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:10:18 2022] DELETE /identity/v3/users/e4d23f90a97c4d0c93861cd91f753899 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:18.926088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab95fb-cc8f-4e9a-bae1-5e7805d46004 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:18.926369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab95fb-cc8f-4e9a-bae1-5e7805d46004 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:18.926640 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab95fb-cc8f-4e9a-bae1-5e7805d46004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:18.946810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-40ab95fb-cc8f-4e9a-bae1-5e7805d46004 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:18.948017 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-40ab95fb-cc8f-4e9a-bae1-5e7805d46004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:19.005781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1249/2485] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:19.015253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:19.016643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:19.075079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8e286-fc84-4a5f-ba45-01031a1b764f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:19.078749 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cb8b5c-4d34-421d-8453-17ae57827d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:19.079359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb8b5c-4d34-421d-8453-17ae57827d1b service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:19.079640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb8b5c-4d34-421d-8453-17ae57827d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:19.079911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cb8b5c-4d34-421d-8453-17ae57827d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:19.088874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb8b5c-4d34-421d-8453-17ae57827d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:19.090340 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cb8b5c-4d34-421d-8453-17ae57827d1b service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:19.099771 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1237/2486] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:10:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:10:19.366104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab95fb-cc8f-4e9a-bae1-5e7805d46004 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:19.367856 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-40ab95fb-cc8f-4e9a-bae1-5e7805d46004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:19.379908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab95fb-cc8f-4e9a-bae1-5e7805d46004 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:19.384637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c20273-7777-4757-b9e4-b1d8132f70ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:19.385289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c20273-7777-4757-b9e4-b1d8132f70ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:19.385586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c20273-7777-4757-b9e4-b1d8132f70ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:19.385860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c20273-7777-4757-b9e4-b1d8132f70ce admin admin] PATH_INFO: `/v3/projects/91190aaee9d8446581960959e317d821` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:19.387024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c20273-7777-4757-b9e4-b1d8132f70ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=91190aaee9d8446581960959e317d821)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:19.388992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c20273-7777-4757-b9e4-b1d8132f70ce admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:19.435302 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-75c20273-7777-4757-b9e4-b1d8132f70ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91190aaee9d8446581960959e317d821', 'request_id': 'req-75c20273-7777-4757-b9e4-b1d8132f70ce'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:19.440645 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-75c20273-7777-4757-b9e4-b1d8132f70ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91190aaee9d8446581960959e317d821', 'request_id': 'req-75c20273-7777-4757-b9e4-b1d8132f70ce'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:19.446603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-75c20273-7777-4757-b9e4-b1d8132f70ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91190aaee9d8446581960959e317d821', 'request_id': 'req-75c20273-7777-4757-b9e4-b1d8132f70ce'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:19.458763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-75c20273-7777-4757-b9e4-b1d8132f70ce admin admin] The token cache is being invalidate because project 91190aaee9d8446581960959e317d821 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:10:19.459054 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-75c20273-7777-4757-b9e4-b1d8132f70ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:19.459694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-75c20273-7777-4757-b9e4-b1d8132f70ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:19.461202 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1250/2487] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:10:19 2022] DELETE /identity/v3/projects/91190aaee9d8446581960959e317d821 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:19.466008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db14de-b199-436c-812b-943d9b51b064 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:19.466493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db14de-b199-436c-812b-943d9b51b064 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:19.466590 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db14de-b199-436c-812b-943d9b51b064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:19.474736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:19.489841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c5db14de-b199-436c-812b-943d9b51b064 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:19.491047 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c5db14de-b199-436c-812b-943d9b51b064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:19.550145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1238/2488] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:19.557760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1270f58-4d1f-4580-b2e0-6c1cafb4c24f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:19.558042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1270f58-4d1f-4580-b2e0-6c1cafb4c24f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:19.558308 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1270f58-4d1f-4580-b2e0-6c1cafb4c24f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:19.577525 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c1270f58-4d1f-4580-b2e0-6c1cafb4c24f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:19.578720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c1270f58-4d1f-4580-b2e0-6c1cafb4c24f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:19.587031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1251/2489] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:19.591239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db14de-b199-436c-812b-943d9b51b064 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:19.601609 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db14de-b199-436c-812b-943d9b51b064 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:19.607154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dd334-8adb-499a-9fc2-311252891950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:19.607779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dd334-8adb-499a-9fc2-311252891950 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:19.608066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dd334-8adb-499a-9fc2-311252891950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:19.608371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23dd334-8adb-499a-9fc2-311252891950 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:19.609071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dd334-8adb-499a-9fc2-311252891950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:10:19.609417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dd334-8adb-499a-9fc2-311252891950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:19.611036 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23dd334-8adb-499a-9fc2-311252891950 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:19.623686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1239/2490] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:10:19.628138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1270f58-4d1f-4580-b2e0-6c1cafb4c24f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:19.633872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:19.640046 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1270f58-4d1f-4580-b2e0-6c1cafb4c24f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:19.646696 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52538f45-954b-4b49-84a9-f693cc074d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:19.647399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52538f45-954b-4b49-84a9-f693cc074d9a admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:19.647755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52538f45-954b-4b49-84a9-f693cc074d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:19.648127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52538f45-954b-4b49-84a9-f693cc074d9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:19.649468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52538f45-954b-4b49-84a9-f693cc074d9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:19.651723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52538f45-954b-4b49-84a9-f693cc074d9a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:19.681330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1252/2491] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:10:19 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:10:19.685589 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dd334-8adb-499a-9fc2-311252891950 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:19.695608 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23dd334-8adb-499a-9fc2-311252891950 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:19.752671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3749a9-dd6d-4d01-9293-dbd18926939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:19.753286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3749a9-dd6d-4d01-9293-dbd18926939b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:19.753591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3749a9-dd6d-4d01-9293-dbd18926939b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:19.753877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3749a9-dd6d-4d01-9293-dbd18926939b admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:19.754543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3749a9-dd6d-4d01-9293-dbd18926939b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:19.756489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3749a9-dd6d-4d01-9293-dbd18926939b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:19.779441 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1240/2492] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:10:19 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:10:19.784104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52538f45-954b-4b49-84a9-f693cc074d9a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:19.795179 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52538f45-954b-4b49-84a9-f693cc074d9a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:19.800020 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab476ce1-d910-474c-89bd-6a1d914c2a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:19.800690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab476ce1-d910-474c-89bd-6a1d914c2a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:19.800917 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab476ce1-d910-474c-89bd-6a1d914c2a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:19.801253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab476ce1-d910-474c-89bd-6a1d914c2a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:19.801987 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab476ce1-d910-474c-89bd-6a1d914c2a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:19.803619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab476ce1-d910-474c-89bd-6a1d914c2a08 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:19.814034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1253/2493] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:19.818057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3749a9-dd6d-4d01-9293-dbd18926939b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:19.828766 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3749a9-dd6d-4d01-9293-dbd18926939b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:19.834109 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c4934-d2c6-42e7-9524-7659d4100b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:19.834718 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c4934-d2c6-42e7-9524-7659d4100b65 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:19.835000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c4934-d2c6-42e7-9524-7659d4100b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:19.835275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c4934-d2c6-42e7-9524-7659d4100b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:19.835972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c4934-d2c6-42e7-9524-7659d4100b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:19.837759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016c4934-d2c6-42e7-9524-7659d4100b65 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:19.849019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1241/2494] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:19.853183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab476ce1-d910-474c-89bd-6a1d914c2a08 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:19.863375 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab476ce1-d910-474c-89bd-6a1d914c2a08 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:19.868982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851357de-3ed8-4c06-ab94-64135767c567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:19.869748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851357de-3ed8-4c06-ab94-64135767c567 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:19.870031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851357de-3ed8-4c06-ab94-64135767c567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:19.870306 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851357de-3ed8-4c06-ab94-64135767c567 admin admin] PATH_INFO: `/v3/projects/c835b44a0ebb4497bd2a894ab1606cb6/users/e00601dbcd014c00ab924d190000ed77/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:19.885864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851357de-3ed8-4c06-ab94-64135767c567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c835b44a0ebb4497bd2a894ab1606cb6, user_id=e00601dbcd014c00ab924d190000ed77, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:19.888561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851357de-3ed8-4c06-ab94-64135767c567 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:19.907283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1254/2495] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:10:19 2022] PUT /identity/v3/projects/c835b44a0ebb4497bd2a894ab1606cb6/users/e00601dbcd014c00ab924d190000ed77/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:19.918995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef9aee-4a06-48db-a97c-710442a10a6c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:19.919286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef9aee-4a06-48db-a97c-710442a10a6c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:19.919555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef9aee-4a06-48db-a97c-710442a10a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:19.948625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ffef9aee-4a06-48db-a97c-710442a10a6c None None] MFA Rules not processed for user `e00601dbcd014c00ab924d190000ed77`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:19.949858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ffef9aee-4a06-48db-a97c-710442a10a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:20.008798 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:20.015085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1242/2496] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:20.026244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851357de-3ed8-4c06-ab94-64135767c567 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:20.027988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-851357de-3ed8-4c06-ab94-64135767c567 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:20.086660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851357de-3ed8-4c06-ab94-64135767c567 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:20.090430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcbd1c0-f637-406f-8c2f-7baad0f4c216 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c358a2d9539c4ae2a5e12aa6f1ed6d61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:20.091046 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbd1c0-f637-406f-8c2f-7baad0f4c216 service glance] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:20.091325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbd1c0-f637-406f-8c2f-7baad0f4c216 service glance] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:20.091597 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcbd1c0-f637-406f-8c2f-7baad0f4c216 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:20.101105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbd1c0-f637-406f-8c2f-7baad0f4c216 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:20.101933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcbd1c0-f637-406f-8c2f-7baad0f4c216 service glance] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:20.110910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1255/2497] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:10:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:10:30.016781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:30.106845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=49,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:39.814043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef9aee-4a06-48db-a97c-710442a10a6c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:39.875187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef9aee-4a06-48db-a97c-710442a10a6c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:39.879635 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:39.880265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:39.880543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:39.880812 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] PATH_INFO: `/v3/users/e00601dbcd014c00ab924d190000ed77` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:39.881967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e00601dbcd014c00ab924d190000ed77)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:39.883914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:39.928452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e00601dbcd014c00ab924d190000ed77'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:39.929097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e00601dbcd014c00ab924d190000ed77'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:39.940669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e00601dbcd014c00ab924d190000ed77'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:39.947369 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e00601dbcd014c00ab924d190000ed77'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:39.953781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e00601dbcd014c00ab924d190000ed77'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:39.959561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1243/2498] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:10:39 2022] DELETE /identity/v3/users/e00601dbcd014c00ab924d190000ed77 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:39.965121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357cf19-3736-4c8e-bcdc-a1cccbb540df None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:39.965624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357cf19-3736-4c8e-bcdc-a1cccbb540df None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:39.965780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357cf19-3736-4c8e-bcdc-a1cccbb540df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:39.985238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f357cf19-3736-4c8e-bcdc-a1cccbb540df None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:39.986466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f357cf19-3736-4c8e-bcdc-a1cccbb540df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:40.043853 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1256/2499] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:40.053670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:40.055172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:40.112452 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ba6f8-272f-4b42-b69e-34f06e32b620 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:40.116235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8960d13a-6996-445f-b29f-2a569b9254d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:40.117356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960d13a-6996-445f-b29f-2a569b9254d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:40.117515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960d13a-6996-445f-b29f-2a569b9254d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:40.117794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8960d13a-6996-445f-b29f-2a569b9254d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:40.127656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960d13a-6996-445f-b29f-2a569b9254d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:40.129065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8960d13a-6996-445f-b29f-2a569b9254d2 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:40.139386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1244/2500] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:10:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:10:40.415358 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357cf19-3736-4c8e-bcdc-a1cccbb540df None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:40.416910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f357cf19-3736-4c8e-bcdc-a1cccbb540df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:40.430356 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357cf19-3736-4c8e-bcdc-a1cccbb540df None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:40.436147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f39364-8a73-4b31-874f-b729fbec7882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:40.436995 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f39364-8a73-4b31-874f-b729fbec7882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:40.437409 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f39364-8a73-4b31-874f-b729fbec7882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:40.437808 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f39364-8a73-4b31-874f-b729fbec7882 admin admin] PATH_INFO: `/v3/projects/c835b44a0ebb4497bd2a894ab1606cb6` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:40.439298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f39364-8a73-4b31-874f-b729fbec7882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c835b44a0ebb4497bd2a894ab1606cb6)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:40.441427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f39364-8a73-4b31-874f-b729fbec7882 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:40.492598 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-45f39364-8a73-4b31-874f-b729fbec7882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c835b44a0ebb4497bd2a894ab1606cb6', 'request_id': 'req-45f39364-8a73-4b31-874f-b729fbec7882'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:40.498895 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-45f39364-8a73-4b31-874f-b729fbec7882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c835b44a0ebb4497bd2a894ab1606cb6', 'request_id': 'req-45f39364-8a73-4b31-874f-b729fbec7882'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:40.505365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-45f39364-8a73-4b31-874f-b729fbec7882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c835b44a0ebb4497bd2a894ab1606cb6', 'request_id': 'req-45f39364-8a73-4b31-874f-b729fbec7882'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:40.519327 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-45f39364-8a73-4b31-874f-b729fbec7882 admin admin] The token cache is being invalidate because project c835b44a0ebb4497bd2a894ab1606cb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:10:40.519685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-45f39364-8a73-4b31-874f-b729fbec7882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:40.520262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-45f39364-8a73-4b31-874f-b729fbec7882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:40.522039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1257/2501] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:10:40 2022] DELETE /identity/v3/projects/c835b44a0ebb4497bd2a894ab1606cb6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:40.527048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72106def-5998-41c3-8d56-8ccbb18cf9bb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:40.527335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72106def-5998-41c3-8d56-8ccbb18cf9bb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:40.527616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72106def-5998-41c3-8d56-8ccbb18cf9bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:40.548008 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-72106def-5998-41c3-8d56-8ccbb18cf9bb None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:40.549253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-72106def-5998-41c3-8d56-8ccbb18cf9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:40.567753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:40.611975 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1245/2502] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:40.620855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0037d3a-bf37-4da9-967d-83221ad5e711 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:40.621142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0037d3a-bf37-4da9-967d-83221ad5e711 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:40.621441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0037d3a-bf37-4da9-967d-83221ad5e711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:40.642139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d0037d3a-bf37-4da9-967d-83221ad5e711 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:40.643340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d0037d3a-bf37-4da9-967d-83221ad5e711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:40.656574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1258/2503] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:40.660642 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72106def-5998-41c3-8d56-8ccbb18cf9bb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:40.670634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72106def-5998-41c3-8d56-8ccbb18cf9bb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:40.675314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5130fb8-a2a9-4a5a-9350-22d43b663b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:40.675909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5130fb8-a2a9-4a5a-9350-22d43b663b5a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:40.676188 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5130fb8-a2a9-4a5a-9350-22d43b663b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:40.676463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5130fb8-a2a9-4a5a-9350-22d43b663b5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:40.677274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5130fb8-a2a9-4a5a-9350-22d43b663b5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:10:40.677618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5130fb8-a2a9-4a5a-9350-22d43b663b5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:40.679227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5130fb8-a2a9-4a5a-9350-22d43b663b5a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:40.691625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1246/2504] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:10:40.696199 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0037d3a-bf37-4da9-967d-83221ad5e711 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:40.706279 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0037d3a-bf37-4da9-967d-83221ad5e711 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:40.711103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556db74f-4145-4952-b762-c7e7ed8cfccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:40.711752 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556db74f-4145-4952-b762-c7e7ed8cfccf admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:40.712064 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556db74f-4145-4952-b762-c7e7ed8cfccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:40.712398 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556db74f-4145-4952-b762-c7e7ed8cfccf admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:40.712986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556db74f-4145-4952-b762-c7e7ed8cfccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:40.714924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556db74f-4145-4952-b762-c7e7ed8cfccf admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:40.744708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1259/2505] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:10:40 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:10:40.749035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5130fb8-a2a9-4a5a-9350-22d43b663b5a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:40.759941 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5130fb8-a2a9-4a5a-9350-22d43b663b5a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:40.816080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413ba78-45fa-4f17-b1a2-153d4f25aff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:40.816724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413ba78-45fa-4f17-b1a2-153d4f25aff2 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:40.817028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413ba78-45fa-4f17-b1a2-153d4f25aff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:40.817322 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413ba78-45fa-4f17-b1a2-153d4f25aff2 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:40.818021 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413ba78-45fa-4f17-b1a2-153d4f25aff2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:40.819989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413ba78-45fa-4f17-b1a2-153d4f25aff2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:40.840655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1247/2506] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:10:40 2022] POST /identity/v3/users => generated 287 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:10:40.844930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556db74f-4145-4952-b762-c7e7ed8cfccf admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:40.855682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556db74f-4145-4952-b762-c7e7ed8cfccf admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:40.860248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb0d8e-19cc-4dd7-82f7-4cafe75c12ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:40.860849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb0d8e-19cc-4dd7-82f7-4cafe75c12ac admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:40.861135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb0d8e-19cc-4dd7-82f7-4cafe75c12ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:40.861432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb0d8e-19cc-4dd7-82f7-4cafe75c12ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:40.862115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb0d8e-19cc-4dd7-82f7-4cafe75c12ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:40.863706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb0d8e-19cc-4dd7-82f7-4cafe75c12ac admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:40.874333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1260/2507] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:40.878349 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413ba78-45fa-4f17-b1a2-153d4f25aff2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:40.888058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413ba78-45fa-4f17-b1a2-153d4f25aff2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:40.892626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966d0157-548d-49d8-8b9f-43ae94cbad4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:40.893210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d0157-548d-49d8-8b9f-43ae94cbad4c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:40.893522 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d0157-548d-49d8-8b9f-43ae94cbad4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:40.893789 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966d0157-548d-49d8-8b9f-43ae94cbad4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:40.894464 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d0157-548d-49d8-8b9f-43ae94cbad4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:40.896080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966d0157-548d-49d8-8b9f-43ae94cbad4c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:40.906302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1248/2508] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:40.910289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb0d8e-19cc-4dd7-82f7-4cafe75c12ac admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:40.923464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb0d8e-19cc-4dd7-82f7-4cafe75c12ac admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:40.927965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36556e9b-9753-44a6-8b4d-69707d9b0047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:40.928608 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36556e9b-9753-44a6-8b4d-69707d9b0047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:40.928884 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36556e9b-9753-44a6-8b4d-69707d9b0047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:40.929154 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36556e9b-9753-44a6-8b4d-69707d9b0047 admin admin] PATH_INFO: `/v3/projects/547c12f088bc45c7a56a930399f0ee42/users/d6094e6389874936bcbd7a1cf5aed8f1/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:40.944640 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36556e9b-9753-44a6-8b4d-69707d9b0047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=547c12f088bc45c7a56a930399f0ee42, user_id=d6094e6389874936bcbd7a1cf5aed8f1, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:40.947322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36556e9b-9753-44a6-8b4d-69707d9b0047 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:40.959541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1261/2509] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:10:40 2022] PUT /identity/v3/projects/547c12f088bc45c7a56a930399f0ee42/users/d6094e6389874936bcbd7a1cf5aed8f1/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:10:40.969868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4cd54-b9dd-4233-9962-6b17cf56899e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:40.970197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4cd54-b9dd-4233-9962-6b17cf56899e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:40.970455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4cd54-b9dd-4233-9962-6b17cf56899e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:40.998424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-36c4cd54-b9dd-4233-9962-6b17cf56899e None None] MFA Rules not processed for user `d6094e6389874936bcbd7a1cf5aed8f1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:40.999625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-36c4cd54-b9dd-4233-9962-6b17cf56899e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:41.062456 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1249/2510] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:41.067297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36556e9b-9753-44a6-8b4d-69707d9b0047 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:41.089313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:41.131777 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36556e9b-9753-44a6-8b4d-69707d9b0047 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:41.136471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad3487-9adb-4466-a461-c7985f531726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:41.137080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad3487-9adb-4466-a461-c7985f531726 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:41.137388 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad3487-9adb-4466-a461-c7985f531726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:41.137665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad3487-9adb-4466-a461-c7985f531726 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:41.138329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad3487-9adb-4466-a461-c7985f531726 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:41.140229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad3487-9adb-4466-a461-c7985f531726 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:41.168885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1262/2511] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:10:41 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:10:41.173312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4cd54-b9dd-4233-9962-6b17cf56899e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:41.184292 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4cd54-b9dd-4233-9962-6b17cf56899e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:41.196407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:41.242975 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f844a-fcd1-4824-b026-a4a972912c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:41.243621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f844a-fcd1-4824-b026-a4a972912c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:41.243898 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f844a-fcd1-4824-b026-a4a972912c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:41.244166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595f844a-fcd1-4824-b026-a4a972912c05 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:41.244834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f844a-fcd1-4824-b026-a4a972912c05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:41.246790 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595f844a-fcd1-4824-b026-a4a972912c05 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:41.268628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1250/2512] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:10:41 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:10:41.272837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad3487-9adb-4466-a461-c7985f531726 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:41.283565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad3487-9adb-4466-a461-c7985f531726 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:41.288238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bf02c-d5b3-48a7-8c46-7fafe2d004ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:41.288877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bf02c-d5b3-48a7-8c46-7fafe2d004ea admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:41.289126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bf02c-d5b3-48a7-8c46-7fafe2d004ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:41.289454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bf02c-d5b3-48a7-8c46-7fafe2d004ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:41.290761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bf02c-d5b3-48a7-8c46-7fafe2d004ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:41.292349 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6bf02c-d5b3-48a7-8c46-7fafe2d004ea admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:41.303321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1263/2513] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:41.307711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f844a-fcd1-4824-b026-a4a972912c05 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:41.318368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595f844a-fcd1-4824-b026-a4a972912c05 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:41.322912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776187d-0751-4a13-8407-70fcfc369d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:41.323559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776187d-0751-4a13-8407-70fcfc369d58 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:41.323831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776187d-0751-4a13-8407-70fcfc369d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:41.324099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776187d-0751-4a13-8407-70fcfc369d58 admin admin] PATH_INFO: `/v3/projects/2e99ed112788418aa90a2d21ce3681cd/users/a3d3d1969dfd467aac50919fdcc444ce/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:41.340832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776187d-0751-4a13-8407-70fcfc369d58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e99ed112788418aa90a2d21ce3681cd, user_id=a3d3d1969dfd467aac50919fdcc444ce, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:41.344095 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4776187d-0751-4a13-8407-70fcfc369d58 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:41.357839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1251/2514] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:10:41 2022] PUT /identity/v3/projects/2e99ed112788418aa90a2d21ce3681cd/users/a3d3d1969dfd467aac50919fdcc444ce/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:41.361907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bf02c-d5b3-48a7-8c46-7fafe2d004ea admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:41.372059 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bf02c-d5b3-48a7-8c46-7fafe2d004ea admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:41.428548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982da80-983c-4e8d-a160-ec0f2060ed6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:41.429158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982da80-983c-4e8d-a160-ec0f2060ed6f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:41.429465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982da80-983c-4e8d-a160-ec0f2060ed6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:41.429739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982da80-983c-4e8d-a160-ec0f2060ed6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:41.430433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982da80-983c-4e8d-a160-ec0f2060ed6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:41.432077 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982da80-983c-4e8d-a160-ec0f2060ed6f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:41.442342 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1264/2515] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:41.446866 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776187d-0751-4a13-8407-70fcfc369d58 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:41.457037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776187d-0751-4a13-8407-70fcfc369d58 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:41.462434 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6abcb-ea01-4365-a3ff-f0f15229b944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:41.463085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6abcb-ea01-4365-a3ff-f0f15229b944 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:41.463360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6abcb-ea01-4365-a3ff-f0f15229b944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:41.463628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d6abcb-ea01-4365-a3ff-f0f15229b944 admin admin] PATH_INFO: `/v3/projects/2e99ed112788418aa90a2d21ce3681cd/users/a3d3d1969dfd467aac50919fdcc444ce/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:41.465695 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6abcb-ea01-4365-a3ff-f0f15229b944 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e99ed112788418aa90a2d21ce3681cd, user_id=a3d3d1969dfd467aac50919fdcc444ce, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:41.468337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d6abcb-ea01-4365-a3ff-f0f15229b944 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:41.479502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1252/2516] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:10:41 2022] PUT /identity/v3/projects/2e99ed112788418aa90a2d21ce3681cd/users/a3d3d1969dfd467aac50919fdcc444ce/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:41.547427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210510ee-abd9-403f-8a7c-c0f3ab72860a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:41.547714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210510ee-abd9-403f-8a7c-c0f3ab72860a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:41.547991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210510ee-abd9-403f-8a7c-c0f3ab72860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:41.583915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-210510ee-abd9-403f-8a7c-c0f3ab72860a None None] MFA Rules not processed for user `a3d3d1969dfd467aac50919fdcc444ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:41.585739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-210510ee-abd9-403f-8a7c-c0f3ab72860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:41.665108 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1265/2517] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:41.676519 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6abcb-ea01-4365-a3ff-f0f15229b944 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:41.678165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-47d6abcb-ea01-4365-a3ff-f0f15229b944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:41.738566 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d6abcb-ea01-4365-a3ff-f0f15229b944 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:41.742737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a009f9-842f-4fe5-9560-914192933e76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:41.743541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a009f9-842f-4fe5-9560-914192933e76 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:41.743814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a009f9-842f-4fe5-9560-914192933e76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:41.744083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a009f9-842f-4fe5-9560-914192933e76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:41.813475 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a009f9-842f-4fe5-9560-914192933e76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:41.815537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a009f9-842f-4fe5-9560-914192933e76 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:41.826470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1253/2518] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:10:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:10:45.439781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210510ee-abd9-403f-8a7c-c0f3ab72860a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:45.457491 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:45.502053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210510ee-abd9-403f-8a7c-c0f3ab72860a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:45.506535 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:45.507168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:45.507446 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:45.507736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] PATH_INFO: `/v3/users/d6094e6389874936bcbd7a1cf5aed8f1` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:45.509411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6094e6389874936bcbd7a1cf5aed8f1)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:45.511319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:45.555289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6094e6389874936bcbd7a1cf5aed8f1'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:45.562168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6094e6389874936bcbd7a1cf5aed8f1'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:45.574396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6094e6389874936bcbd7a1cf5aed8f1'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:45.575022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6094e6389874936bcbd7a1cf5aed8f1'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:45.581660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6094e6389874936bcbd7a1cf5aed8f1'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:45.587997 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1266/2519] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:10:45 2022] DELETE /identity/v3/users/d6094e6389874936bcbd7a1cf5aed8f1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:45.593582 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd20d03-34ca-4896-8744-6e28fef40466 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:45.594075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd20d03-34ca-4896-8744-6e28fef40466 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:45.594184 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd20d03-34ca-4896-8744-6e28fef40466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:45.616805 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8bd20d03-34ca-4896-8744-6e28fef40466 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:45.619011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8bd20d03-34ca-4896-8744-6e28fef40466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:45.643444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:45.689593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1254/2520] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:45.700133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:45.701587 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:45.758054 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e925-9d41-4e82-917a-256773427ede admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:45.762422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb8d5c-87b7-4053-afcf-2985339136a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:45.763031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb8d5c-87b7-4053-afcf-2985339136a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:45.763312 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb8d5c-87b7-4053-afcf-2985339136a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:45.763584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb8d5c-87b7-4053-afcf-2985339136a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:45.772477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb8d5c-87b7-4053-afcf-2985339136a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:45.773959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb8d5c-87b7-4053-afcf-2985339136a5 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:45.783313 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1267/2521] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:10:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:10:46.050931 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd20d03-34ca-4896-8744-6e28fef40466 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:46.052462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8bd20d03-34ca-4896-8744-6e28fef40466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:46.065362 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd20d03-34ca-4896-8744-6e28fef40466 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:46.070214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:46.070983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:46.071270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:46.071631 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] PATH_INFO: `/v3/projects/547c12f088bc45c7a56a930399f0ee42` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:46.073005 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] RBAC: Authorizing `identity:delete_project(project_id=547c12f088bc45c7a56a930399f0ee42)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:46.075152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:46.121404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '547c12f088bc45c7a56a930399f0ee42', 'request_id': 'req-1a1d0e54-0488-4cc8-a457-4e1534f1228b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.126876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '547c12f088bc45c7a56a930399f0ee42', 'request_id': 'req-1a1d0e54-0488-4cc8-a457-4e1534f1228b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.134356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '547c12f088bc45c7a56a930399f0ee42', 'request_id': 'req-1a1d0e54-0488-4cc8-a457-4e1534f1228b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.145438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] The token cache is being invalidate because project 547c12f088bc45c7a56a930399f0ee42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:10:46.145723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.146351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.147839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1255/2522] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:10:46 2022] DELETE /identity/v3/projects/547c12f088bc45c7a56a930399f0ee42 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:46.152169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb8d5c-87b7-4053-afcf-2985339136a5 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:46.161675 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb8d5c-87b7-4053-afcf-2985339136a5 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:46.194599 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:46.218847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dce805-5626-4fc4-93e1-c28365efa0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:46.219478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dce805-5626-4fc4-93e1-c28365efa0f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:46.219758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dce805-5626-4fc4-93e1-c28365efa0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:46.220030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dce805-5626-4fc4-93e1-c28365efa0f5 admin admin] PATH_INFO: `/v3/users/a3d3d1969dfd467aac50919fdcc444ce` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:46.221190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dce805-5626-4fc4-93e1-c28365efa0f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d3d1969dfd467aac50919fdcc444ce)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:46.223158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dce805-5626-4fc4-93e1-c28365efa0f5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:46.269411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-69dce805-5626-4fc4-93e1-c28365efa0f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d3d1969dfd467aac50919fdcc444ce'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.277368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-69dce805-5626-4fc4-93e1-c28365efa0f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d3d1969dfd467aac50919fdcc444ce'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.290332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-69dce805-5626-4fc4-93e1-c28365efa0f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d3d1969dfd467aac50919fdcc444ce'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.291117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-69dce805-5626-4fc4-93e1-c28365efa0f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d3d1969dfd467aac50919fdcc444ce'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.301256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-69dce805-5626-4fc4-93e1-c28365efa0f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d3d1969dfd467aac50919fdcc444ce'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.311680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1268/2523] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:10:46 2022] DELETE /identity/v3/users/a3d3d1969dfd467aac50919fdcc444ce => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:46.672862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:46.674294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:46.688871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d0e54-0488-4cc8-a457-4e1534f1228b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:46.751590 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b89257-8e1b-4372-b35b-fb212d92271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:46.752229 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b89257-8e1b-4372-b35b-fb212d92271a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:46.752504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b89257-8e1b-4372-b35b-fb212d92271a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:46.752772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b89257-8e1b-4372-b35b-fb212d92271a admin admin] PATH_INFO: `/v3/projects/2e99ed112788418aa90a2d21ce3681cd` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:46.753922 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b89257-8e1b-4372-b35b-fb212d92271a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e99ed112788418aa90a2d21ce3681cd)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:46.755833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b89257-8e1b-4372-b35b-fb212d92271a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:46.806129 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-62b89257-8e1b-4372-b35b-fb212d92271a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e99ed112788418aa90a2d21ce3681cd', 'request_id': 'req-62b89257-8e1b-4372-b35b-fb212d92271a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.807351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:46.813042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-62b89257-8e1b-4372-b35b-fb212d92271a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e99ed112788418aa90a2d21ce3681cd', 'request_id': 'req-62b89257-8e1b-4372-b35b-fb212d92271a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.822129 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-62b89257-8e1b-4372-b35b-fb212d92271a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e99ed112788418aa90a2d21ce3681cd', 'request_id': 'req-62b89257-8e1b-4372-b35b-fb212d92271a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.833931 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-62b89257-8e1b-4372-b35b-fb212d92271a admin admin] The token cache is being invalidate because project 2e99ed112788418aa90a2d21ce3681cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:10:46.834217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-62b89257-8e1b-4372-b35b-fb212d92271a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.834859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-62b89257-8e1b-4372-b35b-fb212d92271a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:10:46.836377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1256/2524] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:10:46 2022] DELETE /identity/v3/projects/2e99ed112788418aa90a2d21ce3681cd => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:46.841382 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8f7e6-f859-48b4-9b74-820f3a4236a3 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:46.841863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8f7e6-f859-48b4-9b74-820f3a4236a3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:46.842025 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8f7e6-f859-48b4-9b74-820f3a4236a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:46.863695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3ed8f7e6-f859-48b4-9b74-820f3a4236a3 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:46.864793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3ed8f7e6-f859-48b4-9b74-820f3a4236a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:46.915317 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd92d5-fd41-4118-8c2e-e74d45240ed0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:46.915602 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd92d5-fd41-4118-8c2e-e74d45240ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:46.915883 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd92d5-fd41-4118-8c2e-e74d45240ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:46.931090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1269/2525] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:46.935215 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d5fd92d5-fd41-4118-8c2e-e74d45240ed0 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:46.936415 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d5fd92d5-fd41-4118-8c2e-e74d45240ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:46.939008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020cfb-64ff-4df6-8df9-c2f4604d6f29 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:46.939291 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020cfb-64ff-4df6-8df9-c2f4604d6f29 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:46.939560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c020cfb-64ff-4df6-8df9-c2f4604d6f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:46.960063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2c020cfb-64ff-4df6-8df9-c2f4604d6f29 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:46.961330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2c020cfb-64ff-4df6-8df9-c2f4604d6f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:46.971486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1270/2526] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:10:46.975746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020cfb-64ff-4df6-8df9-c2f4604d6f29 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:46.985150 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c020cfb-64ff-4df6-8df9-c2f4604d6f29 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:46.990122 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a682ff6-03ae-426e-aa03-fe92ee809050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:46.990727 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a682ff6-03ae-426e-aa03-fe92ee809050 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:46.991039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a682ff6-03ae-426e-aa03-fe92ee809050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:46.991308 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a682ff6-03ae-426e-aa03-fe92ee809050 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:46.992253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a682ff6-03ae-426e-aa03-fe92ee809050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:10:46.992558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a682ff6-03ae-426e-aa03-fe92ee809050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:46.994985 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a682ff6-03ae-426e-aa03-fe92ee809050 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:47.000416 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1257/2527] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:10:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:10:47.010314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1271/2528] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 12:10:47.011517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd92d5-fd41-4118-8c2e-e74d45240ed0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:47.022637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd92d5-fd41-4118-8c2e-e74d45240ed0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:47.027403 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73f9cf-bf95-474d-a908-5c7ef06a941a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:47.028154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73f9cf-bf95-474d-a908-5c7ef06a941a admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:47.028439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73f9cf-bf95-474d-a908-5c7ef06a941a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:47.028712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73f9cf-bf95-474d-a908-5c7ef06a941a admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:47.029409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73f9cf-bf95-474d-a908-5c7ef06a941a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:47.031436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb73f9cf-bf95-474d-a908-5c7ef06a941a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:47.048475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a682ff6-03ae-426e-aa03-fe92ee809050 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:47.050288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7a682ff6-03ae-426e-aa03-fe92ee809050 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:47.062360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1258/2529] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:10:47 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:10:47.066465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73f9cf-bf95-474d-a908-5c7ef06a941a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:47.094785 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:47.124656 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a682ff6-03ae-426e-aa03-fe92ee809050 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:47.132251 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb73f9cf-bf95-474d-a908-5c7ef06a941a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:47.137500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26d6f2-3b16-4f97-85aa-10ffce47fd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:47.138113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26d6f2-3b16-4f97-85aa-10ffce47fd81 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:47.138396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26d6f2-3b16-4f97-85aa-10ffce47fd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:47.138671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e26d6f2-3b16-4f97-85aa-10ffce47fd81 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:47.139330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26d6f2-3b16-4f97-85aa-10ffce47fd81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:47.141287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e26d6f2-3b16-4f97-85aa-10ffce47fd81 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:47.164290 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1259/2530] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:10:47 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:10:47.167916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26d6f2-3b16-4f97-85aa-10ffce47fd81 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:47.177768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e26d6f2-3b16-4f97-85aa-10ffce47fd81 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:47.183087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55038b-2fd8-4529-9790-26257ba151d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:47.183711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55038b-2fd8-4529-9790-26257ba151d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:47.184094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55038b-2fd8-4529-9790-26257ba151d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:47.184404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55038b-2fd8-4529-9790-26257ba151d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:47.185213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55038b-2fd8-4529-9790-26257ba151d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:47.186983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55038b-2fd8-4529-9790-26257ba151d0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:47.191012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11389c51-4c89-4571-9c54-b046a27368d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:47.191623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11389c51-4c89-4571-9c54-b046a27368d3 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:47.191906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11389c51-4c89-4571-9c54-b046a27368d3 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:47.192180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11389c51-4c89-4571-9c54-b046a27368d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:47.198171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1260/2531] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:10:47.202033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55038b-2fd8-4529-9790-26257ba151d0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:47.211919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55038b-2fd8-4529-9790-26257ba151d0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:47.216537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d162d36-d048-409f-b1b9-9a5a0ef02ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:47.217124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d162d36-d048-409f-b1b9-9a5a0ef02ac8 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:47.217428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d162d36-d048-409f-b1b9-9a5a0ef02ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:47.217700 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d162d36-d048-409f-b1b9-9a5a0ef02ac8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:47.218378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d162d36-d048-409f-b1b9-9a5a0ef02ac8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:47.219955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d162d36-d048-409f-b1b9-9a5a0ef02ac8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:47.230176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1261/2532] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:10:47.234124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d162d36-d048-409f-b1b9-9a5a0ef02ac8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:47.244032 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d162d36-d048-409f-b1b9-9a5a0ef02ac8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:47.248541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a00b3-1fae-41f9-9093-1763168057fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:47.249158 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a00b3-1fae-41f9-9093-1763168057fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:47.249465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a00b3-1fae-41f9-9093-1763168057fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:47.249738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25a00b3-1fae-41f9-9093-1763168057fd admin admin] PATH_INFO: `/v3/projects/159d61af2345483c9f59f57286f45664/users/988b2fd89b3a49b4abd748d14560be75/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:47.255736 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11389c51-4c89-4571-9c54-b046a27368d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:47.257357 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11389c51-4c89-4571-9c54-b046a27368d3 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:47.265018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a00b3-1fae-41f9-9093-1763168057fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=159d61af2345483c9f59f57286f45664, user_id=988b2fd89b3a49b4abd748d14560be75, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:47.266449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1272/2533] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:10:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:10:47.267764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25a00b3-1fae-41f9-9093-1763168057fd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:47.281418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1262/2534] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:10:47 2022] PUT /identity/v3/projects/159d61af2345483c9f59f57286f45664/users/988b2fd89b3a49b4abd748d14560be75/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:10:47.286692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9f033-4949-459b-9641-87a41237c6ee None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:47.287036 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9f033-4949-459b-9641-87a41237c6ee None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:47.287366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9f033-4949-459b-9641-87a41237c6ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:47.314707 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-49c9f033-4949-459b-9641-87a41237c6ee None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:47.318221 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-49c9f033-4949-459b-9641-87a41237c6ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:47.388468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1273/2535] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:47.404554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a00b3-1fae-41f9-9093-1763168057fd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:47.404554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d25a00b3-1fae-41f9-9093-1763168057fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:47.410457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=3,keystone:SELECT=91,keystone:INSERT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:47.471495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25a00b3-1fae-41f9-9093-1763168057fd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:47.476598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600398d-e9eb-4284-83e5-2fe6da527586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:47.476598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600398d-e9eb-4284-83e5-2fe6da527586 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:47.476969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600398d-e9eb-4284-83e5-2fe6da527586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:47.478462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600398d-e9eb-4284-83e5-2fe6da527586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:47.489488 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600398d-e9eb-4284-83e5-2fe6da527586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:47.492545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600398d-e9eb-4284-83e5-2fe6da527586 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:47.502820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1263/2536] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:10:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:10:52.631802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfac079-03b2-4768-8049-504f284cf855 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:52.632743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfac079-03b2-4768-8049-504f284cf855 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:52.633282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfac079-03b2-4768-8049-504f284cf855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:52.667824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fbfac079-03b2-4768-8049-504f284cf855 None None] MFA Rules not processed for user `988b2fd89b3a49b4abd748d14560be75`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:52.669207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fbfac079-03b2-4768-8049-504f284cf855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:52.698028 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:52.822239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1274/2537] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:52.826880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600398d-e9eb-4284-83e5-2fe6da527586 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:52.849038 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600398d-e9eb-4284-83e5-2fe6da527586 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:52.861757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642446cb-7d0f-42a8-a0c0-d013a6883eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:52.862420 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642446cb-7d0f-42a8-a0c0-d013a6883eaf admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:52.863197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642446cb-7d0f-42a8-a0c0-d013a6883eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:52.863485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642446cb-7d0f-42a8-a0c0-d013a6883eaf admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:52.864343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642446cb-7d0f-42a8-a0c0-d013a6883eaf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:52.866792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642446cb-7d0f-42a8-a0c0-d013a6883eaf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:52.913333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfac079-03b2-4768-8049-504f284cf855 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:52.920887 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1264/2538] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:10:52 2022] POST /identity/v3/projects => generated 383 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:10:52.926376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfac079-03b2-4768-8049-504f284cf855 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:53.076974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a518f7f-1d12-42fc-9048-8c25a8fbdae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:53.076974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a518f7f-1d12-42fc-9048-8c25a8fbdae3 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:53.077719 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a518f7f-1d12-42fc-9048-8c25a8fbdae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:53.077719 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a518f7f-1d12-42fc-9048-8c25a8fbdae3 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:53.079002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a518f7f-1d12-42fc-9048-8c25a8fbdae3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:53.083692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a518f7f-1d12-42fc-9048-8c25a8fbdae3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:53.145003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1275/2539] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:10:52 2022] POST /identity/v3/users => generated 298 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:10:53.153730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642446cb-7d0f-42a8-a0c0-d013a6883eaf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:53.175817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642446cb-7d0f-42a8-a0c0-d013a6883eaf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:53.203580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c9788-ec05-4c10-9780-c10a25e387c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:53.207402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c9788-ec05-4c10-9780-c10a25e387c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:53.207998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c9788-ec05-4c10-9780-c10a25e387c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:53.208749 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02c9788-ec05-4c10-9780-c10a25e387c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:53.209930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c9788-ec05-4c10-9780-c10a25e387c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:53.212534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02c9788-ec05-4c10-9780-c10a25e387c8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:53.240148 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1265/2540] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:53.245747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a518f7f-1d12-42fc-9048-8c25a8fbdae3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:53.257404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a518f7f-1d12-42fc-9048-8c25a8fbdae3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:53.263530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdf29e-dbed-4432-9b48-907b4526d0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:53.264452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdf29e-dbed-4432-9b48-907b4526d0df admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:53.264947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdf29e-dbed-4432-9b48-907b4526d0df admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:53.265734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fdf29e-dbed-4432-9b48-907b4526d0df admin admin] PATH_INFO: `/v3/projects/d72a588e42af4dd6a93f644d8fdd8a0c/users/ae86b6a6148247d3b25c7534fc4d1898/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:53.294495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdf29e-dbed-4432-9b48-907b4526d0df admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72a588e42af4dd6a93f644d8fdd8a0c, user_id=ae86b6a6148247d3b25c7534fc4d1898, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:53.297677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fdf29e-dbed-4432-9b48-907b4526d0df admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:53.323725 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1276/2541] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:10:53 2022] PUT /identity/v3/projects/d72a588e42af4dd6a93f644d8fdd8a0c/users/ae86b6a6148247d3b25c7534fc4d1898/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:53.324960 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c9788-ec05-4c10-9780-c10a25e387c8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:53.336885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02c9788-ec05-4c10-9780-c10a25e387c8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:53.435587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4236ca97-179b-4568-8def-d01886db2c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:53.436956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236ca97-179b-4568-8def-d01886db2c3a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:53.437485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236ca97-179b-4568-8def-d01886db2c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:53.438061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4236ca97-179b-4568-8def-d01886db2c3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:53.440320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236ca97-179b-4568-8def-d01886db2c3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:53.448162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4236ca97-179b-4568-8def-d01886db2c3a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:53.466284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1266/2542] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:10:53.470797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdf29e-dbed-4432-9b48-907b4526d0df admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:53.482525 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fdf29e-dbed-4432-9b48-907b4526d0df admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:53.494277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de1c9c-842d-41e6-8b50-a5a1e37a10f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:53.494979 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de1c9c-842d-41e6-8b50-a5a1e37a10f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:53.495258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de1c9c-842d-41e6-8b50-a5a1e37a10f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:53.495531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80de1c9c-842d-41e6-8b50-a5a1e37a10f2 admin admin] PATH_INFO: `/v3/projects/d72a588e42af4dd6a93f644d8fdd8a0c/users/ae86b6a6148247d3b25c7534fc4d1898/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:53.497821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de1c9c-842d-41e6-8b50-a5a1e37a10f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d72a588e42af4dd6a93f644d8fdd8a0c, user_id=ae86b6a6148247d3b25c7534fc4d1898, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:10:53.502094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80de1c9c-842d-41e6-8b50-a5a1e37a10f2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:10:53.519345 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1277/2543] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:10:53 2022] PUT /identity/v3/projects/d72a588e42af4dd6a93f644d8fdd8a0c/users/ae86b6a6148247d3b25c7534fc4d1898/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:10:59.699308 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c7a4-6f51-48aa-b63a-a88ef3457f12 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:59.699308 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c7a4-6f51-48aa-b63a-a88ef3457f12 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:59.699846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f496c7a4-6f51-48aa-b63a-a88ef3457f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:10:59.740554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f496c7a4-6f51-48aa-b63a-a88ef3457f12 None None] MFA Rules not processed for user `ae86b6a6148247d3b25c7534fc4d1898`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:10:59.742124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f496c7a4-6f51-48aa-b63a-a88ef3457f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:59.819899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:10:59.888965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1267/2544] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:10:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:10:59.903579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de1c9c-842d-41e6-8b50-a5a1e37a10f2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:10:59.905600 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-80de1c9c-842d-41e6-8b50-a5a1e37a10f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:10:59.989045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80de1c9c-842d-41e6-8b50-a5a1e37a10f2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:10:59.993666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefe552-d038-48be-aa0f-ad29c925d1eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c358a2d9539c4ae2a5e12aa6f1ed6d61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:10:59.994299 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefe552-d038-48be-aa0f-ad29c925d1eb service glance] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:10:59.994584 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefe552-d038-48be-aa0f-ad29c925d1eb service glance] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:10:59.994852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefe552-d038-48be-aa0f-ad29c925d1eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:00.021261 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:11:00.104329 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefe552-d038-48be-aa0f-ad29c925d1eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:00.105861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fefe552-d038-48be-aa0f-ad29c925d1eb service glance] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:00.134132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1278/2545] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:10:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:11:00.291259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f18d9-4fb2-43d3-bed5-5e25bcfe35f0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:00.291565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f18d9-4fb2-43d3-bed5-5e25bcfe35f0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:00.291820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4f18d9-4fb2-43d3-bed5-5e25bcfe35f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:00.316936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3a4f18d9-4fb2-43d3-bed5-5e25bcfe35f0 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:11:00.318208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3a4f18d9-4fb2-43d3-bed5-5e25bcfe35f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:00.384376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1268/2546] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:11:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:11:00.397959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefe552-d038-48be-aa0f-ad29c925d1eb service glance] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:11:00.495607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefe552-d038-48be-aa0f-ad29c925d1eb service glance] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:11:00.500974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8caf4af7-2750-4aca-ae80-284473d84129 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:11:00.501831 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf4af7-2750-4aca-ae80-284473d84129 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:00.502207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf4af7-2750-4aca-ae80-284473d84129 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:00.502546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8caf4af7-2750-4aca-ae80-284473d84129 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:00.512682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf4af7-2750-4aca-ae80-284473d84129 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:00.514336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8caf4af7-2750-4aca-ae80-284473d84129 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:00.524596 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1279/2547] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:11:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:11:06.276855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c7005-984d-490b-ac49-325f771c1469 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:06.277446 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c7005-984d-490b-ac49-325f771c1469 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:06.277530 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c7005-984d-490b-ac49-325f771c1469 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:06.279544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1269/2548] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 12:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:11:06.291596 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57544449-828c-4566-b5da-213ab2ebd2c7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:06.294564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57544449-828c-4566-b5da-213ab2ebd2c7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:06.294564 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57544449-828c-4566-b5da-213ab2ebd2c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:06.330216 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-57544449-828c-4566-b5da-213ab2ebd2c7 None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:11:06.331423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-57544449-828c-4566-b5da-213ab2ebd2c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:06.425826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1280/2549] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 12:11:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:11:06.442870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c7005-984d-490b-ac49-325f771c1469 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:11:06.444633 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-453c7005-984d-490b-ac49-325f771c1469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:06.460263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c7005-984d-490b-ac49-325f771c1469 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:11:06.464649 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d252eb2-08ad-42e2-9b36-465514718481 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c358a2d9539c4ae2a5e12aa6f1ed6d61', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:11:06.465619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d252eb2-08ad-42e2-9b36-465514718481 service glance] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:06.466112 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d252eb2-08ad-42e2-9b36-465514718481 service glance] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:06.466601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d252eb2-08ad-42e2-9b36-465514718481 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:06.488754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d252eb2-08ad-42e2-9b36-465514718481 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:06.490614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d252eb2-08ad-42e2-9b36-465514718481 service glance] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:06.510709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1270/2550] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:11:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:11:06.590502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693db1d-3432-4e7c-a5bb-dc6436a05a86 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:06.590947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693db1d-3432-4e7c-a5bb-dc6436a05a86 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:06.591293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f693db1d-3432-4e7c-a5bb-dc6436a05a86 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:06.592825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1281/2551] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 12:11:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:11:06.598307 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13dcbe-b874-47c0-8f8a-d1983eb5c347 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:06.598714 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13dcbe-b874-47c0-8f8a-d1983eb5c347 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:06.599090 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e13dcbe-b874-47c0-8f8a-d1983eb5c347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:06.623458 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4e13dcbe-b874-47c0-8f8a-d1983eb5c347 None None] MFA Rules not processed for user `a2afb18a441549e3b853966ea1ad286e`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:11:06.624956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4e13dcbe-b874-47c0-8f8a-d1983eb5c347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:06.679660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1271/2552] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 12:11:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:11:06.693854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693db1d-3432-4e7c-a5bb-dc6436a05a86 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:11:06.695083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f693db1d-3432-4e7c-a5bb-dc6436a05a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:06.709054 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f693db1d-3432-4e7c-a5bb-dc6436a05a86 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:11:06.714215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e0f518-e5ec-46e2-b887-84a49f23b715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:11:06.714838 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0f518-e5ec-46e2-b887-84a49f23b715 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:06.715113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0f518-e5ec-46e2-b887-84a49f23b715 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:06.715392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e0f518-e5ec-46e2-b887-84a49f23b715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:06.723203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0f518-e5ec-46e2-b887-84a49f23b715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:06.724619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e0f518-e5ec-46e2-b887-84a49f23b715 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:06.734139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1282/2553] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:11:06 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:11:06.827236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c99c02-84f9-43a2-ac91-183447cc2059 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:06.827528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c99c02-84f9-43a2-ac91-183447cc2059 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:06.827807 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c99c02-84f9-43a2-ac91-183447cc2059 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:06.829504 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1272/2554] 10.222.0.42 () {54 vars in 921 bytes} [Mon Aug 1 12:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 12:11:06.834844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6d41c-1a52-4b80-8eb9-f9877da3b804 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:06.837541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6d41c-1a52-4b80-8eb9-f9877da3b804 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:06.837899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6d41c-1a52-4b80-8eb9-f9877da3b804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:06.862559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fcb6d41c-1a52-4b80-8eb9-f9877da3b804 None None] MFA Rules not processed for user `f85279b6b3474c77be0d8d569feea5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:11:06.864214 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fcb6d41c-1a52-4b80-8eb9-f9877da3b804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:06.877243 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1283/2555] 10.222.0.42 () {58 vars in 1018 bytes} [Mon Aug 1 12:11:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:11:06.888368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c99c02-84f9-43a2-ac91-183447cc2059 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:11:06.900461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c99c02-84f9-43a2-ac91-183447cc2059 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:11:06.904130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaf8c5-2162-44fc-85b0-a2e2adc22739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:11:06.904855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaf8c5-2162-44fc-85b0-a2e2adc22739 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:06.905150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaf8c5-2162-44fc-85b0-a2e2adc22739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:06.905458 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acaf8c5-2162-44fc-85b0-a2e2adc22739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:06.918033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acaf8c5-2162-44fc-85b0-a2e2adc22739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:06.919489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acaf8c5-2162-44fc-85b0-a2e2adc22739 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:06.931704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1273/2556] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:11:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:11:08.912635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22983-dbad-4a36-9f79-20a15e2dd3b6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:08.912635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22983-dbad-4a36-9f79-20a15e2dd3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:08.912635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b22983-dbad-4a36-9f79-20a15e2dd3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:08.932421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-18b22983-dbad-4a36-9f79-20a15e2dd3b6 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:11:08.933709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-18b22983-dbad-4a36-9f79-20a15e2dd3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:08.951433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1284/2557] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:11:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:11:08.963728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaf8c5-2162-44fc-85b0-a2e2adc22739 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:11:08.984619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acaf8c5-2162-44fc-85b0-a2e2adc22739 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:11:08.999358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2063d0f-7623-4a5c-bab2-31a8f83bff34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:11:08.999991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063d0f-7623-4a5c-bab2-31a8f83bff34 service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:09.000301 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063d0f-7623-4a5c-bab2-31a8f83bff34 service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:09.000758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2063d0f-7623-4a5c-bab2-31a8f83bff34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:09.010721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2063d0f-7623-4a5c-bab2-31a8f83bff34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:09.012338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2063d0f-7623-4a5c-bab2-31a8f83bff34 service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:09.020752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1274/2558] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:11:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:11:09.958962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b4045-5e93-415a-b2ab-4d77c7d9eb38 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:09.959352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b4045-5e93-415a-b2ab-4d77c7d9eb38 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:09.959526 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02b4045-5e93-415a-b2ab-4d77c7d9eb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:09.989990 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d02b4045-5e93-415a-b2ab-4d77c7d9eb38 None None] MFA Rules not processed for user `988b2fd89b3a49b4abd748d14560be75`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:11:09.991226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d02b4045-5e93-415a-b2ab-4d77c7d9eb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:10.012693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1285/2559] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:11:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:11:10.318409 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2063d0f-7623-4a5c-bab2-31a8f83bff34 service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:11:10.329014 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2063d0f-7623-4a5c-bab2-31a8f83bff34 service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:11:10.332791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea26b3c-ca81-4e4c-9ce8-5f775ad8fc27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:11:10.333458 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea26b3c-ca81-4e4c-9ce8-5f775ad8fc27 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:10.333795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea26b3c-ca81-4e4c-9ce8-5f775ad8fc27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:10.334053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea26b3c-ca81-4e4c-9ce8-5f775ad8fc27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:10.335871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cea26b3c-ca81-4e4c-9ce8-5f775ad8fc27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:10.347435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea26b3c-ca81-4e4c-9ce8-5f775ad8fc27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:10.348977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea26b3c-ca81-4e4c-9ce8-5f775ad8fc27 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:10.358353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1275/2560] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:11:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:11:19.979362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:11:20.354873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=74 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:11:26.343715 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bed5c-1dbe-49d8-8eb8-7536cf7b9cd5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:26.344227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bed5c-1dbe-49d8-8eb8-7536cf7b9cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:26.344328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bed5c-1dbe-49d8-8eb8-7536cf7b9cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:26.385773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ec3bed5c-1dbe-49d8-8eb8-7536cf7b9cd5 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:11:26.386990 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ec3bed5c-1dbe-49d8-8eb8-7536cf7b9cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:26.423407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1286/2561] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:11:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:11:26.440905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea26b3c-ca81-4e4c-9ce8-5f775ad8fc27 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:11:26.485851 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea26b3c-ca81-4e4c-9ce8-5f775ad8fc27 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:11:26.491084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818004dc-f46b-44b4-9600-cba15014f0c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:11:26.492222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818004dc-f46b-44b4-9600-cba15014f0c9 service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:26.492506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818004dc-f46b-44b4-9600-cba15014f0c9 service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:26.492781 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818004dc-f46b-44b4-9600-cba15014f0c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:26.500921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818004dc-f46b-44b4-9600-cba15014f0c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:26.502560 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818004dc-f46b-44b4-9600-cba15014f0c9 service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:26.511382 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1276/2562] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:11:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:11:36.420492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=23 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:11:36.507388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=20 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:11:38.903980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bed5c-1dbe-49d8-8eb8-7536cf7b9cd5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:11:38.905453 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ec3bed5c-1dbe-49d8-8eb8-7536cf7b9cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:38.943573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bed5c-1dbe-49d8-8eb8-7536cf7b9cd5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:11:38.949072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3feb33-c146-426a-b405-f8b48e325105 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:11:38.949711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3feb33-c146-426a-b405-f8b48e325105 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:38.949990 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3feb33-c146-426a-b405-f8b48e325105 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:38.950260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3feb33-c146-426a-b405-f8b48e325105 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:38.951973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0e3feb33-c146-426a-b405-f8b48e325105 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:38.964550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3feb33-c146-426a-b405-f8b48e325105 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:38.966188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3feb33-c146-426a-b405-f8b48e325105 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:38.978517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1287/2563] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:11:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:11:40.497285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d354-9157-45c2-b440-96ce50ca55c6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:40.497833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d354-9157-45c2-b440-96ce50ca55c6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:40.497938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16d354-9157-45c2-b440-96ce50ca55c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:40.517057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7c16d354-9157-45c2-b440-96ce50ca55c6 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:11:40.518320 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7c16d354-9157-45c2-b440-96ce50ca55c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:40.526154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1277/2564] 10.222.0.42 () {58 vars in 967 bytes} [Mon Aug 1 12:11:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:11:40.539951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3feb33-c146-426a-b405-f8b48e325105 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:11:40.557330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3feb33-c146-426a-b405-f8b48e325105 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:11:40.562399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37b9c4-c35c-42d2-b384-fa8d8d7d2a51 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:11:40.563005 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37b9c4-c35c-42d2-b384-fa8d8d7d2a51 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:40.563700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37b9c4-c35c-42d2-b384-fa8d8d7d2a51 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:40.563700 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce37b9c4-c35c-42d2-b384-fa8d8d7d2a51 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:40.572282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37b9c4-c35c-42d2-b384-fa8d8d7d2a51 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:40.573983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce37b9c4-c35c-42d2-b384-fa8d8d7d2a51 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:40.582835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1288/2565] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:11:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:11:50.511681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:11:50.578940 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=21 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:11:51.656715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d354-9157-45c2-b440-96ce50ca55c6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:11:51.658245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7c16d354-9157-45c2-b440-96ce50ca55c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:51.765446 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16d354-9157-45c2-b440-96ce50ca55c6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:11:51.770627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87435fec-3284-47f8-a5cb-741bfa45ba5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:11:51.771395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87435fec-3284-47f8-a5cb-741bfa45ba5a service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:51.772747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87435fec-3284-47f8-a5cb-741bfa45ba5a service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:51.772747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87435fec-3284-47f8-a5cb-741bfa45ba5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:51.774480 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-87435fec-3284-47f8-a5cb-741bfa45ba5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:51.789017 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87435fec-3284-47f8-a5cb-741bfa45ba5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:51.790665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87435fec-3284-47f8-a5cb-741bfa45ba5a service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:51.801440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1278/2566] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:11:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:11:56.363475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37b9c4-c35c-42d2-b384-fa8d8d7d2a51 service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:11:56.383516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce37b9c4-c35c-42d2-b384-fa8d8d7d2a51 service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:11:56.387627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd33fb3-671f-4ae1-bf04-43736e218975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:11:56.388503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33fb3-671f-4ae1-bf04-43736e218975 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:56.388772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33fb3-671f-4ae1-bf04-43736e218975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:56.389047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd33fb3-671f-4ae1-bf04-43736e218975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:56.401694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd33fb3-671f-4ae1-bf04-43736e218975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:56.403422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd33fb3-671f-4ae1-bf04-43736e218975 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:56.415093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1289/2567] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:11:56 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:11:57.559102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87435fec-3284-47f8-a5cb-741bfa45ba5a service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:11:57.568334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87435fec-3284-47f8-a5cb-741bfa45ba5a service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:11:57.572618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7b8b7-80b8-4c29-acca-c5896c59bdec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:11:57.573220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7b8b7-80b8-4c29-acca-c5896c59bdec service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:11:57.573527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7b8b7-80b8-4c29-acca-c5896c59bdec service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:11:57.573797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e7b8b7-80b8-4c29-acca-c5896c59bdec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:11:57.575527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-28e7b8b7-80b8-4c29-acca-c5896c59bdec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:11:57.669801 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7b8b7-80b8-4c29-acca-c5896c59bdec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:11:57.671265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e7b8b7-80b8-4c29-acca-c5896c59bdec service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:11:57.691654 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1279/2568] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:11:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:01.381035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd33fb3-671f-4ae1-bf04-43736e218975 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:01.383845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9dd33fb3-671f-4ae1-bf04-43736e218975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:01.408340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd33fb3-671f-4ae1-bf04-43736e218975 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:01.413612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675e548-b477-469d-a284-6b593c912d78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:01.414433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675e548-b477-469d-a284-6b593c912d78 service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:01.414792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675e548-b477-469d-a284-6b593c912d78 service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:01.415139 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675e548-b477-469d-a284-6b593c912d78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:01.417078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c675e548-b477-469d-a284-6b593c912d78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:01.430454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675e548-b477-469d-a284-6b593c912d78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:01.432035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675e548-b477-469d-a284-6b593c912d78 service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:01.446063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1290/2569] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:01.458044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7b8b7-80b8-4c29-acca-c5896c59bdec service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:01.460490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-28e7b8b7-80b8-4c29-acca-c5896c59bdec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:01.479358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e7b8b7-80b8-4c29-acca-c5896c59bdec service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:01.483925 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fd5ef9-ecac-4eaf-af53-1bd0f8875c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:01.484563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5ef9-ecac-4eaf-af53-1bd0f8875c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:01.484841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5ef9-ecac-4eaf-af53-1bd0f8875c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:01.485114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fd5ef9-ecac-4eaf-af53-1bd0f8875c17 admin admin] PATH_INFO: `/v3/users/f3cc3768b87844298b2b21ba8dc61662` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:01.486299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd5ef9-ecac-4eaf-af53-1bd0f8875c17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3cc3768b87844298b2b21ba8dc61662)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:01.488217 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fd5ef9-ecac-4eaf-af53-1bd0f8875c17 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:01.523484 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:01.537970 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d3fd5ef9-ecac-4eaf-af53-1bd0f8875c17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3cc3768b87844298b2b21ba8dc61662'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:01.538626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d3fd5ef9-ecac-4eaf-af53-1bd0f8875c17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3cc3768b87844298b2b21ba8dc61662'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:01.550553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d3fd5ef9-ecac-4eaf-af53-1bd0f8875c17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3cc3768b87844298b2b21ba8dc61662'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:01.557994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d3fd5ef9-ecac-4eaf-af53-1bd0f8875c17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3cc3768b87844298b2b21ba8dc61662'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:01.565069 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d3fd5ef9-ecac-4eaf-af53-1bd0f8875c17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3cc3768b87844298b2b21ba8dc61662'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:01.571652 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1280/2570] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:01 2022] DELETE /identity/v3/users/f3cc3768b87844298b2b21ba8dc61662 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:01.740401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675e548-b477-469d-a284-6b593c912d78 service placement] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:01.751764 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675e548-b477-469d-a284-6b593c912d78 service placement] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:01.810174 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f79cf19-514b-4583-b716-3afadc9cb688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:01.810815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79cf19-514b-4583-b716-3afadc9cb688 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:01.811094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79cf19-514b-4583-b716-3afadc9cb688 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:01.811364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f79cf19-514b-4583-b716-3afadc9cb688 admin admin] PATH_INFO: `/v3/projects/a07a9298c7534180a341c2b4b4c9c47e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:01.812536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79cf19-514b-4583-b716-3afadc9cb688 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a07a9298c7534180a341c2b4b4c9c47e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:01.814532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f79cf19-514b-4583-b716-3afadc9cb688 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:01.859502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4f79cf19-514b-4583-b716-3afadc9cb688 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a07a9298c7534180a341c2b4b4c9c47e', 'request_id': 'req-4f79cf19-514b-4583-b716-3afadc9cb688'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:01.865218 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4f79cf19-514b-4583-b716-3afadc9cb688 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a07a9298c7534180a341c2b4b4c9c47e', 'request_id': 'req-4f79cf19-514b-4583-b716-3afadc9cb688'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:01.872207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4f79cf19-514b-4583-b716-3afadc9cb688 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a07a9298c7534180a341c2b4b4c9c47e', 'request_id': 'req-4f79cf19-514b-4583-b716-3afadc9cb688'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:01.884117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4f79cf19-514b-4583-b716-3afadc9cb688 admin admin] The token cache is being invalidate because project a07a9298c7534180a341c2b4b4c9c47e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:01.884400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4f79cf19-514b-4583-b716-3afadc9cb688 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:01.885037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4f79cf19-514b-4583-b716-3afadc9cb688 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:01.886603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1291/2571] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:01 2022] DELETE /identity/v3/projects/a07a9298c7534180a341c2b4b4c9c47e => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:01.891615 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7a661-518c-41ef-8791-af38a136f7d9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:01.891958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7a661-518c-41ef-8791-af38a136f7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:01.892231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b7a661-518c-41ef-8791-af38a136f7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:01.950588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d3b7a661-518c-41ef-8791-af38a136f7d9 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:01.951801 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d3b7a661-518c-41ef-8791-af38a136f7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:02.010345 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1281/2572] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:02.018248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64e62b-04a7-42a8-9160-c1c1189e3b91 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.018535 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64e62b-04a7-42a8-9160-c1c1189e3b91 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.018806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db64e62b-04a7-42a8-9160-c1c1189e3b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.039698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-db64e62b-04a7-42a8-9160-c1c1189e3b91 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:02.040913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-db64e62b-04a7-42a8-9160-c1c1189e3b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:02.048778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1292/2573] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:02.053867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7a661-518c-41ef-8791-af38a136f7d9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:02.063888 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b7a661-518c-41ef-8791-af38a136f7d9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:02.068534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faab56-a22a-453e-a012-e89eecac0d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:02.069213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faab56-a22a-453e-a012-e89eecac0d31 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.069515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faab56-a22a-453e-a012-e89eecac0d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.069810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29faab56-a22a-453e-a012-e89eecac0d31 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.070543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faab56-a22a-453e-a012-e89eecac0d31 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:12:02.070842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faab56-a22a-453e-a012-e89eecac0d31 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:02.073391 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29faab56-a22a-453e-a012-e89eecac0d31 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:02.090966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1282/2574] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:12:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:12:02.095180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64e62b-04a7-42a8-9160-c1c1189e3b91 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:02.105154 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db64e62b-04a7-42a8-9160-c1c1189e3b91 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:02.109848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50cf7-f4a8-4d7b-a377-3254a2871d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:02.110457 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50cf7-f4a8-4d7b-a377-3254a2871d3a admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.110760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50cf7-f4a8-4d7b-a377-3254a2871d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.111044 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f50cf7-f4a8-4d7b-a377-3254a2871d3a admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.111694 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f50cf7-f4a8-4d7b-a377-3254a2871d3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:02.113672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f50cf7-f4a8-4d7b-a377-3254a2871d3a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:02.142431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1293/2575] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:02 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:12:02.146667 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faab56-a22a-453e-a012-e89eecac0d31 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:02.156995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29faab56-a22a-453e-a012-e89eecac0d31 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:02.211581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e0b61-5610-4c04-b8ea-b3379b82643a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:02.212213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e0b61-5610-4c04-b8ea-b3379b82643a admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.212487 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e0b61-5610-4c04-b8ea-b3379b82643a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.212758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e0b61-5610-4c04-b8ea-b3379b82643a admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.213434 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e0b61-5610-4c04-b8ea-b3379b82643a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:02.215353 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e0b61-5610-4c04-b8ea-b3379b82643a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:02.224885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:02.238131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1283/2576] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:02 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:02.242560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50cf7-f4a8-4d7b-a377-3254a2871d3a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:02.253000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f50cf7-f4a8-4d7b-a377-3254a2871d3a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:02.258042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489cc94-2d97-4cce-947e-16b96b4bcc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:02.258645 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489cc94-2d97-4cce-947e-16b96b4bcc88 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.258927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489cc94-2d97-4cce-947e-16b96b4bcc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.259203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489cc94-2d97-4cce-947e-16b96b4bcc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.259893 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489cc94-2d97-4cce-947e-16b96b4bcc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:02.261570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489cc94-2d97-4cce-947e-16b96b4bcc88 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:02.271728 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1294/2577] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:12:02.275962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e0b61-5610-4c04-b8ea-b3379b82643a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:02.285711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e0b61-5610-4c04-b8ea-b3379b82643a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:02.291076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e17bdd-753c-4f47-8a31-81622464c9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:02.291682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e17bdd-753c-4f47-8a31-81622464c9e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.291961 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e17bdd-753c-4f47-8a31-81622464c9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.292334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e17bdd-753c-4f47-8a31-81622464c9e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.293034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e17bdd-753c-4f47-8a31-81622464c9e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:02.294687 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e17bdd-753c-4f47-8a31-81622464c9e2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:02.305900 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1284/2578] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:02.309735 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489cc94-2d97-4cce-947e-16b96b4bcc88 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:02.319824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489cc94-2d97-4cce-947e-16b96b4bcc88 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:02.324439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be53bb1-cade-4159-a7b7-1fe8a164f38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:02.325097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be53bb1-cade-4159-a7b7-1fe8a164f38f admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.325404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be53bb1-cade-4159-a7b7-1fe8a164f38f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.325679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be53bb1-cade-4159-a7b7-1fe8a164f38f admin admin] PATH_INFO: `/v3/projects/2135a6d43d284b0c8ab170a4162fe71a/users/a7bbd5aefe8140758c440edbbbac7157/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.338002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:02.341208 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be53bb1-cade-4159-a7b7-1fe8a164f38f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2135a6d43d284b0c8ab170a4162fe71a, user_id=a7bbd5aefe8140758c440edbbbac7157, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:02.343991 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be53bb1-cade-4159-a7b7-1fe8a164f38f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:02.358851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1295/2579] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:02 2022] PUT /identity/v3/projects/2135a6d43d284b0c8ab170a4162fe71a/users/a7bbd5aefe8140758c440edbbbac7157/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:02.370470 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc28b1-c6a2-4cec-89db-5212d94d0b84 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.370757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc28b1-c6a2-4cec-89db-5212d94d0b84 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.371031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc28b1-c6a2-4cec-89db-5212d94d0b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.404102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8cdc28b1-c6a2-4cec-89db-5212d94d0b84 None None] MFA Rules not processed for user `a7bbd5aefe8140758c440edbbbac7157`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:02.405390 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8cdc28b1-c6a2-4cec-89db-5212d94d0b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:02.486393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1285/2580] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:02.490890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be53bb1-cade-4159-a7b7-1fe8a164f38f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:02.551861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be53bb1-cade-4159-a7b7-1fe8a164f38f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:02.556374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b096c-53e9-48f7-9eeb-67749cd41a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:02.556980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b096c-53e9-48f7-9eeb-67749cd41a68 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.557258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b096c-53e9-48f7-9eeb-67749cd41a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.557560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26b096c-53e9-48f7-9eeb-67749cd41a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.558224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b096c-53e9-48f7-9eeb-67749cd41a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:02.560122 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26b096c-53e9-48f7-9eeb-67749cd41a68 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:02.586947 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1296/2581] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:02 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:02.590999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc28b1-c6a2-4cec-89db-5212d94d0b84 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:02.601647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc28b1-c6a2-4cec-89db-5212d94d0b84 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:02.656357 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ce738-2666-451d-9d7e-4885c3f97ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:02.656965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ce738-2666-451d-9d7e-4885c3f97ce1 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.657241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ce738-2666-451d-9d7e-4885c3f97ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.657540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ce738-2666-451d-9d7e-4885c3f97ce1 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.658188 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ce738-2666-451d-9d7e-4885c3f97ce1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:02.660133 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ce738-2666-451d-9d7e-4885c3f97ce1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:02.680893 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1286/2582] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:02 2022] POST /identity/v3/users => generated 296 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:12:02.684954 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b096c-53e9-48f7-9eeb-67749cd41a68 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:02.695604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26b096c-53e9-48f7-9eeb-67749cd41a68 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:02.700266 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b57e9-037b-4c7c-b352-0585ef0a2583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:02.700891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b57e9-037b-4c7c-b352-0585ef0a2583 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.701169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b57e9-037b-4c7c-b352-0585ef0a2583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.701480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b57e9-037b-4c7c-b352-0585ef0a2583 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.702162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b57e9-037b-4c7c-b352-0585ef0a2583 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:02.703740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36b57e9-037b-4c7c-b352-0585ef0a2583 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:02.714810 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1297/2583] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:02.719080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ce738-2666-451d-9d7e-4885c3f97ce1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:02.729013 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ce738-2666-451d-9d7e-4885c3f97ce1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:02.733672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58229e01-33b8-40a4-bb96-987d46dd71c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:02.734318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58229e01-33b8-40a4-bb96-987d46dd71c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.734606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58229e01-33b8-40a4-bb96-987d46dd71c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.734877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58229e01-33b8-40a4-bb96-987d46dd71c0 admin admin] PATH_INFO: `/v3/projects/fa1f37f7b2ff4a478d1d645be1946889/users/54f2ac1ec0a748489870d2c64a7e131a/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.750157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58229e01-33b8-40a4-bb96-987d46dd71c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1f37f7b2ff4a478d1d645be1946889, user_id=54f2ac1ec0a748489870d2c64a7e131a, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:02.752894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58229e01-33b8-40a4-bb96-987d46dd71c0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:02.769680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1287/2584] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:02 2022] PUT /identity/v3/projects/fa1f37f7b2ff4a478d1d645be1946889/users/54f2ac1ec0a748489870d2c64a7e131a/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:02.774253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b57e9-037b-4c7c-b352-0585ef0a2583 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:02.784781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b57e9-037b-4c7c-b352-0585ef0a2583 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:02.839428 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70b6051-65b9-4883-aabf-90e8bbaef83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:02.839953 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6051-65b9-4883-aabf-90e8bbaef83f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.840229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6051-65b9-4883-aabf-90e8bbaef83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.840494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70b6051-65b9-4883-aabf-90e8bbaef83f admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.841167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b6051-65b9-4883-aabf-90e8bbaef83f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:02.842779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70b6051-65b9-4883-aabf-90e8bbaef83f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:02.852247 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1298/2585] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:02.856450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58229e01-33b8-40a4-bb96-987d46dd71c0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:02.867428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58229e01-33b8-40a4-bb96-987d46dd71c0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:02.871960 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e8dfa-03b3-4448-a690-cc56dbc93443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:02.872604 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e8dfa-03b3-4448-a690-cc56dbc93443 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.872884 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e8dfa-03b3-4448-a690-cc56dbc93443 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.873155 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5e8dfa-03b3-4448-a690-cc56dbc93443 admin admin] PATH_INFO: `/v3/projects/fa1f37f7b2ff4a478d1d645be1946889/users/54f2ac1ec0a748489870d2c64a7e131a/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.875131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e8dfa-03b3-4448-a690-cc56dbc93443 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1f37f7b2ff4a478d1d645be1946889, user_id=54f2ac1ec0a748489870d2c64a7e131a, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:02.877806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5e8dfa-03b3-4448-a690-cc56dbc93443 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:02.888182 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1288/2586] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:02 2022] PUT /identity/v3/projects/fa1f37f7b2ff4a478d1d645be1946889/users/54f2ac1ec0a748489870d2c64a7e131a/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:02.898784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed619d5-bfc1-4693-a597-67685f304053 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:02.899069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed619d5-bfc1-4693-a597-67685f304053 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:02.899342 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed619d5-bfc1-4693-a597-67685f304053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:02.926512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4ed619d5-bfc1-4693-a597-67685f304053 None None] MFA Rules not processed for user `54f2ac1ec0a748489870d2c64a7e131a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:02.927722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4ed619d5-bfc1-4693-a597-67685f304053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:02.974284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:02.996188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1299/2587] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:03.008031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e8dfa-03b3-4448-a690-cc56dbc93443 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:03.009784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5c5e8dfa-03b3-4448-a690-cc56dbc93443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:03.042103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:03.104507 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5e8dfa-03b3-4448-a690-cc56dbc93443 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:03.108293 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc5ea7-426c-480a-b6c5-d7a2ac195346 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:03.108901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc5ea7-426c-480a-b6c5-d7a2ac195346 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:03.109176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc5ea7-426c-480a-b6c5-d7a2ac195346 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:03.109472 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc5ea7-426c-480a-b6c5-d7a2ac195346 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:03.119393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc5ea7-426c-480a-b6c5-d7a2ac195346 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:03.120832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbc5ea7-426c-480a-b6c5-d7a2ac195346 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:03.130135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1289/2588] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:03 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:03.204283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed619d5-bfc1-4693-a597-67685f304053 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:03.213762 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed619d5-bfc1-4693-a597-67685f304053 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:03.217334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c66710d-80b7-48f0-a083-d9632c79b8ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:03.217942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66710d-80b7-48f0-a083-d9632c79b8ed service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:03.218223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66710d-80b7-48f0-a083-d9632c79b8ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:03.218498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c66710d-80b7-48f0-a083-d9632c79b8ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:03.274287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66710d-80b7-48f0-a083-d9632c79b8ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:03.275708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c66710d-80b7-48f0-a083-d9632c79b8ed service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:03.284417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1300/2589] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:10.031496 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc5ea7-426c-480a-b6c5-d7a2ac195346 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:10.093124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc5ea7-426c-480a-b6c5-d7a2ac195346 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:10.097681 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:10.098312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:10.098592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:10.098864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] PATH_INFO: `/v3/users/a7bbd5aefe8140758c440edbbbac7157` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:10.100010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7bbd5aefe8140758c440edbbbac7157)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:10.101973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:10.149209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7bbd5aefe8140758c440edbbbac7157'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.149828 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7bbd5aefe8140758c440edbbbac7157'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.161500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7bbd5aefe8140758c440edbbbac7157'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.168116 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7bbd5aefe8140758c440edbbbac7157'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.175498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7bbd5aefe8140758c440edbbbac7157'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.181625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1290/2590] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:10 2022] DELETE /identity/v3/users/a7bbd5aefe8140758c440edbbbac7157 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:10.186141 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1985aed-4219-4342-a41b-844811ca546e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:10.186624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1985aed-4219-4342-a41b-844811ca546e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:10.186719 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1985aed-4219-4342-a41b-844811ca546e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:10.206047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e1985aed-4219-4342-a41b-844811ca546e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:10.207242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e1985aed-4219-4342-a41b-844811ca546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:10.264204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1301/2591] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:12:10.274342 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:10.275717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:10.305366 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:10.346150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb820175-2bab-4064-ad74-9667dd741298 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:10.349950 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d41dd-8e8d-4ca0-b92a-ea4d755a2ca4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:10.350546 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d41dd-8e8d-4ca0-b92a-ea4d755a2ca4 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:10.350820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d41dd-8e8d-4ca0-b92a-ea4d755a2ca4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:10.351087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924d41dd-8e8d-4ca0-b92a-ea4d755a2ca4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:10.359947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d41dd-8e8d-4ca0-b92a-ea4d755a2ca4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:10.361461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924d41dd-8e8d-4ca0-b92a-ea4d755a2ca4 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:10.371154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1291/2592] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:10.645827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1985aed-4219-4342-a41b-844811ca546e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:10.647265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e1985aed-4219-4342-a41b-844811ca546e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:10.661592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1985aed-4219-4342-a41b-844811ca546e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:10.667053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:10.667882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:10.668168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:10.668449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] PATH_INFO: `/v3/projects/2135a6d43d284b0c8ab170a4162fe71a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:10.669866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2135a6d43d284b0c8ab170a4162fe71a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:10.672421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:10.722669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2135a6d43d284b0c8ab170a4162fe71a', 'request_id': 'req-9156bb5b-ff6b-485c-9086-476e93a74381'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.728781 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2135a6d43d284b0c8ab170a4162fe71a', 'request_id': 'req-9156bb5b-ff6b-485c-9086-476e93a74381'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.734901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2135a6d43d284b0c8ab170a4162fe71a', 'request_id': 'req-9156bb5b-ff6b-485c-9086-476e93a74381'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.748950 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] The token cache is being invalidate because project 2135a6d43d284b0c8ab170a4162fe71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:10.749596 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.750643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.752965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1302/2593] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:10 2022] DELETE /identity/v3/projects/2135a6d43d284b0c8ab170a4162fe71a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:10.756983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d41dd-8e8d-4ca0-b92a-ea4d755a2ca4 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:10.766652 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924d41dd-8e8d-4ca0-b92a-ea4d755a2ca4 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:10.827606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3457c3d-fa3c-4e32-8e01-fbaab53a1322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:10.828241 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3457c3d-fa3c-4e32-8e01-fbaab53a1322 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:10.828520 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3457c3d-fa3c-4e32-8e01-fbaab53a1322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:10.828792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3457c3d-fa3c-4e32-8e01-fbaab53a1322 admin admin] PATH_INFO: `/v3/users/54f2ac1ec0a748489870d2c64a7e131a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:10.829967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3457c3d-fa3c-4e32-8e01-fbaab53a1322 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54f2ac1ec0a748489870d2c64a7e131a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:10.831917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3457c3d-fa3c-4e32-8e01-fbaab53a1322 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:10.877166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f3457c3d-fa3c-4e32-8e01-fbaab53a1322 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54f2ac1ec0a748489870d2c64a7e131a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.877995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f3457c3d-fa3c-4e32-8e01-fbaab53a1322 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54f2ac1ec0a748489870d2c64a7e131a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.889503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f3457c3d-fa3c-4e32-8e01-fbaab53a1322 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54f2ac1ec0a748489870d2c64a7e131a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.896404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f3457c3d-fa3c-4e32-8e01-fbaab53a1322 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54f2ac1ec0a748489870d2c64a7e131a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.902844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f3457c3d-fa3c-4e32-8e01-fbaab53a1322 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54f2ac1ec0a748489870d2c64a7e131a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:10.908673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1292/2594] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:10 2022] DELETE /identity/v3/users/54f2ac1ec0a748489870d2c64a7e131a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:11.187945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:11.189140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:11.203186 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9156bb5b-ff6b-485c-9086-476e93a74381 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:11.208194 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:11.263844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553ecc2b-2dda-4f2e-a105-36d154438a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:11.264410 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ecc2b-2dda-4f2e-a105-36d154438a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:11.264693 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ecc2b-2dda-4f2e-a105-36d154438a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:11.264968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553ecc2b-2dda-4f2e-a105-36d154438a94 admin admin] PATH_INFO: `/v3/projects/fa1f37f7b2ff4a478d1d645be1946889` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:11.266191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ecc2b-2dda-4f2e-a105-36d154438a94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1f37f7b2ff4a478d1d645be1946889)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:11.268117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553ecc2b-2dda-4f2e-a105-36d154438a94 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:11.313701 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-553ecc2b-2dda-4f2e-a105-36d154438a94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1f37f7b2ff4a478d1d645be1946889', 'request_id': 'req-553ecc2b-2dda-4f2e-a105-36d154438a94'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:11.319185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-553ecc2b-2dda-4f2e-a105-36d154438a94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1f37f7b2ff4a478d1d645be1946889', 'request_id': 'req-553ecc2b-2dda-4f2e-a105-36d154438a94'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:11.325865 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-553ecc2b-2dda-4f2e-a105-36d154438a94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1f37f7b2ff4a478d1d645be1946889', 'request_id': 'req-553ecc2b-2dda-4f2e-a105-36d154438a94'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:11.338077 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-553ecc2b-2dda-4f2e-a105-36d154438a94 admin admin] The token cache is being invalidate because project fa1f37f7b2ff4a478d1d645be1946889 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:11.338361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-553ecc2b-2dda-4f2e-a105-36d154438a94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:11.338978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-553ecc2b-2dda-4f2e-a105-36d154438a94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:11.340589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1303/2595] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:11 2022] DELETE /identity/v3/projects/fa1f37f7b2ff4a478d1d645be1946889 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:11.345811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095326ea-64e6-44e2-9522-848a40f15556 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:11.346283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095326ea-64e6-44e2-9522-848a40f15556 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:11.346383 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095326ea-64e6-44e2-9522-848a40f15556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:11.365330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-095326ea-64e6-44e2-9522-848a40f15556 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:11.366524 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-095326ea-64e6-44e2-9522-848a40f15556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:11.399251 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:11.426650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1293/2596] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:11.434773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d6668-d555-4b6a-9bf2-fa864187ec74 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:11.435136 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d6668-d555-4b6a-9bf2-fa864187ec74 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:11.435408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d6668-d555-4b6a-9bf2-fa864187ec74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:11.455204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b50d6668-d555-4b6a-9bf2-fa864187ec74 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:11.456817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b50d6668-d555-4b6a-9bf2-fa864187ec74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:11.464541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1304/2597] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:11.468658 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095326ea-64e6-44e2-9522-848a40f15556 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:11.478796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095326ea-64e6-44e2-9522-848a40f15556 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:11.483540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd71cce-0b2a-481e-bd63-c8e0738ce5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:11.484142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd71cce-0b2a-481e-bd63-c8e0738ce5d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:11.484422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd71cce-0b2a-481e-bd63-c8e0738ce5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:11.484692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd71cce-0b2a-481e-bd63-c8e0738ce5d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:11.485406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd71cce-0b2a-481e-bd63-c8e0738ce5d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:12:11.485708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd71cce-0b2a-481e-bd63-c8e0738ce5d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:11.487318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd71cce-0b2a-481e-bd63-c8e0738ce5d8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:11.499742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1294/2598] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:12:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:12:11.504120 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d6668-d555-4b6a-9bf2-fa864187ec74 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:11.513288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d6668-d555-4b6a-9bf2-fa864187ec74 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:11.517936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a791913-7e58-40d6-a652-555847337944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:11.518502 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a791913-7e58-40d6-a652-555847337944 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:11.518778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a791913-7e58-40d6-a652-555847337944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:11.519094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a791913-7e58-40d6-a652-555847337944 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:11.519753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a791913-7e58-40d6-a652-555847337944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:11.521663 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a791913-7e58-40d6-a652-555847337944 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:11.548013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1305/2599] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:11 2022] POST /identity/v3/projects => generated 365 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:11.552070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd71cce-0b2a-481e-bd63-c8e0738ce5d8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:11.562613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd71cce-0b2a-481e-bd63-c8e0738ce5d8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:11.619434 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f6a82-d73f-48b1-95ca-4360b5447a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:11.620035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f6a82-d73f-48b1-95ca-4360b5447a1b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:11.620311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f6a82-d73f-48b1-95ca-4360b5447a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:11.620578 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091f6a82-d73f-48b1-95ca-4360b5447a1b admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:11.621224 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f6a82-d73f-48b1-95ca-4360b5447a1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:11.623173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091f6a82-d73f-48b1-95ca-4360b5447a1b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:11.643798 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1295/2600] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:11 2022] POST /identity/v3/users => generated 283 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:11.647899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a791913-7e58-40d6-a652-555847337944 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:11.658239 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a791913-7e58-40d6-a652-555847337944 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:11.662942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990593-ebdb-4ae6-a94f-e581889bec18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:11.663550 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990593-ebdb-4ae6-a94f-e581889bec18 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:11.663828 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990593-ebdb-4ae6-a94f-e581889bec18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:11.664103 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd990593-ebdb-4ae6-a94f-e581889bec18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:11.665323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd990593-ebdb-4ae6-a94f-e581889bec18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:11.666943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd990593-ebdb-4ae6-a94f-e581889bec18 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:11.676808 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1306/2601] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:11.681081 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f6a82-d73f-48b1-95ca-4360b5447a1b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:11.691059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091f6a82-d73f-48b1-95ca-4360b5447a1b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:11.700955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c9bf3c-cd03-4e8a-8899-f44031b5040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:11.701746 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9bf3c-cd03-4e8a-8899-f44031b5040d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:11.702024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9bf3c-cd03-4e8a-8899-f44031b5040d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:11.702292 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c9bf3c-cd03-4e8a-8899-f44031b5040d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:11.702992 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9bf3c-cd03-4e8a-8899-f44031b5040d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:11.704622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c9bf3c-cd03-4e8a-8899-f44031b5040d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:11.715827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1296/2602] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:11.720113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990593-ebdb-4ae6-a94f-e581889bec18 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:11.730545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd990593-ebdb-4ae6-a94f-e581889bec18 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:11.735137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088e4fd-9e3f-4429-8c22-aaa2318ab141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:11.735786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088e4fd-9e3f-4429-8c22-aaa2318ab141 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:11.736063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088e4fd-9e3f-4429-8c22-aaa2318ab141 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:11.736333 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088e4fd-9e3f-4429-8c22-aaa2318ab141 admin admin] PATH_INFO: `/v3/projects/f77ea0c3d0e44a1ba1009460a07b816c/users/7f826fc1c87e4b55913b8175b020d962/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:11.751357 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088e4fd-9e3f-4429-8c22-aaa2318ab141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f77ea0c3d0e44a1ba1009460a07b816c, user_id=7f826fc1c87e4b55913b8175b020d962, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:11.754044 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088e4fd-9e3f-4429-8c22-aaa2318ab141 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:11.766818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1307/2603] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:11 2022] PUT /identity/v3/projects/f77ea0c3d0e44a1ba1009460a07b816c/users/7f826fc1c87e4b55913b8175b020d962/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:11.778198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb8bf7-7dee-410a-bcd3-9aa830e3aead None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:11.778414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb8bf7-7dee-410a-bcd3-9aa830e3aead None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:11.778683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb8bf7-7dee-410a-bcd3-9aa830e3aead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:11.806489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-94cb8bf7-7dee-410a-bcd3-9aa830e3aead None None] MFA Rules not processed for user `7f826fc1c87e4b55913b8175b020d962`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:11.807862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-94cb8bf7-7dee-410a-bcd3-9aa830e3aead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:11.874824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1297/2604] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:11.879337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088e4fd-9e3f-4429-8c22-aaa2318ab141 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:11.918213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:11.941365 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088e4fd-9e3f-4429-8c22-aaa2318ab141 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:11.946007 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3690c0-d177-4ba7-9303-914b82ddc6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:11.946616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3690c0-d177-4ba7-9303-914b82ddc6f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:11.946897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3690c0-d177-4ba7-9303-914b82ddc6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:11.947170 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3690c0-d177-4ba7-9303-914b82ddc6f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:11.947823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3690c0-d177-4ba7-9303-914b82ddc6f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:11.949754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3690c0-d177-4ba7-9303-914b82ddc6f1 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:11.975713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1308/2605] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:11 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:11.980265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb8bf7-7dee-410a-bcd3-9aa830e3aead None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:11.990915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb8bf7-7dee-410a-bcd3-9aa830e3aead None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:12.020253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:12.048072 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52eec9-c5ba-40a9-952e-f60bc6a5fefe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:12.048635 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52eec9-c5ba-40a9-952e-f60bc6a5fefe admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:12.048911 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52eec9-c5ba-40a9-952e-f60bc6a5fefe admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:12.049176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52eec9-c5ba-40a9-952e-f60bc6a5fefe admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:12.049861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52eec9-c5ba-40a9-952e-f60bc6a5fefe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:12.051778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52eec9-c5ba-40a9-952e-f60bc6a5fefe admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:12.073850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1298/2606] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:11 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:12.077763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3690c0-d177-4ba7-9303-914b82ddc6f1 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:12.088468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3690c0-d177-4ba7-9303-914b82ddc6f1 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:12.093110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d0ca0-b1ad-4d1c-b544-ca84793784e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:12.093747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d0ca0-b1ad-4d1c-b544-ca84793784e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:12.094026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d0ca0-b1ad-4d1c-b544-ca84793784e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:12.094298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4d0ca0-b1ad-4d1c-b544-ca84793784e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:12.095000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d0ca0-b1ad-4d1c-b544-ca84793784e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:12.096571 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4d0ca0-b1ad-4d1c-b544-ca84793784e7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:12.107682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1309/2607] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:12.112599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52eec9-c5ba-40a9-952e-f60bc6a5fefe admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:12.123563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52eec9-c5ba-40a9-952e-f60bc6a5fefe admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:12.128275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de4344-6308-4d67-848c-733efc8100da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:12.128924 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de4344-6308-4d67-848c-733efc8100da admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:12.129199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de4344-6308-4d67-848c-733efc8100da admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:12.129493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de4344-6308-4d67-848c-733efc8100da admin admin] PATH_INFO: `/v3/projects/1f22e0c486b046d5985dd0cc8b9ed284/users/dab530b41ce74729a7de0ab7efea4552/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:12.144372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de4344-6308-4d67-848c-733efc8100da admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f22e0c486b046d5985dd0cc8b9ed284, user_id=dab530b41ce74729a7de0ab7efea4552, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:12.147102 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de4344-6308-4d67-848c-733efc8100da admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:12.160111 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1299/2608] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:12 2022] PUT /identity/v3/projects/1f22e0c486b046d5985dd0cc8b9ed284/users/dab530b41ce74729a7de0ab7efea4552/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:12.164080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d0ca0-b1ad-4d1c-b544-ca84793784e7 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:12.174632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4d0ca0-b1ad-4d1c-b544-ca84793784e7 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:12.230166 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ead0ca-b17d-4994-b0d1-a2b31e70c9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:12.230811 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ead0ca-b17d-4994-b0d1-a2b31e70c9ca admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:12.231042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ead0ca-b17d-4994-b0d1-a2b31e70c9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:12.231314 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ead0ca-b17d-4994-b0d1-a2b31e70c9ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:12.232001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ead0ca-b17d-4994-b0d1-a2b31e70c9ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:12.233658 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ead0ca-b17d-4994-b0d1-a2b31e70c9ca admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:12.243562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1310/2609] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:12.248081 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de4344-6308-4d67-848c-733efc8100da admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:12.258721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de4344-6308-4d67-848c-733efc8100da admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:12.263316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63f70a-48d2-4ccf-b445-cadabeb3e670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:12.263964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63f70a-48d2-4ccf-b445-cadabeb3e670 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:12.264243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63f70a-48d2-4ccf-b445-cadabeb3e670 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:12.264517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb63f70a-48d2-4ccf-b445-cadabeb3e670 admin admin] PATH_INFO: `/v3/projects/1f22e0c486b046d5985dd0cc8b9ed284/users/dab530b41ce74729a7de0ab7efea4552/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:12.266688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63f70a-48d2-4ccf-b445-cadabeb3e670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f22e0c486b046d5985dd0cc8b9ed284, user_id=dab530b41ce74729a7de0ab7efea4552, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:12.269417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb63f70a-48d2-4ccf-b445-cadabeb3e670 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:12.280198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1300/2610] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:12 2022] PUT /identity/v3/projects/1f22e0c486b046d5985dd0cc8b9ed284/users/dab530b41ce74729a7de0ab7efea4552/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:12.290324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd695bdd-2860-4b05-b1b1-05748c88e653 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:12.290615 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd695bdd-2860-4b05-b1b1-05748c88e653 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:12.290892 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd695bdd-2860-4b05-b1b1-05748c88e653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:12.318837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fd695bdd-2860-4b05-b1b1-05748c88e653 None None] MFA Rules not processed for user `dab530b41ce74729a7de0ab7efea4552`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:12.320073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fd695bdd-2860-4b05-b1b1-05748c88e653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:12.387252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1311/2611] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:12.399972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63f70a-48d2-4ccf-b445-cadabeb3e670 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:12.401755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cb63f70a-48d2-4ccf-b445-cadabeb3e670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:12.457537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb63f70a-48d2-4ccf-b445-cadabeb3e670 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:12.461788 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c628887-5163-4dd3-87cc-52727b5f3f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:12.462389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c628887-5163-4dd3-87cc-52727b5f3f99 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:12.462663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c628887-5163-4dd3-87cc-52727b5f3f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:12.462931 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c628887-5163-4dd3-87cc-52727b5f3f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:12.471663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c628887-5163-4dd3-87cc-52727b5f3f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:12.473084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c628887-5163-4dd3-87cc-52727b5f3f99 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:12.482374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1301/2612] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:12:12.557806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd695bdd-2860-4b05-b1b1-05748c88e653 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:12.567330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd695bdd-2860-4b05-b1b1-05748c88e653 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:12.571425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d599dd88-6c65-4a29-b050-f657149c4c3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:12.572079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599dd88-6c65-4a29-b050-f657149c4c3f service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:12.572361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599dd88-6c65-4a29-b050-f657149c4c3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:12.572631 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d599dd88-6c65-4a29-b050-f657149c4c3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:12.601532 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:12.630517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599dd88-6c65-4a29-b050-f657149c4c3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:12.631986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d599dd88-6c65-4a29-b050-f657149c4c3f service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:12.641414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1312/2613] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:12 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:19.601362 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c628887-5163-4dd3-87cc-52727b5f3f99 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:19.666989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c628887-5163-4dd3-87cc-52727b5f3f99 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:19.671553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:19.672180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:19.672461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:19.672735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] PATH_INFO: `/v3/users/7f826fc1c87e4b55913b8175b020d962` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:19.673905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f826fc1c87e4b55913b8175b020d962)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:19.675861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:19.708525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:19.723483 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f826fc1c87e4b55913b8175b020d962'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:19.724140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f826fc1c87e4b55913b8175b020d962'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:19.736282 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f826fc1c87e4b55913b8175b020d962'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:19.744108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f826fc1c87e4b55913b8175b020d962'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:19.751517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f826fc1c87e4b55913b8175b020d962'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:19.757373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1302/2614] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:19 2022] DELETE /identity/v3/users/7f826fc1c87e4b55913b8175b020d962 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:19.761806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7cc9b-8fb0-4fa0-9997-feba74ed5bac None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:19.762292 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7cc9b-8fb0-4fa0-9997-feba74ed5bac None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:19.762397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a7cc9b-8fb0-4fa0-9997-feba74ed5bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:19.780827 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b4a7cc9b-8fb0-4fa0-9997-feba74ed5bac None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:19.782058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b4a7cc9b-8fb0-4fa0-9997-feba74ed5bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:19.841244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1313/2615] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:19.851092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:19.853204 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:19.909930 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4e754-1df2-40d1-8f9d-0fa99c462b7b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:19.913580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8879a4-8be4-4a4a-bf3c-f5870abe303a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:19.914780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8879a4-8be4-4a4a-bf3c-f5870abe303a service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:19.915127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8879a4-8be4-4a4a-bf3c-f5870abe303a service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:19.915428 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8879a4-8be4-4a4a-bf3c-f5870abe303a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:19.924433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8879a4-8be4-4a4a-bf3c-f5870abe303a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:19.925921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8879a4-8be4-4a4a-bf3c-f5870abe303a service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:19.936019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1303/2616] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:20.201574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7cc9b-8fb0-4fa0-9997-feba74ed5bac None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:20.203035 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b4a7cc9b-8fb0-4fa0-9997-feba74ed5bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:20.216122 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a7cc9b-8fb0-4fa0-9997-feba74ed5bac None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:20.220731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:20.221546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:20.221945 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:20.222221 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] PATH_INFO: `/v3/projects/f77ea0c3d0e44a1ba1009460a07b816c` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:20.223368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f77ea0c3d0e44a1ba1009460a07b816c)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:20.225260 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:20.279808 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f77ea0c3d0e44a1ba1009460a07b816c', 'request_id': 'req-0a1b52e0-faa4-4930-9f00-255c1730b927'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.285180 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f77ea0c3d0e44a1ba1009460a07b816c', 'request_id': 'req-0a1b52e0-faa4-4930-9f00-255c1730b927'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.292124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f77ea0c3d0e44a1ba1009460a07b816c', 'request_id': 'req-0a1b52e0-faa4-4930-9f00-255c1730b927'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.305531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] The token cache is being invalidate because project f77ea0c3d0e44a1ba1009460a07b816c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:20.306315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.306460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.307971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1314/2617] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:20 2022] DELETE /identity/v3/projects/f77ea0c3d0e44a1ba1009460a07b816c => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:20.312040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8879a4-8be4-4a4a-bf3c-f5870abe303a service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:20.322167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8879a4-8be4-4a4a-bf3c-f5870abe303a service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:20.377256 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0511e73-8771-4b73-9c9b-f581aeb8af86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:20.377843 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0511e73-8771-4b73-9c9b-f581aeb8af86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:20.378121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0511e73-8771-4b73-9c9b-f581aeb8af86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:20.378392 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0511e73-8771-4b73-9c9b-f581aeb8af86 admin admin] PATH_INFO: `/v3/users/dab530b41ce74729a7de0ab7efea4552` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:20.379543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0511e73-8771-4b73-9c9b-f581aeb8af86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dab530b41ce74729a7de0ab7efea4552)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:20.381499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0511e73-8771-4b73-9c9b-f581aeb8af86 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:20.427891 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b0511e73-8771-4b73-9c9b-f581aeb8af86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dab530b41ce74729a7de0ab7efea4552'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.428545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b0511e73-8771-4b73-9c9b-f581aeb8af86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dab530b41ce74729a7de0ab7efea4552'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.433235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:20.442613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b0511e73-8771-4b73-9c9b-f581aeb8af86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dab530b41ce74729a7de0ab7efea4552'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.450597 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b0511e73-8771-4b73-9c9b-f581aeb8af86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dab530b41ce74729a7de0ab7efea4552'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.458778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b0511e73-8771-4b73-9c9b-f581aeb8af86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dab530b41ce74729a7de0ab7efea4552'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.465596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1304/2618] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:20 2022] DELETE /identity/v3/users/dab530b41ce74729a7de0ab7efea4552 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:20.741052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:20.742904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:20.755904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b52e0-faa4-4930-9f00-255c1730b927 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:20.807473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:20.817877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e54cc-dc1c-441e-918d-3b57c02a4660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:20.818758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e54cc-dc1c-441e-918d-3b57c02a4660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:20.819206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e54cc-dc1c-441e-918d-3b57c02a4660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:20.819722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e54cc-dc1c-441e-918d-3b57c02a4660 admin admin] PATH_INFO: `/v3/projects/1f22e0c486b046d5985dd0cc8b9ed284` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:20.821540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e54cc-dc1c-441e-918d-3b57c02a4660 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f22e0c486b046d5985dd0cc8b9ed284)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:20.823604 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03e54cc-dc1c-441e-918d-3b57c02a4660 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:20.869454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e03e54cc-dc1c-441e-918d-3b57c02a4660 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f22e0c486b046d5985dd0cc8b9ed284', 'request_id': 'req-e03e54cc-dc1c-441e-918d-3b57c02a4660'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.874798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e03e54cc-dc1c-441e-918d-3b57c02a4660 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f22e0c486b046d5985dd0cc8b9ed284', 'request_id': 'req-e03e54cc-dc1c-441e-918d-3b57c02a4660'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.880690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e03e54cc-dc1c-441e-918d-3b57c02a4660 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f22e0c486b046d5985dd0cc8b9ed284', 'request_id': 'req-e03e54cc-dc1c-441e-918d-3b57c02a4660'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.892913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e03e54cc-dc1c-441e-918d-3b57c02a4660 admin admin] The token cache is being invalidate because project 1f22e0c486b046d5985dd0cc8b9ed284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:20.893191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e03e54cc-dc1c-441e-918d-3b57c02a4660 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.893899 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e03e54cc-dc1c-441e-918d-3b57c02a4660 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:20.895381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1315/2619] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:20 2022] DELETE /identity/v3/projects/1f22e0c486b046d5985dd0cc8b9ed284 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:20.900228 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76958c8d-c391-4b0d-ad5e-28d86508d53c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:20.900725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76958c8d-c391-4b0d-ad5e-28d86508d53c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:20.900863 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76958c8d-c391-4b0d-ad5e-28d86508d53c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:20.920113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-76958c8d-c391-4b0d-ad5e-28d86508d53c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:20.921229 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-76958c8d-c391-4b0d-ad5e-28d86508d53c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:20.978914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1305/2620] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:20.987876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeab8f-9192-42c6-8f15-9a6329b508d3 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:20.988169 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeab8f-9192-42c6-8f15-9a6329b508d3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:20.988445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eeab8f-9192-42c6-8f15-9a6329b508d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.009860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-15eeab8f-9192-42c6-8f15-9a6329b508d3 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:21.011069 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-15eeab8f-9192-42c6-8f15-9a6329b508d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:21.018998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1316/2621] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:21.023191 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76958c8d-c391-4b0d-ad5e-28d86508d53c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.032792 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76958c8d-c391-4b0d-ad5e-28d86508d53c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:21.037312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e95ffa-e290-420b-b51d-becf70402724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:21.037918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e95ffa-e290-420b-b51d-becf70402724 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.038196 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e95ffa-e290-420b-b51d-becf70402724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.038466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e95ffa-e290-420b-b51d-becf70402724 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.039154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e95ffa-e290-420b-b51d-becf70402724 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:12:21.039458 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e95ffa-e290-420b-b51d-becf70402724 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:21.041063 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e95ffa-e290-420b-b51d-becf70402724 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:21.052448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1306/2622] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:12:21.057231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeab8f-9192-42c6-8f15-9a6329b508d3 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.066390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eeab8f-9192-42c6-8f15-9a6329b508d3 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:21.071618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af0191-4bfd-463a-acc9-c25f44dea304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:21.072210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af0191-4bfd-463a-acc9-c25f44dea304 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.072481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af0191-4bfd-463a-acc9-c25f44dea304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.072748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33af0191-4bfd-463a-acc9-c25f44dea304 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.073463 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af0191-4bfd-463a-acc9-c25f44dea304 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:21.075337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33af0191-4bfd-463a-acc9-c25f44dea304 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:21.102061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1317/2623] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:21 2022] POST /identity/v3/projects => generated 361 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:21.106223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e95ffa-e290-420b-b51d-becf70402724 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.116142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e95ffa-e290-420b-b51d-becf70402724 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:21.171497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b0a8c-fa4a-4994-9c22-e5b73bca4454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:21.172035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b0a8c-fa4a-4994-9c22-e5b73bca4454 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.172313 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b0a8c-fa4a-4994-9c22-e5b73bca4454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.172586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60b0a8c-fa4a-4994-9c22-e5b73bca4454 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.173234 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b0a8c-fa4a-4994-9c22-e5b73bca4454 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:21.175175 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60b0a8c-fa4a-4994-9c22-e5b73bca4454 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:21.197098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1307/2624] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:21 2022] POST /identity/v3/users => generated 281 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:21.201415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af0191-4bfd-463a-acc9-c25f44dea304 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.211593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33af0191-4bfd-463a-acc9-c25f44dea304 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:21.216598 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668deacb-052c-46b2-b636-fb324ef257ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:21.217210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668deacb-052c-46b2-b636-fb324ef257ac admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.217666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668deacb-052c-46b2-b636-fb324ef257ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.217846 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668deacb-052c-46b2-b636-fb324ef257ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.218468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668deacb-052c-46b2-b636-fb324ef257ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:21.220068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668deacb-052c-46b2-b636-fb324ef257ac admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:21.230530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1318/2625] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:21.234323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b0a8c-fa4a-4994-9c22-e5b73bca4454 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.244952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60b0a8c-fa4a-4994-9c22-e5b73bca4454 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:21.249574 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a087fa-4f64-430c-b3a8-9b70fb821c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:21.250162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a087fa-4f64-430c-b3a8-9b70fb821c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.250433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a087fa-4f64-430c-b3a8-9b70fb821c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.250699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a087fa-4f64-430c-b3a8-9b70fb821c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.251378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a087fa-4f64-430c-b3a8-9b70fb821c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:21.252951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a087fa-4f64-430c-b3a8-9b70fb821c13 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:21.263198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1308/2626] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:21.267045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668deacb-052c-46b2-b636-fb324ef257ac admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.276884 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668deacb-052c-46b2-b636-fb324ef257ac admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:21.281478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b642f7c-d84e-4298-afd5-7e35c54f2c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:21.282124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b642f7c-d84e-4298-afd5-7e35c54f2c7a admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.282427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b642f7c-d84e-4298-afd5-7e35c54f2c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.282698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b642f7c-d84e-4298-afd5-7e35c54f2c7a admin admin] PATH_INFO: `/v3/projects/c01bf78c1e624f9eb3df462e58d7298a/users/ac98d6d434d245feb142f7e926124a75/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.297820 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b642f7c-d84e-4298-afd5-7e35c54f2c7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01bf78c1e624f9eb3df462e58d7298a, user_id=ac98d6d434d245feb142f7e926124a75, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:21.300499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b642f7c-d84e-4298-afd5-7e35c54f2c7a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:21.314660 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1319/2627] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:21 2022] PUT /identity/v3/projects/c01bf78c1e624f9eb3df462e58d7298a/users/ac98d6d434d245feb142f7e926124a75/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:12:21.325092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301366f-f984-45d6-b99c-c1114a41e247 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.325417 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301366f-f984-45d6-b99c-c1114a41e247 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.325690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a301366f-f984-45d6-b99c-c1114a41e247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.353332 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a301366f-f984-45d6-b99c-c1114a41e247 None None] MFA Rules not processed for user `ac98d6d434d245feb142f7e926124a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:21.354525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a301366f-f984-45d6-b99c-c1114a41e247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:21.378341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:21.419733 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1309/2628] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:21 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:21.424231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b642f7c-d84e-4298-afd5-7e35c54f2c7a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.483872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b642f7c-d84e-4298-afd5-7e35c54f2c7a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:21.488505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c37822-6e24-48c5-aac6-117a6c891b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:21.489106 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c37822-6e24-48c5-aac6-117a6c891b5a admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.489412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c37822-6e24-48c5-aac6-117a6c891b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.489680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c37822-6e24-48c5-aac6-117a6c891b5a admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.490368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c37822-6e24-48c5-aac6-117a6c891b5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:21.493084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c37822-6e24-48c5-aac6-117a6c891b5a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:21.518616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1320/2629] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:21 2022] POST /identity/v3/projects => generated 365 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:12:21.522760 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301366f-f984-45d6-b99c-c1114a41e247 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.533231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a301366f-f984-45d6-b99c-c1114a41e247 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:21.588424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b353b6-833a-4f21-b7db-ba904a984005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:21.589026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b353b6-833a-4f21-b7db-ba904a984005 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.589328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b353b6-833a-4f21-b7db-ba904a984005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.589602 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b353b6-833a-4f21-b7db-ba904a984005 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.590261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b353b6-833a-4f21-b7db-ba904a984005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:21.592179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b353b6-833a-4f21-b7db-ba904a984005 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:21.614702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1310/2630] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:21 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:21.619141 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c37822-6e24-48c5-aac6-117a6c891b5a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.625739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:21.629800 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c37822-6e24-48c5-aac6-117a6c891b5a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:21.635635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ab15-42e1-4b9d-8854-77c6e9f0fc19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:21.636414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ab15-42e1-4b9d-8854-77c6e9f0fc19 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.636861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ab15-42e1-4b9d-8854-77c6e9f0fc19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.637191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd7ab15-42e1-4b9d-8854-77c6e9f0fc19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.638143 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7ab15-42e1-4b9d-8854-77c6e9f0fc19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:21.639790 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd7ab15-42e1-4b9d-8854-77c6e9f0fc19 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:21.650919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1321/2631] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:21.655024 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b353b6-833a-4f21-b7db-ba904a984005 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.665418 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b353b6-833a-4f21-b7db-ba904a984005 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:21.669996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422ea38-18b4-43cd-93bb-64d3414fd7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:21.670644 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422ea38-18b4-43cd-93bb-64d3414fd7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.670920 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422ea38-18b4-43cd-93bb-64d3414fd7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.671189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422ea38-18b4-43cd-93bb-64d3414fd7ce admin admin] PATH_INFO: `/v3/projects/91131728e452493595af39df283e92bb/users/daa65b49ee5e4c6ba219f7510f94d42a/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.685576 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422ea38-18b4-43cd-93bb-64d3414fd7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=91131728e452493595af39df283e92bb, user_id=daa65b49ee5e4c6ba219f7510f94d42a, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:21.688196 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422ea38-18b4-43cd-93bb-64d3414fd7ce admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:21.701805 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1311/2632] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:21 2022] PUT /identity/v3/projects/91131728e452493595af39df283e92bb/users/daa65b49ee5e4c6ba219f7510f94d42a/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:21.705647 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ab15-42e1-4b9d-8854-77c6e9f0fc19 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.716004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd7ab15-42e1-4b9d-8854-77c6e9f0fc19 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:21.771752 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72237801-1377-4182-826f-b44a69fa96f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:21.772366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72237801-1377-4182-826f-b44a69fa96f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.772646 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72237801-1377-4182-826f-b44a69fa96f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.772916 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72237801-1377-4182-826f-b44a69fa96f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.774125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72237801-1377-4182-826f-b44a69fa96f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:21.775711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72237801-1377-4182-826f-b44a69fa96f1 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:21.785235 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1322/2633] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:21.789883 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422ea38-18b4-43cd-93bb-64d3414fd7ce admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.800074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422ea38-18b4-43cd-93bb-64d3414fd7ce admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:21.804728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768ab14-9960-42f8-a67e-c4c737071314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:21.805843 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768ab14-9960-42f8-a67e-c4c737071314 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.806344 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768ab14-9960-42f8-a67e-c4c737071314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.806850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2768ab14-9960-42f8-a67e-c4c737071314 admin admin] PATH_INFO: `/v3/projects/91131728e452493595af39df283e92bb/users/daa65b49ee5e4c6ba219f7510f94d42a/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.810142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768ab14-9960-42f8-a67e-c4c737071314 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91131728e452493595af39df283e92bb, user_id=daa65b49ee5e4c6ba219f7510f94d42a, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:21.814083 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2768ab14-9960-42f8-a67e-c4c737071314 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:21.826312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1312/2634] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:21 2022] PUT /identity/v3/projects/91131728e452493595af39df283e92bb/users/daa65b49ee5e4c6ba219f7510f94d42a/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:21.838263 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c952d9-35af-4356-901f-40d7ab1c3fa0 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:21.838749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c952d9-35af-4356-901f-40d7ab1c3fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:21.838859 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c952d9-35af-4356-901f-40d7ab1c3fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:21.866183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-39c952d9-35af-4356-901f-40d7ab1c3fa0 None None] MFA Rules not processed for user `daa65b49ee5e4c6ba219f7510f94d42a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:21.867641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-39c952d9-35af-4356-901f-40d7ab1c3fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:21.933253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1323/2635] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:21 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:21.944593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768ab14-9960-42f8-a67e-c4c737071314 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:21.946881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2768ab14-9960-42f8-a67e-c4c737071314 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:22.002189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2768ab14-9960-42f8-a67e-c4c737071314 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:22.005822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947c612-36b7-41e3-be76-2a3ac31fa9e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:22.006424 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947c612-36b7-41e3-be76-2a3ac31fa9e0 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:22.006703 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947c612-36b7-41e3-be76-2a3ac31fa9e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:22.006974 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947c612-36b7-41e3-be76-2a3ac31fa9e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:22.016233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947c612-36b7-41e3-be76-2a3ac31fa9e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:22.017708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1947c612-36b7-41e3-be76-2a3ac31fa9e0 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:22.027554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1313/2636] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:22.104716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c952d9-35af-4356-901f-40d7ab1c3fa0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:22.114504 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c952d9-35af-4356-901f-40d7ab1c3fa0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:22.118505 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71021aa4-1f97-4d3c-9e88-ac52dd3ca02f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:22.119067 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71021aa4-1f97-4d3c-9e88-ac52dd3ca02f service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:22.119379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71021aa4-1f97-4d3c-9e88-ac52dd3ca02f service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:22.119701 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71021aa4-1f97-4d3c-9e88-ac52dd3ca02f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:22.178442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71021aa4-1f97-4d3c-9e88-ac52dd3ca02f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:22.179880 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71021aa4-1f97-4d3c-9e88-ac52dd3ca02f service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:22.188737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1324/2637] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:22 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:24.900834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947c612-36b7-41e3-be76-2a3ac31fa9e0 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:24.921623 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:24.963786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947c612-36b7-41e3-be76-2a3ac31fa9e0 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:24.968318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:24.968932 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:24.969209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:24.969509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] PATH_INFO: `/v3/users/ac98d6d434d245feb142f7e926124a75` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:24.970659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac98d6d434d245feb142f7e926124a75)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:24.972593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:25.017846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac98d6d434d245feb142f7e926124a75'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.018485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac98d6d434d245feb142f7e926124a75'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.031624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac98d6d434d245feb142f7e926124a75'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.038325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac98d6d434d245feb142f7e926124a75'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.045369 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac98d6d434d245feb142f7e926124a75'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.051209 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1314/2638] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:24 2022] DELETE /identity/v3/users/ac98d6d434d245feb142f7e926124a75 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:25.055830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac696aea-f7f6-451f-a778-1ae444c66e5d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:25.056310 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac696aea-f7f6-451f-a778-1ae444c66e5d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:25.056439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac696aea-f7f6-451f-a778-1ae444c66e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:25.201229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ac696aea-f7f6-451f-a778-1ae444c66e5d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:25.202384 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ac696aea-f7f6-451f-a778-1ae444c66e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:25.211399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:25.261366 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1325/2639] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:25.271002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:25.272395 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:25.329707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108295f9-f1ef-40f6-bc33-847c97c6761a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:25.333401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94512ee9-9b06-4c28-bf75-cf5fd7e64a59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:25.334023 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512ee9-9b06-4c28-bf75-cf5fd7e64a59 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:25.334299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512ee9-9b06-4c28-bf75-cf5fd7e64a59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:25.334571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94512ee9-9b06-4c28-bf75-cf5fd7e64a59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:25.344284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94512ee9-9b06-4c28-bf75-cf5fd7e64a59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:25.345801 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94512ee9-9b06-4c28-bf75-cf5fd7e64a59 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:25.355227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1315/2640] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:25.622740 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac696aea-f7f6-451f-a778-1ae444c66e5d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:25.624405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ac696aea-f7f6-451f-a778-1ae444c66e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:25.638858 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac696aea-f7f6-451f-a778-1ae444c66e5d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:25.643472 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:25.644111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:25.644391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:25.644664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] PATH_INFO: `/v3/projects/c01bf78c1e624f9eb3df462e58d7298a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:25.646371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01bf78c1e624f9eb3df462e58d7298a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:25.648507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:25.694225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01bf78c1e624f9eb3df462e58d7298a', 'request_id': 'req-02845fa6-e060-4939-87e7-67c74a41f87e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.700195 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01bf78c1e624f9eb3df462e58d7298a', 'request_id': 'req-02845fa6-e060-4939-87e7-67c74a41f87e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.706394 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01bf78c1e624f9eb3df462e58d7298a', 'request_id': 'req-02845fa6-e060-4939-87e7-67c74a41f87e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.718353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] The token cache is being invalidate because project c01bf78c1e624f9eb3df462e58d7298a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:25.718656 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.719274 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.720755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1326/2641] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:25 2022] DELETE /identity/v3/projects/c01bf78c1e624f9eb3df462e58d7298a => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:25.725443 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94512ee9-9b06-4c28-bf75-cf5fd7e64a59 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:25.735521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94512ee9-9b06-4c28-bf75-cf5fd7e64a59 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:25.775711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:25.801670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4ffa4-01cb-454c-b239-92bd59b46ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:25.802314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4ffa4-01cb-454c-b239-92bd59b46ad9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:25.802587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4ffa4-01cb-454c-b239-92bd59b46ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:25.802855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4ffa4-01cb-454c-b239-92bd59b46ad9 admin admin] PATH_INFO: `/v3/users/daa65b49ee5e4c6ba219f7510f94d42a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:25.804022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4ffa4-01cb-454c-b239-92bd59b46ad9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa65b49ee5e4c6ba219f7510f94d42a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:25.806639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4ffa4-01cb-454c-b239-92bd59b46ad9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:25.851991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-43c4ffa4-01cb-454c-b239-92bd59b46ad9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa65b49ee5e4c6ba219f7510f94d42a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.852633 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-43c4ffa4-01cb-454c-b239-92bd59b46ad9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa65b49ee5e4c6ba219f7510f94d42a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.864150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-43c4ffa4-01cb-454c-b239-92bd59b46ad9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa65b49ee5e4c6ba219f7510f94d42a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.871753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-43c4ffa4-01cb-454c-b239-92bd59b46ad9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa65b49ee5e4c6ba219f7510f94d42a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.878907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-43c4ffa4-01cb-454c-b239-92bd59b46ad9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa65b49ee5e4c6ba219f7510f94d42a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:25.884957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1316/2642] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:25 2022] DELETE /identity/v3/users/daa65b49ee5e4c6ba219f7510f94d42a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:12:26.192531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:26.194022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:26.208087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02845fa6-e060-4939-87e7-67c74a41f87e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:26.266284 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea0af13-292f-45c8-a912-8cf6f256522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:26.266922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0af13-292f-45c8-a912-8cf6f256522b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:26.267203 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0af13-292f-45c8-a912-8cf6f256522b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:26.267475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea0af13-292f-45c8-a912-8cf6f256522b admin admin] PATH_INFO: `/v3/projects/91131728e452493595af39df283e92bb` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:26.268627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0af13-292f-45c8-a912-8cf6f256522b admin admin] RBAC: Authorizing `identity:delete_project(project_id=91131728e452493595af39df283e92bb)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:26.270634 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea0af13-292f-45c8-a912-8cf6f256522b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:26.312371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:26.321113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4ea0af13-292f-45c8-a912-8cf6f256522b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91131728e452493595af39df283e92bb', 'request_id': 'req-4ea0af13-292f-45c8-a912-8cf6f256522b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:26.326946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4ea0af13-292f-45c8-a912-8cf6f256522b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91131728e452493595af39df283e92bb', 'request_id': 'req-4ea0af13-292f-45c8-a912-8cf6f256522b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:26.333104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4ea0af13-292f-45c8-a912-8cf6f256522b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91131728e452493595af39df283e92bb', 'request_id': 'req-4ea0af13-292f-45c8-a912-8cf6f256522b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:26.346065 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4ea0af13-292f-45c8-a912-8cf6f256522b admin admin] The token cache is being invalidate because project 91131728e452493595af39df283e92bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:26.346353 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4ea0af13-292f-45c8-a912-8cf6f256522b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:26.346974 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4ea0af13-292f-45c8-a912-8cf6f256522b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:26.348471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1327/2643] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:26 2022] DELETE /identity/v3/projects/91131728e452493595af39df283e92bb => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:26.353983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3a0ed-2b5e-46af-bfda-8f8408d8350d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:26.354486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3a0ed-2b5e-46af-bfda-8f8408d8350d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:26.354592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3a0ed-2b5e-46af-bfda-8f8408d8350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:26.373958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-02a3a0ed-2b5e-46af-bfda-8f8408d8350d None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:26.375157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-02a3a0ed-2b5e-46af-bfda-8f8408d8350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:26.432634 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1317/2644] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:26.441573 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb37c00-2afd-45e1-9d50-95a1efeebb68 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:26.441861 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb37c00-2afd-45e1-9d50-95a1efeebb68 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:26.442132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb37c00-2afd-45e1-9d50-95a1efeebb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:26.462099 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3bb37c00-2afd-45e1-9d50-95a1efeebb68 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:26.463288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3bb37c00-2afd-45e1-9d50-95a1efeebb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:26.471391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1328/2645] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:26.475546 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3a0ed-2b5e-46af-bfda-8f8408d8350d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:26.485141 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3a0ed-2b5e-46af-bfda-8f8408d8350d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:26.489944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe01cc-3806-444a-acfd-2480206ef189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:26.490550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe01cc-3806-444a-acfd-2480206ef189 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:26.490827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe01cc-3806-444a-acfd-2480206ef189 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:26.491098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe01cc-3806-444a-acfd-2480206ef189 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:26.491784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe01cc-3806-444a-acfd-2480206ef189 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:12:26.492344 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe01cc-3806-444a-acfd-2480206ef189 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:26.494026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe01cc-3806-444a-acfd-2480206ef189 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:26.505958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1318/2646] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:12:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:12:26.510621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb37c00-2afd-45e1-9d50-95a1efeebb68 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:26.519637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb37c00-2afd-45e1-9d50-95a1efeebb68 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:26.524836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456af318-ca7f-4c77-a656-0acfb3a9344d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:26.525469 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456af318-ca7f-4c77-a656-0acfb3a9344d admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:26.525743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456af318-ca7f-4c77-a656-0acfb3a9344d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:26.526015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456af318-ca7f-4c77-a656-0acfb3a9344d admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:26.526668 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456af318-ca7f-4c77-a656-0acfb3a9344d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:26.528528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456af318-ca7f-4c77-a656-0acfb3a9344d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:26.554782 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1329/2647] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:26 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:26.558982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe01cc-3806-444a-acfd-2480206ef189 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:26.569045 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe01cc-3806-444a-acfd-2480206ef189 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:26.613363 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:26.626895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2c49-8053-466b-81d3-ee3ac3667d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:26.627532 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2c49-8053-466b-81d3-ee3ac3667d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:26.627815 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2c49-8053-466b-81d3-ee3ac3667d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:26.628087 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923f2c49-8053-466b-81d3-ee3ac3667d37 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:26.628757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f2c49-8053-466b-81d3-ee3ac3667d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:26.630752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923f2c49-8053-466b-81d3-ee3ac3667d37 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:26.652135 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1319/2648] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:26 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:26.656168 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456af318-ca7f-4c77-a656-0acfb3a9344d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:26.666364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456af318-ca7f-4c77-a656-0acfb3a9344d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:26.670908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a38e-d9f0-4cb5-a4fb-4a610bdbf612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:26.671535 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a38e-d9f0-4cb5-a4fb-4a610bdbf612 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:26.671812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a38e-d9f0-4cb5-a4fb-4a610bdbf612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:26.672082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49a38e-d9f0-4cb5-a4fb-4a610bdbf612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:26.672772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49a38e-d9f0-4cb5-a4fb-4a610bdbf612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:26.674371 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49a38e-d9f0-4cb5-a4fb-4a610bdbf612 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:26.683999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1330/2649] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:26.687640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2c49-8053-466b-81d3-ee3ac3667d37 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:26.698080 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923f2c49-8053-466b-81d3-ee3ac3667d37 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:26.702705 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e800184-8002-482d-a9e6-84b66351ff3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:26.703301 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800184-8002-482d-a9e6-84b66351ff3f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:26.703583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800184-8002-482d-a9e6-84b66351ff3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:26.703860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e800184-8002-482d-a9e6-84b66351ff3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:26.704547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e800184-8002-482d-a9e6-84b66351ff3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:26.706176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e800184-8002-482d-a9e6-84b66351ff3f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:26.717104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1320/2650] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:26.720936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a38e-d9f0-4cb5-a4fb-4a610bdbf612 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:26.730908 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49a38e-d9f0-4cb5-a4fb-4a610bdbf612 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:26.735545 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27504e1d-3e02-45f0-b062-9a16e4e0c3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:26.736189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27504e1d-3e02-45f0-b062-9a16e4e0c3e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:26.736469 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27504e1d-3e02-45f0-b062-9a16e4e0c3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:26.736741 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27504e1d-3e02-45f0-b062-9a16e4e0c3e5 admin admin] PATH_INFO: `/v3/projects/b5d34f126f45475cac5de6659ef734ce/users/9eae0a04a9c5471aba40bbe8a6e1fc46/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:26.754278 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27504e1d-3e02-45f0-b062-9a16e4e0c3e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5d34f126f45475cac5de6659ef734ce, user_id=9eae0a04a9c5471aba40bbe8a6e1fc46, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:26.756942 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27504e1d-3e02-45f0-b062-9a16e4e0c3e5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:26.770215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1331/2651] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:26 2022] PUT /identity/v3/projects/b5d34f126f45475cac5de6659ef734ce/users/9eae0a04a9c5471aba40bbe8a6e1fc46/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:26.781281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768912e-7fdd-4090-9f03-0f082ecc65a5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:26.781616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768912e-7fdd-4090-9f03-0f082ecc65a5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:26.781895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3768912e-7fdd-4090-9f03-0f082ecc65a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:26.808712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3768912e-7fdd-4090-9f03-0f082ecc65a5 None None] MFA Rules not processed for user `9eae0a04a9c5471aba40bbe8a6e1fc46`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:26.810000 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3768912e-7fdd-4090-9f03-0f082ecc65a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:26.875821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1321/2652] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:26.880387 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27504e1d-3e02-45f0-b062-9a16e4e0c3e5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:26.939405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27504e1d-3e02-45f0-b062-9a16e4e0c3e5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:26.943920 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db197b1-88b2-4893-ac4e-457f3b356571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:26.944522 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db197b1-88b2-4893-ac4e-457f3b356571 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:26.944796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db197b1-88b2-4893-ac4e-457f3b356571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:26.945666 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db197b1-88b2-4893-ac4e-457f3b356571 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:26.946325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db197b1-88b2-4893-ac4e-457f3b356571 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:26.948188 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db197b1-88b2-4893-ac4e-457f3b356571 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:26.973610 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1332/2653] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:26 2022] POST /identity/v3/projects => generated 379 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:26.977784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768912e-7fdd-4090-9f03-0f082ecc65a5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:26.988508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3768912e-7fdd-4090-9f03-0f082ecc65a5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:27.046699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777ba46-5f1e-4da1-b9f6-c247a262ecdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:27.047341 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ba46-5f1e-4da1-b9f6-c247a262ecdb admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:27.047622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ba46-5f1e-4da1-b9f6-c247a262ecdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:27.047917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2777ba46-5f1e-4da1-b9f6-c247a262ecdb admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:27.048574 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777ba46-5f1e-4da1-b9f6-c247a262ecdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:27.050550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2777ba46-5f1e-4da1-b9f6-c247a262ecdb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:27.073281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1322/2654] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:26 2022] POST /identity/v3/users => generated 296 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:27.077331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db197b1-88b2-4893-ac4e-457f3b356571 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:27.087951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db197b1-88b2-4893-ac4e-457f3b356571 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:27.092509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf0911-c617-4353-bdca-87dcf1ef7fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:27.093108 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0911-c617-4353-bdca-87dcf1ef7fa3 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:27.093408 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0911-c617-4353-bdca-87dcf1ef7fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:27.093675 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf0911-c617-4353-bdca-87dcf1ef7fa3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:27.094351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf0911-c617-4353-bdca-87dcf1ef7fa3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:27.095924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf0911-c617-4353-bdca-87dcf1ef7fa3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:27.105560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1333/2655] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:27.109633 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777ba46-5f1e-4da1-b9f6-c247a262ecdb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:27.120250 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2777ba46-5f1e-4da1-b9f6-c247a262ecdb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:27.124976 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35574dba-3ddf-402c-8cc6-3684e915bacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:27.125675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35574dba-3ddf-402c-8cc6-3684e915bacf admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:27.125957 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35574dba-3ddf-402c-8cc6-3684e915bacf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:27.126283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35574dba-3ddf-402c-8cc6-3684e915bacf admin admin] PATH_INFO: `/v3/projects/646c5f5d9bdc4f04862ce1d48e9214dd/users/6da703812ea344e2a6cee1ba50901064/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:27.141619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35574dba-3ddf-402c-8cc6-3684e915bacf admin admin] RBAC: Authorizing `identity:create_grant(project_id=646c5f5d9bdc4f04862ce1d48e9214dd, user_id=6da703812ea344e2a6cee1ba50901064, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:27.144295 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35574dba-3ddf-402c-8cc6-3684e915bacf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:27.156670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1323/2656] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:27 2022] PUT /identity/v3/projects/646c5f5d9bdc4f04862ce1d48e9214dd/users/6da703812ea344e2a6cee1ba50901064/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:27.160460 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf0911-c617-4353-bdca-87dcf1ef7fa3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:27.173486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf0911-c617-4353-bdca-87dcf1ef7fa3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:27.211303 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:27.236075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d1d1a-86a0-48a8-9349-903d7e0ee8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:27.236687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d1d1a-86a0-48a8-9349-903d7e0ee8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:27.236967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d1d1a-86a0-48a8-9349-903d7e0ee8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:27.237242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d1d1a-86a0-48a8-9349-903d7e0ee8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:27.237965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d1d1a-86a0-48a8-9349-903d7e0ee8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:27.239548 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3d1d1a-86a0-48a8-9349-903d7e0ee8b7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:27.249857 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1334/2657] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:27.254074 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35574dba-3ddf-402c-8cc6-3684e915bacf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:27.264405 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35574dba-3ddf-402c-8cc6-3684e915bacf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:27.268984 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42a26b-d085-4ceb-8f5b-3bc3b10a8c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:27.269665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a26b-d085-4ceb-8f5b-3bc3b10a8c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:27.269946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a26b-d085-4ceb-8f5b-3bc3b10a8c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:27.270218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a26b-d085-4ceb-8f5b-3bc3b10a8c6b admin admin] PATH_INFO: `/v3/projects/646c5f5d9bdc4f04862ce1d48e9214dd/users/6da703812ea344e2a6cee1ba50901064/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:27.272167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42a26b-d085-4ceb-8f5b-3bc3b10a8c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=646c5f5d9bdc4f04862ce1d48e9214dd, user_id=6da703812ea344e2a6cee1ba50901064, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:27.274894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42a26b-d085-4ceb-8f5b-3bc3b10a8c6b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:27.284903 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1324/2658] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:27 2022] PUT /identity/v3/projects/646c5f5d9bdc4f04862ce1d48e9214dd/users/6da703812ea344e2a6cee1ba50901064/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:27.296601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5f5f0-882a-4d61-8c37-48b708b352f2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:27.296890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5f5f0-882a-4d61-8c37-48b708b352f2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:27.297166 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b5f5f0-882a-4d61-8c37-48b708b352f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:27.324684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a8b5f5f0-882a-4d61-8c37-48b708b352f2 None None] MFA Rules not processed for user `6da703812ea344e2a6cee1ba50901064`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:27.325888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a8b5f5f0-882a-4d61-8c37-48b708b352f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:27.391792 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1335/2659] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:27 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:27.403744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42a26b-d085-4ceb-8f5b-3bc3b10a8c6b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:27.405530 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5c42a26b-d085-4ceb-8f5b-3bc3b10a8c6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:27.416999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:27.464796 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42a26b-d085-4ceb-8f5b-3bc3b10a8c6b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:27.468894 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998e6a4-273b-444f-b06c-6844035adee4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:27.469538 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998e6a4-273b-444f-b06c-6844035adee4 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:27.469821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998e6a4-273b-444f-b06c-6844035adee4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:27.470094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7998e6a4-273b-444f-b06c-6844035adee4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:27.482146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998e6a4-273b-444f-b06c-6844035adee4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:27.483592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7998e6a4-273b-444f-b06c-6844035adee4 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:27.494123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1325/2660] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:27 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:27.797461 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5f5f0-882a-4d61-8c37-48b708b352f2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:27.806516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b5f5f0-882a-4d61-8c37-48b708b352f2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:27.811119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c435ec-b88e-4362-a4b2-20e74a432ebf tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da703812ea344e2a6cee1ba50901064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '646c5f5d9bdc4f04862ce1d48e9214dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:27.811721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c435ec-b88e-4362-a4b2-20e74a432ebf tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:27.812002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c435ec-b88e-4362-a4b2-20e74a432ebf tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:27.812280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c435ec-b88e-4362-a4b2-20e74a432ebf tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:27.812968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c435ec-b88e-4362-a4b2-20e74a432ebf tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:12:27.813272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c435ec-b88e-4362-a4b2-20e74a432ebf tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:27.814891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c435ec-b88e-4362-a4b2-20e74a432ebf tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:27.826299 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1336/2661] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:12:27.830449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998e6a4-273b-444f-b06c-6844035adee4 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:27.840058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7998e6a4-273b-444f-b06c-6844035adee4 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:27.844673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6c992-639f-4411-90e8-149f68d24171 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da703812ea344e2a6cee1ba50901064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '646c5f5d9bdc4f04862ce1d48e9214dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:27.845275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6c992-639f-4411-90e8-149f68d24171 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:27.845589 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6c992-639f-4411-90e8-149f68d24171 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:27.845867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e6c992-639f-4411-90e8-149f68d24171 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:27.846575 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6c992-639f-4411-90e8-149f68d24171 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:27.848448 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e6c992-639f-4411-90e8-149f68d24171 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:27.874836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1326/2662] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:27 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:27.878750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c435ec-b88e-4362-a4b2-20e74a432ebf tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:27.888427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c435ec-b88e-4362-a4b2-20e74a432ebf tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:27.943045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44490161-5d78-4bed-a192-d828ac563d1b tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da703812ea344e2a6cee1ba50901064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '646c5f5d9bdc4f04862ce1d48e9214dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:27.943704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44490161-5d78-4bed-a192-d828ac563d1b tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:27.943986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44490161-5d78-4bed-a192-d828ac563d1b tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:27.944255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44490161-5d78-4bed-a192-d828ac563d1b tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:27.945590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44490161-5d78-4bed-a192-d828ac563d1b tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:12:27.945982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44490161-5d78-4bed-a192-d828ac563d1b tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:27.947951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44490161-5d78-4bed-a192-d828ac563d1b tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:27.959875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1337/2663] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:12:27.996351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6c992-639f-4411-90e8-149f68d24171 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:28.006708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e6c992-639f-4411-90e8-149f68d24171 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:28.011771 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22674a80-81dd-425d-9527-f09fcab563c6 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6da703812ea344e2a6cee1ba50901064', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '646c5f5d9bdc4f04862ce1d48e9214dd', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:28.012422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22674a80-81dd-425d-9527-f09fcab563c6 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:28.012701 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22674a80-81dd-425d-9527-f09fcab563c6 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:28.012969 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22674a80-81dd-425d-9527-f09fcab563c6 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] PATH_INFO: `/v3/projects/36359dc1ab9543b4b9fd11248401d811` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:28.014159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22674a80-81dd-425d-9527-f09fcab563c6 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: Authorizing `identity:delete_project(project_id=36359dc1ab9543b4b9fd11248401d811)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:28.016077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22674a80-81dd-425d-9527-f09fcab563c6 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:28.061141 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-22674a80-81dd-425d-9527-f09fcab563c6 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36359dc1ab9543b4b9fd11248401d811', 'request_id': 'req-22674a80-81dd-425d-9527-f09fcab563c6'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:28.066505 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-22674a80-81dd-425d-9527-f09fcab563c6 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36359dc1ab9543b4b9fd11248401d811', 'request_id': 'req-22674a80-81dd-425d-9527-f09fcab563c6'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:28.074011 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-22674a80-81dd-425d-9527-f09fcab563c6 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36359dc1ab9543b4b9fd11248401d811', 'request_id': 'req-22674a80-81dd-425d-9527-f09fcab563c6'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:28.087177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-22674a80-81dd-425d-9527-f09fcab563c6 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] The token cache is being invalidate because project 36359dc1ab9543b4b9fd11248401d811 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:28.087465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-22674a80-81dd-425d-9527-f09fcab563c6 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:28.088127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-22674a80-81dd-425d-9527-f09fcab563c6 tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:28.089696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1327/2664] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:27 2022] DELETE /identity/v3/projects/36359dc1ab9543b4b9fd11248401d811 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:28.279115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44490161-5d78-4bed-a192-d828ac563d1b tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:28.280902 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-44490161-5d78-4bed-a192-d828ac563d1b tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:28.323783 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:28.346347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44490161-5d78-4bed-a192-d828ac563d1b tempest-VolumeQuotaClassesTest-763340079 tempest-VolumeQuotaClassesTest-763340079-project-admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:28.402322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:28.402882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:28.403158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:28.403429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] PATH_INFO: `/v3/users/9eae0a04a9c5471aba40bbe8a6e1fc46` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:28.404626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9eae0a04a9c5471aba40bbe8a6e1fc46)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:28.406561 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:28.452424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9eae0a04a9c5471aba40bbe8a6e1fc46'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:28.458982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9eae0a04a9c5471aba40bbe8a6e1fc46'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:28.471238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9eae0a04a9c5471aba40bbe8a6e1fc46'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:28.471863 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9eae0a04a9c5471aba40bbe8a6e1fc46'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:28.479248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9eae0a04a9c5471aba40bbe8a6e1fc46'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:28.485108 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1338/2665] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:28 2022] DELETE /identity/v3/users/9eae0a04a9c5471aba40bbe8a6e1fc46 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:28.489651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004aa8ed-0932-4536-ab98-d8547e520724 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:28.490137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004aa8ed-0932-4536-ab98-d8547e520724 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:28.490237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004aa8ed-0932-4536-ab98-d8547e520724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:28.508794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-004aa8ed-0932-4536-ab98-d8547e520724 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:28.510009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-004aa8ed-0932-4536-ab98-d8547e520724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:28.569327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1328/2666] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:28.579167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:28.580698 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:28.636888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e2e2d-e0b8-409b-83e7-864ea2990e53 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:28.640589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18e5da-f95a-4ff7-b7b0-99f14faa2683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:28.641191 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18e5da-f95a-4ff7-b7b0-99f14faa2683 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:28.641508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18e5da-f95a-4ff7-b7b0-99f14faa2683 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:28.641777 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d18e5da-f95a-4ff7-b7b0-99f14faa2683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:28.651085 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18e5da-f95a-4ff7-b7b0-99f14faa2683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:28.652541 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d18e5da-f95a-4ff7-b7b0-99f14faa2683 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:28.661759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1339/2667] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:28.944035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004aa8ed-0932-4536-ab98-d8547e520724 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:28.946049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-004aa8ed-0932-4536-ab98-d8547e520724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:28.957937 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004aa8ed-0932-4536-ab98-d8547e520724 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:28.963210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:28.963842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:28.964142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:28.964414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] PATH_INFO: `/v3/projects/b5d34f126f45475cac5de6659ef734ce` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:28.965610 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5d34f126f45475cac5de6659ef734ce)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:28.967518 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:28.976627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:29.016219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5d34f126f45475cac5de6659ef734ce', 'request_id': 'req-e7b0402d-7600-44bd-900d-565664c8ddad'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.021836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5d34f126f45475cac5de6659ef734ce', 'request_id': 'req-e7b0402d-7600-44bd-900d-565664c8ddad'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.029865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5d34f126f45475cac5de6659ef734ce', 'request_id': 'req-e7b0402d-7600-44bd-900d-565664c8ddad'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.041200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] The token cache is being invalidate because project b5d34f126f45475cac5de6659ef734ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:29.041516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.042283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.043779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1329/2668] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:28 2022] DELETE /identity/v3/projects/b5d34f126f45475cac5de6659ef734ce => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:29.047735 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18e5da-f95a-4ff7-b7b0-99f14faa2683 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:29.057421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d18e5da-f95a-4ff7-b7b0-99f14faa2683 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:29.062097 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:29.116300 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11143f1a-167e-46b2-8b99-5e626344cbd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:29.117469 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11143f1a-167e-46b2-8b99-5e626344cbd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:29.117743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11143f1a-167e-46b2-8b99-5e626344cbd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:29.118009 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11143f1a-167e-46b2-8b99-5e626344cbd8 admin admin] PATH_INFO: `/v3/users/6da703812ea344e2a6cee1ba50901064` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:29.119149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11143f1a-167e-46b2-8b99-5e626344cbd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6da703812ea344e2a6cee1ba50901064)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:29.121048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11143f1a-167e-46b2-8b99-5e626344cbd8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:29.170968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-11143f1a-167e-46b2-8b99-5e626344cbd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6da703812ea344e2a6cee1ba50901064'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.177720 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-11143f1a-167e-46b2-8b99-5e626344cbd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6da703812ea344e2a6cee1ba50901064'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.189671 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-11143f1a-167e-46b2-8b99-5e626344cbd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6da703812ea344e2a6cee1ba50901064'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.190238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-11143f1a-167e-46b2-8b99-5e626344cbd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6da703812ea344e2a6cee1ba50901064'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.197515 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-11143f1a-167e-46b2-8b99-5e626344cbd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6da703812ea344e2a6cee1ba50901064'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.203253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1340/2669] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:29 2022] DELETE /identity/v3/users/6da703812ea344e2a6cee1ba50901064 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:29.474035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:29.475547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:29.489393 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0402d-7600-44bd-900d-565664c8ddad admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:29.547239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca18b20-c893-4a0a-8681-4b3340f4c247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:29.547940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca18b20-c893-4a0a-8681-4b3340f4c247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:29.548222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca18b20-c893-4a0a-8681-4b3340f4c247 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:29.548492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca18b20-c893-4a0a-8681-4b3340f4c247 admin admin] PATH_INFO: `/v3/projects/646c5f5d9bdc4f04862ce1d48e9214dd` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:29.549702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca18b20-c893-4a0a-8681-4b3340f4c247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=646c5f5d9bdc4f04862ce1d48e9214dd)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:29.551683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca18b20-c893-4a0a-8681-4b3340f4c247 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:29.597276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-aca18b20-c893-4a0a-8681-4b3340f4c247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '646c5f5d9bdc4f04862ce1d48e9214dd', 'request_id': 'req-aca18b20-c893-4a0a-8681-4b3340f4c247'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.603229 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-aca18b20-c893-4a0a-8681-4b3340f4c247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '646c5f5d9bdc4f04862ce1d48e9214dd', 'request_id': 'req-aca18b20-c893-4a0a-8681-4b3340f4c247'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.610378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-aca18b20-c893-4a0a-8681-4b3340f4c247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '646c5f5d9bdc4f04862ce1d48e9214dd', 'request_id': 'req-aca18b20-c893-4a0a-8681-4b3340f4c247'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.623467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-aca18b20-c893-4a0a-8681-4b3340f4c247 admin admin] The token cache is being invalidate because project 646c5f5d9bdc4f04862ce1d48e9214dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:29.623724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-aca18b20-c893-4a0a-8681-4b3340f4c247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.624455 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-aca18b20-c893-4a0a-8681-4b3340f4c247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:29.626186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1330/2670] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:29 2022] DELETE /identity/v3/projects/646c5f5d9bdc4f04862ce1d48e9214dd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:29.631210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ca9c5-67b0-4f0c-901c-42f726271975 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:29.631680 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ca9c5-67b0-4f0c-901c-42f726271975 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:29.631807 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982ca9c5-67b0-4f0c-901c-42f726271975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:29.650809 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-982ca9c5-67b0-4f0c-901c-42f726271975 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:29.652008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-982ca9c5-67b0-4f0c-901c-42f726271975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:29.710024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1341/2671] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:29.717716 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0a3cf-c8ba-47f0-9c8f-b7f2ffcf85ff None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:29.717942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0a3cf-c8ba-47f0-9c8f-b7f2ffcf85ff None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:29.718216 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0a3cf-c8ba-47f0-9c8f-b7f2ffcf85ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:29.737750 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f0a0a3cf-c8ba-47f0-9c8f-b7f2ffcf85ff None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:29.738955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f0a0a3cf-c8ba-47f0-9c8f-b7f2ffcf85ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:29.747490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1331/2672] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:29.751635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ca9c5-67b0-4f0c-901c-42f726271975 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:29.761352 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982ca9c5-67b0-4f0c-901c-42f726271975 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:29.765978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464254b3-215a-4925-bc30-ea5b14133e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:29.766576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464254b3-215a-4925-bc30-ea5b14133e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:29.766853 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464254b3-215a-4925-bc30-ea5b14133e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:29.767123 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464254b3-215a-4925-bc30-ea5b14133e83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:29.767805 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464254b3-215a-4925-bc30-ea5b14133e83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:12:29.768107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464254b3-215a-4925-bc30-ea5b14133e83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:29.769742 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464254b3-215a-4925-bc30-ea5b14133e83 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:29.781145 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1342/2673] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:12:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:12:29.785331 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0a3cf-c8ba-47f0-9c8f-b7f2ffcf85ff None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:29.794986 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0a3cf-c8ba-47f0-9c8f-b7f2ffcf85ff None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:29.799606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd3bd0-d872-4623-89e5-2fd94747eaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:29.800231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd3bd0-d872-4623-89e5-2fd94747eaba admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:29.800508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd3bd0-d872-4623-89e5-2fd94747eaba admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:29.800778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd3bd0-d872-4623-89e5-2fd94747eaba admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:29.801475 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd3bd0-d872-4623-89e5-2fd94747eaba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:29.803373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd3bd0-d872-4623-89e5-2fd94747eaba admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:29.823913 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:29.832118 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1332/2674] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:29 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:12:29.836392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464254b3-215a-4925-bc30-ea5b14133e83 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:29.846012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464254b3-215a-4925-bc30-ea5b14133e83 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:29.857727 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:29.904002 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd91e16-daf0-4526-b9f5-61d2ca34ee5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:29.904607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd91e16-daf0-4526-b9f5-61d2ca34ee5d admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:29.904885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd91e16-daf0-4526-b9f5-61d2ca34ee5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:29.905159 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd91e16-daf0-4526-b9f5-61d2ca34ee5d admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:29.905849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd91e16-daf0-4526-b9f5-61d2ca34ee5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:29.907731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd91e16-daf0-4526-b9f5-61d2ca34ee5d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:29.928172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1343/2675] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:29 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:29.932436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd3bd0-d872-4623-89e5-2fd94747eaba admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:29.942797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd3bd0-d872-4623-89e5-2fd94747eaba admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:29.947388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386fc7c-ced1-4dff-9b1c-985fa28e4700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:29.947991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386fc7c-ced1-4dff-9b1c-985fa28e4700 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:29.948287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386fc7c-ced1-4dff-9b1c-985fa28e4700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:29.948541 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f386fc7c-ced1-4dff-9b1c-985fa28e4700 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:29.949231 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386fc7c-ced1-4dff-9b1c-985fa28e4700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:29.950867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f386fc7c-ced1-4dff-9b1c-985fa28e4700 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:29.961070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1333/2676] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:29.964869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd91e16-daf0-4526-b9f5-61d2ca34ee5d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:29.974612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd91e16-daf0-4526-b9f5-61d2ca34ee5d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:29.979748 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26121f54-4122-443a-84c8-1fdd29bac7e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:29.980338 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26121f54-4122-443a-84c8-1fdd29bac7e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:29.980613 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26121f54-4122-443a-84c8-1fdd29bac7e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:29.980879 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26121f54-4122-443a-84c8-1fdd29bac7e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:29.981594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26121f54-4122-443a-84c8-1fdd29bac7e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:29.983156 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26121f54-4122-443a-84c8-1fdd29bac7e6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:29.992912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1344/2677] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:29.996678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386fc7c-ced1-4dff-9b1c-985fa28e4700 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:30.006423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f386fc7c-ced1-4dff-9b1c-985fa28e4700 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:30.011052 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e196f76-9a9f-4b93-9971-132e5ce365bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:30.011724 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e196f76-9a9f-4b93-9971-132e5ce365bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:30.012001 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e196f76-9a9f-4b93-9971-132e5ce365bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:30.012274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e196f76-9a9f-4b93-9971-132e5ce365bb admin admin] PATH_INFO: `/v3/projects/79b8de1d56aa40579e8f59aff677997c/users/882df7a849a147df8aded8ac594dcb64/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:30.028058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e196f76-9a9f-4b93-9971-132e5ce365bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=79b8de1d56aa40579e8f59aff677997c, user_id=882df7a849a147df8aded8ac594dcb64, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:30.030758 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e196f76-9a9f-4b93-9971-132e5ce365bb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:30.044176 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1334/2678] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:29 2022] PUT /identity/v3/projects/79b8de1d56aa40579e8f59aff677997c/users/882df7a849a147df8aded8ac594dcb64/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:12:30.054621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836efb5-0d6f-4629-82b6-7fde15c2dd4b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:30.054907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836efb5-0d6f-4629-82b6-7fde15c2dd4b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:30.055181 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f836efb5-0d6f-4629-82b6-7fde15c2dd4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:30.083332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f836efb5-0d6f-4629-82b6-7fde15c2dd4b None None] MFA Rules not processed for user `882df7a849a147df8aded8ac594dcb64`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:30.084741 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f836efb5-0d6f-4629-82b6-7fde15c2dd4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:30.149184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1345/2679] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:30.153659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e196f76-9a9f-4b93-9971-132e5ce365bb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:30.214268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e196f76-9a9f-4b93-9971-132e5ce365bb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:30.218820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f94ca-3082-48ea-8838-518bb2e405ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:30.219420 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f94ca-3082-48ea-8838-518bb2e405ec admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:30.219694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f94ca-3082-48ea-8838-518bb2e405ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:30.219960 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529f94ca-3082-48ea-8838-518bb2e405ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:30.220600 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f94ca-3082-48ea-8838-518bb2e405ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:30.222532 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529f94ca-3082-48ea-8838-518bb2e405ec admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:30.248210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1335/2680] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:30 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:30.252207 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836efb5-0d6f-4629-82b6-7fde15c2dd4b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:30.263113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f836efb5-0d6f-4629-82b6-7fde15c2dd4b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:30.317924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d5eae-4c3a-47a8-ae57-d953f939ec6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:30.318552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d5eae-4c3a-47a8-ae57-d953f939ec6d admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:30.318806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d5eae-4c3a-47a8-ae57-d953f939ec6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:30.319071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d5eae-4c3a-47a8-ae57-d953f939ec6d admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:30.319750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d5eae-4c3a-47a8-ae57-d953f939ec6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:30.322177 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d5eae-4c3a-47a8-ae57-d953f939ec6d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:30.343913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1346/2681] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:30 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:30.347876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f94ca-3082-48ea-8838-518bb2e405ec admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:30.358110 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529f94ca-3082-48ea-8838-518bb2e405ec admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:30.362678 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3d36-7538-40ba-ad32-fa49182ff0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:30.363280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3d36-7538-40ba-ad32-fa49182ff0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:30.363559 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3d36-7538-40ba-ad32-fa49182ff0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:30.363830 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c3d36-7538-40ba-ad32-fa49182ff0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:30.364517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c3d36-7538-40ba-ad32-fa49182ff0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:30.366188 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49c3d36-7538-40ba-ad32-fa49182ff0f6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:30.376727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1336/2682] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:30.380558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d5eae-4c3a-47a8-ae57-d953f939ec6d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:30.390860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d5eae-4c3a-47a8-ae57-d953f939ec6d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:30.395515 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a4e68-3ec5-4662-9bba-6a93a7dc1714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:30.396161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a4e68-3ec5-4662-9bba-6a93a7dc1714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:30.396439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a4e68-3ec5-4662-9bba-6a93a7dc1714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:30.396713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a4e68-3ec5-4662-9bba-6a93a7dc1714 admin admin] PATH_INFO: `/v3/projects/8e68ba4a678647a883bf19d75f03af95/users/8b07635ee7284d4194108fd9048901cb/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:30.408223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:30.412708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a4e68-3ec5-4662-9bba-6a93a7dc1714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e68ba4a678647a883bf19d75f03af95, user_id=8b07635ee7284d4194108fd9048901cb, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:30.416055 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a4e68-3ec5-4662-9bba-6a93a7dc1714 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:30.428414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1347/2683] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:30 2022] PUT /identity/v3/projects/8e68ba4a678647a883bf19d75f03af95/users/8b07635ee7284d4194108fd9048901cb/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:30.432500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3d36-7538-40ba-ad32-fa49182ff0f6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:30.442384 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c3d36-7538-40ba-ad32-fa49182ff0f6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:30.498168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54568549-e177-4c16-ad63-f717b7ed7778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:30.498842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568549-e177-4c16-ad63-f717b7ed7778 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:30.499065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568549-e177-4c16-ad63-f717b7ed7778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:30.499339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54568549-e177-4c16-ad63-f717b7ed7778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:30.500028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568549-e177-4c16-ad63-f717b7ed7778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:30.501684 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54568549-e177-4c16-ad63-f717b7ed7778 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:30.511871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1337/2684] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:12:30.516127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a4e68-3ec5-4662-9bba-6a93a7dc1714 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:30.527109 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a4e68-3ec5-4662-9bba-6a93a7dc1714 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:30.531721 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa719a6-e178-464c-a086-a600e1b44a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:30.532430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa719a6-e178-464c-a086-a600e1b44a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:30.533462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa719a6-e178-464c-a086-a600e1b44a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:30.533462 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa719a6-e178-464c-a086-a600e1b44a15 admin admin] PATH_INFO: `/v3/projects/8e68ba4a678647a883bf19d75f03af95/users/8b07635ee7284d4194108fd9048901cb/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:30.534962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa719a6-e178-464c-a086-a600e1b44a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e68ba4a678647a883bf19d75f03af95, user_id=8b07635ee7284d4194108fd9048901cb, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:30.537622 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa719a6-e178-464c-a086-a600e1b44a15 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:30.547999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1348/2685] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:30 2022] PUT /identity/v3/projects/8e68ba4a678647a883bf19d75f03af95/users/8b07635ee7284d4194108fd9048901cb/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:30.615793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7b309-3ba6-480e-b9e6-f8f28d8fecef None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:30.616365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7b309-3ba6-480e-b9e6-f8f28d8fecef None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:30.616365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a7b309-3ba6-480e-b9e6-f8f28d8fecef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:30.645433 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-02a7b309-3ba6-480e-b9e6-f8f28d8fecef None None] MFA Rules not processed for user `8b07635ee7284d4194108fd9048901cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:30.646622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-02a7b309-3ba6-480e-b9e6-f8f28d8fecef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:30.665857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:30.714023 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1338/2686] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:30 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:30.724669 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa719a6-e178-464c-a086-a600e1b44a15 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:30.726523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3aa719a6-e178-464c-a086-a600e1b44a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:30.784407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa719a6-e178-464c-a086-a600e1b44a15 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:30.787924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bd641-d9c1-4230-a1b8-9dfe4a93470a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:30.788528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bd641-d9c1-4230-a1b8-9dfe4a93470a service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:30.788823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bd641-d9c1-4230-a1b8-9dfe4a93470a service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:30.789096 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bd641-d9c1-4230-a1b8-9dfe4a93470a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:30.797868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bd641-d9c1-4230-a1b8-9dfe4a93470a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:30.799355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bd641-d9c1-4230-a1b8-9dfe4a93470a service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:30.809104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1349/2687] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:30.909669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7b309-3ba6-480e-b9e6-f8f28d8fecef None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:30.919197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a7b309-3ba6-480e-b9e6-f8f28d8fecef None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:30.922736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d4909-33a6-4eeb-bdc8-125614bdf152 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:30.923335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d4909-33a6-4eeb-bdc8-125614bdf152 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:30.923613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d4909-33a6-4eeb-bdc8-125614bdf152 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:30.923885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d4909-33a6-4eeb-bdc8-125614bdf152 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:30.980119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d4909-33a6-4eeb-bdc8-125614bdf152 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:30.981589 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d4909-33a6-4eeb-bdc8-125614bdf152 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:30.990197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1339/2688] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:33.562240 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bd641-d9c1-4230-a1b8-9dfe4a93470a service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:33.623429 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bd641-d9c1-4230-a1b8-9dfe4a93470a service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:33.627881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:33.628509 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:33.628786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:33.629056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] PATH_INFO: `/v3/users/882df7a849a147df8aded8ac594dcb64` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:33.630232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=882df7a849a147df8aded8ac594dcb64)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:33.632125 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:33.676466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '882df7a849a147df8aded8ac594dcb64'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:33.683783 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '882df7a849a147df8aded8ac594dcb64'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:33.695402 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '882df7a849a147df8aded8ac594dcb64'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:33.696029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '882df7a849a147df8aded8ac594dcb64'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:33.702746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '882df7a849a147df8aded8ac594dcb64'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:33.704147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:33.709673 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1350/2689] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:33 2022] DELETE /identity/v3/users/882df7a849a147df8aded8ac594dcb64 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:33.714990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04302965-b6a5-466c-bc58-778034957aa6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:33.715461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04302965-b6a5-466c-bc58-778034957aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:33.715580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04302965-b6a5-466c-bc58-778034957aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:33.734691 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-04302965-b6a5-466c-bc58-778034957aa6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:33.735884 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-04302965-b6a5-466c-bc58-778034957aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:33.798933 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1340/2690] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:12:33.810835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:33.812647 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:33.877707 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7585868-7d8a-4246-9434-10c96f950e2c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:33.881349 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f39e5-b3e7-4079-ac3a-af0fe4d030f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:33.881965 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f39e5-b3e7-4079-ac3a-af0fe4d030f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:33.882245 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f39e5-b3e7-4079-ac3a-af0fe4d030f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:33.882519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4f39e5-b3e7-4079-ac3a-af0fe4d030f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:33.891434 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f39e5-b3e7-4079-ac3a-af0fe4d030f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:33.892882 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4f39e5-b3e7-4079-ac3a-af0fe4d030f4 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:33.902801 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1351/2691] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:34.170764 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04302965-b6a5-466c-bc58-778034957aa6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:34.172188 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-04302965-b6a5-466c-bc58-778034957aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:34.184422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04302965-b6a5-466c-bc58-778034957aa6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:34.189919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:34.190558 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:34.190833 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:34.191104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] PATH_INFO: `/v3/projects/79b8de1d56aa40579e8f59aff677997c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:34.192247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79b8de1d56aa40579e8f59aff677997c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:34.194399 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:34.243712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79b8de1d56aa40579e8f59aff677997c', 'request_id': 'req-f8ac6665-733f-4e12-99a6-121674bb2be2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.245694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:34.250898 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79b8de1d56aa40579e8f59aff677997c', 'request_id': 'req-f8ac6665-733f-4e12-99a6-121674bb2be2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.258486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79b8de1d56aa40579e8f59aff677997c', 'request_id': 'req-f8ac6665-733f-4e12-99a6-121674bb2be2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.269400 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] The token cache is being invalidate because project 79b8de1d56aa40579e8f59aff677997c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:34.269682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.270304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.271806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1341/2692] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:34 2022] DELETE /identity/v3/projects/79b8de1d56aa40579e8f59aff677997c => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:34.276590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f39e5-b3e7-4079-ac3a-af0fe4d030f4 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:34.286030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4f39e5-b3e7-4079-ac3a-af0fe4d030f4 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:34.345883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef9f73c-71e8-434c-adec-45b8ecb4e257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:34.346444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9f73c-71e8-434c-adec-45b8ecb4e257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:34.346723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9f73c-71e8-434c-adec-45b8ecb4e257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:34.346996 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef9f73c-71e8-434c-adec-45b8ecb4e257 admin admin] PATH_INFO: `/v3/users/8b07635ee7284d4194108fd9048901cb` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:34.348148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9f73c-71e8-434c-adec-45b8ecb4e257 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b07635ee7284d4194108fd9048901cb)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:34.350088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef9f73c-71e8-434c-adec-45b8ecb4e257 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:34.397110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bef9f73c-71e8-434c-adec-45b8ecb4e257 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b07635ee7284d4194108fd9048901cb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.404068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bef9f73c-71e8-434c-adec-45b8ecb4e257 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b07635ee7284d4194108fd9048901cb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.415872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bef9f73c-71e8-434c-adec-45b8ecb4e257 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b07635ee7284d4194108fd9048901cb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.416534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bef9f73c-71e8-434c-adec-45b8ecb4e257 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b07635ee7284d4194108fd9048901cb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.423273 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bef9f73c-71e8-434c-adec-45b8ecb4e257 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b07635ee7284d4194108fd9048901cb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.430012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1352/2693] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:34 2022] DELETE /identity/v3/users/8b07635ee7284d4194108fd9048901cb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:34.708967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:34.710723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:34.725259 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ac6665-733f-4e12-99a6-121674bb2be2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:34.782489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f5b27-85eb-4998-9dc6-946e6739528d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:34.783128 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5b27-85eb-4998-9dc6-946e6739528d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:34.783408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5b27-85eb-4998-9dc6-946e6739528d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:34.783680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f5b27-85eb-4998-9dc6-946e6739528d admin admin] PATH_INFO: `/v3/projects/8e68ba4a678647a883bf19d75f03af95` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:34.784832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5b27-85eb-4998-9dc6-946e6739528d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e68ba4a678647a883bf19d75f03af95)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:34.786778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f5b27-85eb-4998-9dc6-946e6739528d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:34.836978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-651f5b27-85eb-4998-9dc6-946e6739528d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e68ba4a678647a883bf19d75f03af95', 'request_id': 'req-651f5b27-85eb-4998-9dc6-946e6739528d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.842473 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-651f5b27-85eb-4998-9dc6-946e6739528d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e68ba4a678647a883bf19d75f03af95', 'request_id': 'req-651f5b27-85eb-4998-9dc6-946e6739528d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.849721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-651f5b27-85eb-4998-9dc6-946e6739528d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e68ba4a678647a883bf19d75f03af95', 'request_id': 'req-651f5b27-85eb-4998-9dc6-946e6739528d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.862387 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-651f5b27-85eb-4998-9dc6-946e6739528d admin admin] The token cache is being invalidate because project 8e68ba4a678647a883bf19d75f03af95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:34.862679 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-651f5b27-85eb-4998-9dc6-946e6739528d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.863315 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-651f5b27-85eb-4998-9dc6-946e6739528d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:34.864891 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1342/2694] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:34 2022] DELETE /identity/v3/projects/8e68ba4a678647a883bf19d75f03af95 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:34.870699 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1082-1ffa-4351-8b6b-31ebaa9ac02b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:34.871165 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1082-1ffa-4351-8b6b-31ebaa9ac02b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:34.871282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124b1082-1ffa-4351-8b6b-31ebaa9ac02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:34.890465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-124b1082-1ffa-4351-8b6b-31ebaa9ac02b None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:34.891603 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-124b1082-1ffa-4351-8b6b-31ebaa9ac02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:34.904324 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:34.951644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1353/2695] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:34.959337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d90d4-7f5b-43d5-9bcd-6fb516b8e299 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:34.959723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d90d4-7f5b-43d5-9bcd-6fb516b8e299 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:34.960002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d90d4-7f5b-43d5-9bcd-6fb516b8e299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:34.981002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ec1d90d4-7f5b-43d5-9bcd-6fb516b8e299 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:34.982243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ec1d90d4-7f5b-43d5-9bcd-6fb516b8e299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:34.990064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1343/2696] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:34.995079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1082-1ffa-4351-8b6b-31ebaa9ac02b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.004802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124b1082-1ffa-4351-8b6b-31ebaa9ac02b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.009563 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a13c8-cec2-4b22-a051-d604cf9925ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.010198 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a13c8-cec2-4b22-a051-d604cf9925ae admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.010478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a13c8-cec2-4b22-a051-d604cf9925ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.010751 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4a13c8-cec2-4b22-a051-d604cf9925ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.011517 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a13c8-cec2-4b22-a051-d604cf9925ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:12:35.011822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a13c8-cec2-4b22-a051-d604cf9925ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.013449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4a13c8-cec2-4b22-a051-d604cf9925ae admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:35.024954 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1354/2697] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 12:12:35.029033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d90d4-7f5b-43d5-9bcd-6fb516b8e299 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.038285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d90d4-7f5b-43d5-9bcd-6fb516b8e299 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.043410 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e12c7-7b5c-4393-b815-cdb743787c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.044006 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e12c7-7b5c-4393-b815-cdb743787c44 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.044284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e12c7-7b5c-4393-b815-cdb743787c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.044555 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e12c7-7b5c-4393-b815-cdb743787c44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.045211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e12c7-7b5c-4393-b815-cdb743787c44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.047136 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953e12c7-7b5c-4393-b815-cdb743787c44 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:35.073258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1344/2698] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:35 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:35.077488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a13c8-cec2-4b22-a051-d604cf9925ae admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.088668 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4a13c8-cec2-4b22-a051-d604cf9925ae admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.144038 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437ff95-18ee-42c4-83b8-18240c1ee7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.144591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437ff95-18ee-42c4-83b8-18240c1ee7ec admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.144876 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437ff95-18ee-42c4-83b8-18240c1ee7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.145151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437ff95-18ee-42c4-83b8-18240c1ee7ec admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.145868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437ff95-18ee-42c4-83b8-18240c1ee7ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.147779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437ff95-18ee-42c4-83b8-18240c1ee7ec admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:35.169092 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1355/2699] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:35 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:35.173208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e12c7-7b5c-4393-b815-cdb743787c44 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.183408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e12c7-7b5c-4393-b815-cdb743787c44 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.188018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c931e9d-6c69-4ed3-ba15-d07252e8f8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.188618 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c931e9d-6c69-4ed3-ba15-d07252e8f8f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.188899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c931e9d-6c69-4ed3-ba15-d07252e8f8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.189172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c931e9d-6c69-4ed3-ba15-d07252e8f8f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.189888 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c931e9d-6c69-4ed3-ba15-d07252e8f8f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.191478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c931e9d-6c69-4ed3-ba15-d07252e8f8f5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:35.201834 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1345/2700] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:35.205473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437ff95-18ee-42c4-83b8-18240c1ee7ec admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.215403 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437ff95-18ee-42c4-83b8-18240c1ee7ec admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.219944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0ef4f6-658d-4e5c-907c-93cd628433a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.220530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ef4f6-658d-4e5c-907c-93cd628433a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.220804 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ef4f6-658d-4e5c-907c-93cd628433a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.221073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0ef4f6-658d-4e5c-907c-93cd628433a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.221783 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ef4f6-658d-4e5c-907c-93cd628433a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.223368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0ef4f6-658d-4e5c-907c-93cd628433a4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:35.234091 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1356/2701] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:35.238119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c931e9d-6c69-4ed3-ba15-d07252e8f8f5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.248169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c931e9d-6c69-4ed3-ba15-d07252e8f8f5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.252729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f81a5-624b-4f6e-8fa9-1d5120ca3148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.253389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f81a5-624b-4f6e-8fa9-1d5120ca3148 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.253666 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f81a5-624b-4f6e-8fa9-1d5120ca3148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.253939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f81a5-624b-4f6e-8fa9-1d5120ca3148 admin admin] PATH_INFO: `/v3/projects/28377155cce54b6a8321a2b533926634/users/3d600662e97646539a56277fd708dce2/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.268171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f81a5-624b-4f6e-8fa9-1d5120ca3148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28377155cce54b6a8321a2b533926634, user_id=3d600662e97646539a56277fd708dce2, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.270857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f81a5-624b-4f6e-8fa9-1d5120ca3148 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:35.283686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1346/2702] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:35 2022] PUT /identity/v3/projects/28377155cce54b6a8321a2b533926634/users/3d600662e97646539a56277fd708dce2/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:35.294565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896aa98-73aa-42e2-b9de-4ddeff879646 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.294849 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896aa98-73aa-42e2-b9de-4ddeff879646 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.295121 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2896aa98-73aa-42e2-b9de-4ddeff879646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.322994 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2896aa98-73aa-42e2-b9de-4ddeff879646 None None] MFA Rules not processed for user `3d600662e97646539a56277fd708dce2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:35.324193 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2896aa98-73aa-42e2-b9de-4ddeff879646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:35.392607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1357/2703] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:35.397318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f81a5-624b-4f6e-8fa9-1d5120ca3148 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.406121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:35.461478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f81a5-624b-4f6e-8fa9-1d5120ca3148 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.466194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef76f5-e4ca-4025-9f0c-27c06ec06d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.466827 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef76f5-e4ca-4025-9f0c-27c06ec06d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.467108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef76f5-e4ca-4025-9f0c-27c06ec06d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.467381 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ef76f5-e4ca-4025-9f0c-27c06ec06d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.468030 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef76f5-e4ca-4025-9f0c-27c06ec06d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.469991 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ef76f5-e4ca-4025-9f0c-27c06ec06d4d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:35.496882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1347/2704] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:35 2022] POST /identity/v3/projects => generated 381 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:35.501174 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896aa98-73aa-42e2-b9de-4ddeff879646 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.512004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2896aa98-73aa-42e2-b9de-4ddeff879646 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.523316 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:35.570259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50500e8d-9e4a-42e9-8f38-b61015da529e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.570870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50500e8d-9e4a-42e9-8f38-b61015da529e admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.571147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50500e8d-9e4a-42e9-8f38-b61015da529e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.571414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50500e8d-9e4a-42e9-8f38-b61015da529e admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.572074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50500e8d-9e4a-42e9-8f38-b61015da529e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.574021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50500e8d-9e4a-42e9-8f38-b61015da529e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:35.594734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1358/2705] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:35 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:35.598711 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef76f5-e4ca-4025-9f0c-27c06ec06d4d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.609525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ef76f5-e4ca-4025-9f0c-27c06ec06d4d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.614118 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6105cd-0d52-4435-9d25-a0eb8bc82c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.614721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6105cd-0d52-4435-9d25-a0eb8bc82c0a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.615004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6105cd-0d52-4435-9d25-a0eb8bc82c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.615278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6105cd-0d52-4435-9d25-a0eb8bc82c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.615965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6105cd-0d52-4435-9d25-a0eb8bc82c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.618449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6105cd-0d52-4435-9d25-a0eb8bc82c0a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:35.628823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1348/2706] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:35.632670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50500e8d-9e4a-42e9-8f38-b61015da529e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.642722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50500e8d-9e4a-42e9-8f38-b61015da529e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.647391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bee493-50b7-4205-99d2-de1c7ec39431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.647986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bee493-50b7-4205-99d2-de1c7ec39431 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.648262 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bee493-50b7-4205-99d2-de1c7ec39431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.648530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bee493-50b7-4205-99d2-de1c7ec39431 admin admin] PATH_INFO: `/v3/projects/44135144162f407e8d69a09039fcce6a/users/d5d245d7aa8d46c4aaebb07bf3a4045d/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.662704 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bee493-50b7-4205-99d2-de1c7ec39431 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44135144162f407e8d69a09039fcce6a, user_id=d5d245d7aa8d46c4aaebb07bf3a4045d, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.665868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bee493-50b7-4205-99d2-de1c7ec39431 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:35.678868 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1359/2707] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:35 2022] PUT /identity/v3/projects/44135144162f407e8d69a09039fcce6a/users/d5d245d7aa8d46c4aaebb07bf3a4045d/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:35.683233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6105cd-0d52-4435-9d25-a0eb8bc82c0a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.693104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6105cd-0d52-4435-9d25-a0eb8bc82c0a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.748611 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef430106-6689-4196-8035-bd5bc75d6dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.749205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430106-6689-4196-8035-bd5bc75d6dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.749509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430106-6689-4196-8035-bd5bc75d6dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.749791 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef430106-6689-4196-8035-bd5bc75d6dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.750475 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef430106-6689-4196-8035-bd5bc75d6dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.752077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef430106-6689-4196-8035-bd5bc75d6dc5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:35.761619 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1349/2708] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:35.765733 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bee493-50b7-4205-99d2-de1c7ec39431 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.776047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bee493-50b7-4205-99d2-de1c7ec39431 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.780661 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf4c33-15d3-45eb-859b-ed200867ad6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.781336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf4c33-15d3-45eb-859b-ed200867ad6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.781624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf4c33-15d3-45eb-859b-ed200867ad6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.781900 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf4c33-15d3-45eb-859b-ed200867ad6f admin admin] PATH_INFO: `/v3/projects/44135144162f407e8d69a09039fcce6a/users/d5d245d7aa8d46c4aaebb07bf3a4045d/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.783839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf4c33-15d3-45eb-859b-ed200867ad6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=44135144162f407e8d69a09039fcce6a, user_id=d5d245d7aa8d46c4aaebb07bf3a4045d, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.786539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf4c33-15d3-45eb-859b-ed200867ad6f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:35.797363 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1360/2709] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:35 2022] PUT /identity/v3/projects/44135144162f407e8d69a09039fcce6a/users/d5d245d7aa8d46c4aaebb07bf3a4045d/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:35.809590 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe502dc-c89c-449b-acd2-115dbe3eb093 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.809879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe502dc-c89c-449b-acd2-115dbe3eb093 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.810183 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe502dc-c89c-449b-acd2-115dbe3eb093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.837584 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-efe502dc-c89c-449b-acd2-115dbe3eb093 None None] MFA Rules not processed for user `d5d245d7aa8d46c4aaebb07bf3a4045d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:35.838795 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-efe502dc-c89c-449b-acd2-115dbe3eb093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:35.905536 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1350/2710] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:35 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:35.916628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf4c33-15d3-45eb-859b-ed200867ad6f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:35.918425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-eecf4c33-15d3-45eb-859b-ed200867ad6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:35.975361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf4c33-15d3-45eb-859b-ed200867ad6f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:35.979632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07728b6-a2fd-4ec2-9327-f7669ec87c39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:35.980242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07728b6-a2fd-4ec2-9327-f7669ec87c39 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:35.980523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07728b6-a2fd-4ec2-9327-f7669ec87c39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:35.980795 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07728b6-a2fd-4ec2-9327-f7669ec87c39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:35.989718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07728b6-a2fd-4ec2-9327-f7669ec87c39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:35.991158 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07728b6-a2fd-4ec2-9327-f7669ec87c39 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:36.000818 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1361/2711] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:35 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:36.363041 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe502dc-c89c-449b-acd2-115dbe3eb093 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:36.367429 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:36.425492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe502dc-c89c-449b-acd2-115dbe3eb093 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:36.429898 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:36.430521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:36.430793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:36.431057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] PATH_INFO: `/v3/users/3d600662e97646539a56277fd708dce2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:36.432187 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d600662e97646539a56277fd708dce2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:36.434127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:36.479527 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d600662e97646539a56277fd708dce2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:36.480168 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d600662e97646539a56277fd708dce2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:36.491671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d600662e97646539a56277fd708dce2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:36.498639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d600662e97646539a56277fd708dce2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:36.505508 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d600662e97646539a56277fd708dce2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:36.512077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1351/2712] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:36 2022] DELETE /identity/v3/users/3d600662e97646539a56277fd708dce2 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:36.516555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53654f0b-6eb4-47a5-ac5b-649017e9ea56 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:36.516835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53654f0b-6eb4-47a5-ac5b-649017e9ea56 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:36.517102 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53654f0b-6eb4-47a5-ac5b-649017e9ea56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:36.535713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-53654f0b-6eb4-47a5-ac5b-649017e9ea56 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:36.536885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-53654f0b-6eb4-47a5-ac5b-649017e9ea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:36.595434 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1362/2713] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:36.605124 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:36.606563 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:36.663550 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f7990e-fdfe-4a76-acc4-aac867a4f814 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:36.667227 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baba225-8a27-447a-becc-666ef6cce7ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:36.667831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baba225-8a27-447a-becc-666ef6cce7ef service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:36.668111 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baba225-8a27-447a-becc-666ef6cce7ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:36.668384 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baba225-8a27-447a-becc-666ef6cce7ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:36.677330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baba225-8a27-447a-becc-666ef6cce7ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:36.678721 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baba225-8a27-447a-becc-666ef6cce7ef service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:36.688552 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1352/2714] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:12:36.954692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53654f0b-6eb4-47a5-ac5b-649017e9ea56 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:36.956110 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-53654f0b-6eb4-47a5-ac5b-649017e9ea56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:36.968250 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53654f0b-6eb4-47a5-ac5b-649017e9ea56 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:36.972864 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:36.973540 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:36.973820 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:36.974094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] PATH_INFO: `/v3/projects/28377155cce54b6a8321a2b533926634` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:36.975256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28377155cce54b6a8321a2b533926634)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:36.977686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:36.984423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:37.025655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28377155cce54b6a8321a2b533926634', 'request_id': 'req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.031119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28377155cce54b6a8321a2b533926634', 'request_id': 'req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.037523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28377155cce54b6a8321a2b533926634', 'request_id': 'req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.050140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] The token cache is being invalidate because project 28377155cce54b6a8321a2b533926634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:37.050423 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.051031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.052494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1363/2715] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:36 2022] DELETE /identity/v3/projects/28377155cce54b6a8321a2b533926634 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:37.057233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baba225-8a27-447a-becc-666ef6cce7ef service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:37.066910 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baba225-8a27-447a-becc-666ef6cce7ef service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:37.086411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:37.124672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f619b0-5af3-4644-9b39-f6bdb8b9e250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:37.125328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f619b0-5af3-4644-9b39-f6bdb8b9e250 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:37.125608 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f619b0-5af3-4644-9b39-f6bdb8b9e250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:37.125877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f619b0-5af3-4644-9b39-f6bdb8b9e250 admin admin] PATH_INFO: `/v3/users/d5d245d7aa8d46c4aaebb07bf3a4045d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:37.127029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f619b0-5af3-4644-9b39-f6bdb8b9e250 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5d245d7aa8d46c4aaebb07bf3a4045d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:37.128940 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f619b0-5af3-4644-9b39-f6bdb8b9e250 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:37.177581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-76f619b0-5af3-4644-9b39-f6bdb8b9e250 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5d245d7aa8d46c4aaebb07bf3a4045d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.178655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-76f619b0-5af3-4644-9b39-f6bdb8b9e250 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5d245d7aa8d46c4aaebb07bf3a4045d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.192275 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-76f619b0-5af3-4644-9b39-f6bdb8b9e250 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5d245d7aa8d46c4aaebb07bf3a4045d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.199084 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-76f619b0-5af3-4644-9b39-f6bdb8b9e250 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5d245d7aa8d46c4aaebb07bf3a4045d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.206356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-76f619b0-5af3-4644-9b39-f6bdb8b9e250 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5d245d7aa8d46c4aaebb07bf3a4045d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.212251 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1353/2716] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:37 2022] DELETE /identity/v3/users/d5d245d7aa8d46c4aaebb07bf3a4045d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:37.492523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:37.494044 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:37.508595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f067dbf-80b8-4d10-bc6d-e825a32bf8b2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:37.565276 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8099f586-cbeb-45b1-8435-11a31a3cf17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:37.565943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099f586-cbeb-45b1-8435-11a31a3cf17a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:37.566225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099f586-cbeb-45b1-8435-11a31a3cf17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:37.566499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8099f586-cbeb-45b1-8435-11a31a3cf17a admin admin] PATH_INFO: `/v3/projects/44135144162f407e8d69a09039fcce6a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:37.567643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099f586-cbeb-45b1-8435-11a31a3cf17a admin admin] RBAC: Authorizing `identity:delete_project(project_id=44135144162f407e8d69a09039fcce6a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:37.569598 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8099f586-cbeb-45b1-8435-11a31a3cf17a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:37.615012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8099f586-cbeb-45b1-8435-11a31a3cf17a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44135144162f407e8d69a09039fcce6a', 'request_id': 'req-8099f586-cbeb-45b1-8435-11a31a3cf17a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.620629 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8099f586-cbeb-45b1-8435-11a31a3cf17a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44135144162f407e8d69a09039fcce6a', 'request_id': 'req-8099f586-cbeb-45b1-8435-11a31a3cf17a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.626555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8099f586-cbeb-45b1-8435-11a31a3cf17a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44135144162f407e8d69a09039fcce6a', 'request_id': 'req-8099f586-cbeb-45b1-8435-11a31a3cf17a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.638477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8099f586-cbeb-45b1-8435-11a31a3cf17a admin admin] The token cache is being invalidate because project 44135144162f407e8d69a09039fcce6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:37.638763 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8099f586-cbeb-45b1-8435-11a31a3cf17a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.639391 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8099f586-cbeb-45b1-8435-11a31a3cf17a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:37.640886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1364/2717] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:37 2022] DELETE /identity/v3/projects/44135144162f407e8d69a09039fcce6a => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:37.645844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a883d5-3022-4e6f-9a6b-07a2c721af36 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:37.646130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a883d5-3022-4e6f-9a6b-07a2c721af36 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:37.646401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a883d5-3022-4e6f-9a6b-07a2c721af36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:37.666590 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-59a883d5-3022-4e6f-9a6b-07a2c721af36 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:37.667806 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-59a883d5-3022-4e6f-9a6b-07a2c721af36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:37.724725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1354/2718] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:37.732377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd218838-dc32-4d35-aebb-417973669e8f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:37.732667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd218838-dc32-4d35-aebb-417973669e8f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:37.732939 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd218838-dc32-4d35-aebb-417973669e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:37.752368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-dd218838-dc32-4d35-aebb-417973669e8f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:37.753597 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dd218838-dc32-4d35-aebb-417973669e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:37.761936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1365/2719] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:37.765921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a883d5-3022-4e6f-9a6b-07a2c721af36 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:37.776042 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a883d5-3022-4e6f-9a6b-07a2c721af36 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:37.780583 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f1217-5f15-437a-9601-3bc49f10649d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:37.781179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f1217-5f15-437a-9601-3bc49f10649d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:37.781491 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f1217-5f15-437a-9601-3bc49f10649d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:37.781858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f1217-5f15-437a-9601-3bc49f10649d admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:37.782466 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f1217-5f15-437a-9601-3bc49f10649d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:12:37.782765 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f1217-5f15-437a-9601-3bc49f10649d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:37.784348 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62f1217-5f15-437a-9601-3bc49f10649d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:37.795771 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1355/2720] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:12:37.800059 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd218838-dc32-4d35-aebb-417973669e8f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:37.809521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd218838-dc32-4d35-aebb-417973669e8f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:37.814060 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d9e3e-49ca-4d56-9dd4-d583873e5c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:37.814652 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d9e3e-49ca-4d56-9dd4-d583873e5c00 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:37.814924 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d9e3e-49ca-4d56-9dd4-d583873e5c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:37.815190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431d9e3e-49ca-4d56-9dd4-d583873e5c00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:37.815834 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d9e3e-49ca-4d56-9dd4-d583873e5c00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:37.817741 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431d9e3e-49ca-4d56-9dd4-d583873e5c00 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:37.833147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:37.847475 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1366/2721] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:37 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:37.851579 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f1217-5f15-437a-9601-3bc49f10649d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:37.861263 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f1217-5f15-437a-9601-3bc49f10649d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:37.889849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:37.918564 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77125d5-4c19-4374-9299-091f1c8d0c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:37.919167 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77125d5-4c19-4374-9299-091f1c8d0c66 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:37.919446 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77125d5-4c19-4374-9299-091f1c8d0c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:37.919719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77125d5-4c19-4374-9299-091f1c8d0c66 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:37.920368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77125d5-4c19-4374-9299-091f1c8d0c66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:37.922325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77125d5-4c19-4374-9299-091f1c8d0c66 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:37.943503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1356/2722] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:37 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:37.947217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d9e3e-49ca-4d56-9dd4-d583873e5c00 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:37.957621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431d9e3e-49ca-4d56-9dd4-d583873e5c00 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:37.962933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9623c6a-41d6-49e5-a43f-2a78558abe99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:37.963538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9623c6a-41d6-49e5-a43f-2a78558abe99 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:37.963819 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9623c6a-41d6-49e5-a43f-2a78558abe99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:37.964120 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9623c6a-41d6-49e5-a43f-2a78558abe99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:37.964812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9623c6a-41d6-49e5-a43f-2a78558abe99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:37.966433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9623c6a-41d6-49e5-a43f-2a78558abe99 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:37.976847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1367/2723] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:37.980671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77125d5-4c19-4374-9299-091f1c8d0c66 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:37.990568 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77125d5-4c19-4374-9299-091f1c8d0c66 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:37.995824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4acd48-bc1c-4122-84bd-e31ee6ff955b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:37.996411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4acd48-bc1c-4122-84bd-e31ee6ff955b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:37.996685 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4acd48-bc1c-4122-84bd-e31ee6ff955b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:37.996950 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4acd48-bc1c-4122-84bd-e31ee6ff955b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:37.997669 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4acd48-bc1c-4122-84bd-e31ee6ff955b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:37.999242 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4acd48-bc1c-4122-84bd-e31ee6ff955b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:38.009646 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1357/2724] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:38.013430 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9623c6a-41d6-49e5-a43f-2a78558abe99 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:38.023145 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9623c6a-41d6-49e5-a43f-2a78558abe99 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:38.027820 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621fe0e-ff31-4d18-b7f0-d81b4f00d1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:38.028458 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621fe0e-ff31-4d18-b7f0-d81b4f00d1b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:38.028738 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621fe0e-ff31-4d18-b7f0-d81b4f00d1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:38.029012 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621fe0e-ff31-4d18-b7f0-d81b4f00d1b3 admin admin] PATH_INFO: `/v3/projects/4e6f81f4ddda4b199420b7229668bc44/users/7ab2cb37221c422091eda9dcba1efc7c/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:38.043930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621fe0e-ff31-4d18-b7f0-d81b4f00d1b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e6f81f4ddda4b199420b7229668bc44, user_id=7ab2cb37221c422091eda9dcba1efc7c, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:38.046607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621fe0e-ff31-4d18-b7f0-d81b4f00d1b3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:38.060096 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1368/2725] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:38 2022] PUT /identity/v3/projects/4e6f81f4ddda4b199420b7229668bc44/users/7ab2cb37221c422091eda9dcba1efc7c/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:38.071440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c9a13-6abb-445b-95b8-cd8d07add5f5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:38.071907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c9a13-6abb-445b-95b8-cd8d07add5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:38.072032 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8c9a13-6abb-445b-95b8-cd8d07add5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:38.101586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-be8c9a13-6abb-445b-95b8-cd8d07add5f5 None None] MFA Rules not processed for user `7ab2cb37221c422091eda9dcba1efc7c`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:38.102810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-be8c9a13-6abb-445b-95b8-cd8d07add5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:38.166044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1358/2726] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:38.177108 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621fe0e-ff31-4d18-b7f0-d81b4f00d1b3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:38.178852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7621fe0e-ff31-4d18-b7f0-d81b4f00d1b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:38.233516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621fe0e-ff31-4d18-b7f0-d81b4f00d1b3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:38.237059 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849bcc-0e4b-4455-b708-bfb54fb9ecdb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:38.237685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849bcc-0e4b-4455-b708-bfb54fb9ecdb service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:38.237962 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849bcc-0e4b-4455-b708-bfb54fb9ecdb service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:38.238232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849bcc-0e4b-4455-b708-bfb54fb9ecdb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:38.246522 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87849bcc-0e4b-4455-b708-bfb54fb9ecdb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:38.247934 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87849bcc-0e4b-4455-b708-bfb54fb9ecdb service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:38.256415 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1369/2727] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:38 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:48.162445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=52,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:48.252601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:51.802636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c9a13-6abb-445b-95b8-cd8d07add5f5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:51.870200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8c9a13-6abb-445b-95b8-cd8d07add5f5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:51.875005 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:51.875665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:51.876002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:51.876213 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] PATH_INFO: `/v3/users/7ab2cb37221c422091eda9dcba1efc7c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:51.877402 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ab2cb37221c422091eda9dcba1efc7c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:51.879355 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:51.931995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ab2cb37221c422091eda9dcba1efc7c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:51.932569 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ab2cb37221c422091eda9dcba1efc7c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:51.944734 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ab2cb37221c422091eda9dcba1efc7c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:51.951485 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ab2cb37221c422091eda9dcba1efc7c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:51.958258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ab2cb37221c422091eda9dcba1efc7c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:51.965079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1359/2728] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:51 2022] DELETE /identity/v3/users/7ab2cb37221c422091eda9dcba1efc7c => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:51.970411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3a0c6-1c02-4c61-b846-6c2964d595ca None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:51.970978 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3a0c6-1c02-4c61-b846-6c2964d595ca None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:51.971305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd3a0c6-1c02-4c61-b846-6c2964d595ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:51.992411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-acd3a0c6-1c02-4c61-b846-6c2964d595ca None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:51.993658 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-acd3a0c6-1c02-4c61-b846-6c2964d595ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:52.054498 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1370/2729] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:52.064218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:52.065662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:52.126881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d058d27-314c-467b-b5ed-607351b4723d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:52.130544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f630be-a72a-41df-bee8-ac9947258cfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:52.131192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f630be-a72a-41df-bee8-ac9947258cfa service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:52.131491 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f630be-a72a-41df-bee8-ac9947258cfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:52.132397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f630be-a72a-41df-bee8-ac9947258cfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:52.141780 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f630be-a72a-41df-bee8-ac9947258cfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:52.143223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f630be-a72a-41df-bee8-ac9947258cfa service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:52.153150 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1360/2730] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:52.418599 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3a0c6-1c02-4c61-b846-6c2964d595ca None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:52.420054 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-acd3a0c6-1c02-4c61-b846-6c2964d595ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:52.432888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd3a0c6-1c02-4c61-b846-6c2964d595ca None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:52.437619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3632ac-16df-4296-9a4b-c0126ed487dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:52.438264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3632ac-16df-4296-9a4b-c0126ed487dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:52.438547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3632ac-16df-4296-9a4b-c0126ed487dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:52.438820 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3632ac-16df-4296-9a4b-c0126ed487dd admin admin] PATH_INFO: `/v3/projects/4e6f81f4ddda4b199420b7229668bc44` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:52.439988 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3632ac-16df-4296-9a4b-c0126ed487dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e6f81f4ddda4b199420b7229668bc44)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:52.442193 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3632ac-16df-4296-9a4b-c0126ed487dd admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:52.488672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1f3632ac-16df-4296-9a4b-c0126ed487dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e6f81f4ddda4b199420b7229668bc44', 'request_id': 'req-1f3632ac-16df-4296-9a4b-c0126ed487dd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:52.494870 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1f3632ac-16df-4296-9a4b-c0126ed487dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e6f81f4ddda4b199420b7229668bc44', 'request_id': 'req-1f3632ac-16df-4296-9a4b-c0126ed487dd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:52.500910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1f3632ac-16df-4296-9a4b-c0126ed487dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e6f81f4ddda4b199420b7229668bc44', 'request_id': 'req-1f3632ac-16df-4296-9a4b-c0126ed487dd'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:52.513528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1f3632ac-16df-4296-9a4b-c0126ed487dd admin admin] The token cache is being invalidate because project 4e6f81f4ddda4b199420b7229668bc44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:52.513844 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1f3632ac-16df-4296-9a4b-c0126ed487dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:52.514492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1f3632ac-16df-4296-9a4b-c0126ed487dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:52.515975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1371/2731] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:52 2022] DELETE /identity/v3/projects/4e6f81f4ddda4b199420b7229668bc44 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:52.520853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b60dc-5b40-4ffd-a65e-4cab96d6191c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:52.521157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b60dc-5b40-4ffd-a65e-4cab96d6191c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:52.521481 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415b60dc-5b40-4ffd-a65e-4cab96d6191c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:52.540874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-415b60dc-5b40-4ffd-a65e-4cab96d6191c None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:52.542104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-415b60dc-5b40-4ffd-a65e-4cab96d6191c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:52.559639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:52.603465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1361/2732] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:52.611424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc862-4c4b-490f-9323-4160ffe277e7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:52.611713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc862-4c4b-490f-9323-4160ffe277e7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:52.612062 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6bc862-4c4b-490f-9323-4160ffe277e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:52.635906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1b6bc862-4c4b-490f-9323-4160ffe277e7 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:52.637106 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1b6bc862-4c4b-490f-9323-4160ffe277e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:52.645138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1372/2733] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:52.649440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b60dc-5b40-4ffd-a65e-4cab96d6191c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:52.659210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415b60dc-5b40-4ffd-a65e-4cab96d6191c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:52.663759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e426-9cbd-4e24-a1b8-2d4525e2441c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:52.664356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e426-9cbd-4e24-a1b8-2d4525e2441c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:52.664636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e426-9cbd-4e24-a1b8-2d4525e2441c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:52.664909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97e426-9cbd-4e24-a1b8-2d4525e2441c admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:52.665631 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97e426-9cbd-4e24-a1b8-2d4525e2441c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:12:52.665936 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97e426-9cbd-4e24-a1b8-2d4525e2441c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:52.667546 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd97e426-9cbd-4e24-a1b8-2d4525e2441c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:52.679375 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1362/2734] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:12:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:12:52.683624 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bc862-4c4b-490f-9323-4160ffe277e7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:52.692567 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6bc862-4c4b-490f-9323-4160ffe277e7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:52.697744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c21f31-558b-46df-9e2d-82acfb6f26e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:52.698332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c21f31-558b-46df-9e2d-82acfb6f26e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:52.698606 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c21f31-558b-46df-9e2d-82acfb6f26e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:52.698872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c21f31-558b-46df-9e2d-82acfb6f26e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:52.699555 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c21f31-558b-46df-9e2d-82acfb6f26e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:52.701454 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c21f31-558b-46df-9e2d-82acfb6f26e1 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:52.728817 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1373/2735] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:52 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:12:52.733060 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e426-9cbd-4e24-a1b8-2d4525e2441c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:52.743841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97e426-9cbd-4e24-a1b8-2d4525e2441c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:52.799450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4410b-8659-4229-96a1-d8bc5669f5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:52.799980 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4410b-8659-4229-96a1-d8bc5669f5de admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:52.800254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4410b-8659-4229-96a1-d8bc5669f5de admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:52.800523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e4410b-8659-4229-96a1-d8bc5669f5de admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:52.801203 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4410b-8659-4229-96a1-d8bc5669f5de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:52.803181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e4410b-8659-4229-96a1-d8bc5669f5de admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:52.824994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1363/2736] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:52 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:52.829107 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c21f31-558b-46df-9e2d-82acfb6f26e1 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:52.839224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c21f31-558b-46df-9e2d-82acfb6f26e1 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:52.843779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1249b5-0a5a-408e-872e-1769439827f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:52.845215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1249b5-0a5a-408e-872e-1769439827f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:52.845522 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1249b5-0a5a-408e-872e-1769439827f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:52.845793 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1249b5-0a5a-408e-872e-1769439827f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:52.846663 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1249b5-0a5a-408e-872e-1769439827f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:52.848241 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1249b5-0a5a-408e-872e-1769439827f4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:52.859140 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1374/2737] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:52.863794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4410b-8659-4229-96a1-d8bc5669f5de admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:52.877147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e4410b-8659-4229-96a1-d8bc5669f5de admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:52.882157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afbdd3c-8039-44d3-a6d4-fb19142a6612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:52.882797 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbdd3c-8039-44d3-a6d4-fb19142a6612 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:52.883077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbdd3c-8039-44d3-a6d4-fb19142a6612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:52.883351 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afbdd3c-8039-44d3-a6d4-fb19142a6612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:52.884043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbdd3c-8039-44d3-a6d4-fb19142a6612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:52.885676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afbdd3c-8039-44d3-a6d4-fb19142a6612 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:52.898996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1364/2738] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:52.903225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1249b5-0a5a-408e-872e-1769439827f4 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:52.913549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1249b5-0a5a-408e-872e-1769439827f4 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:52.918569 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed7cc-a7fe-4f3b-8866-2b9d45513265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:52.919294 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed7cc-a7fe-4f3b-8866-2b9d45513265 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:52.919635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed7cc-a7fe-4f3b-8866-2b9d45513265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:52.919910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7ed7cc-a7fe-4f3b-8866-2b9d45513265 admin admin] PATH_INFO: `/v3/projects/508e123caf6245d1aa28ced60d8f36a3/users/d6c2f3d4fb12456f88eb5993d83c1bd2/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:52.935813 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ed7cc-a7fe-4f3b-8866-2b9d45513265 admin admin] RBAC: Authorizing `identity:create_grant(project_id=508e123caf6245d1aa28ced60d8f36a3, user_id=d6c2f3d4fb12456f88eb5993d83c1bd2, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:52.938674 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7ed7cc-a7fe-4f3b-8866-2b9d45513265 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:52.956094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1375/2739] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:52 2022] PUT /identity/v3/projects/508e123caf6245d1aa28ced60d8f36a3/users/d6c2f3d4fb12456f88eb5993d83c1bd2/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:52.957671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaef2f-a8d1-41c0-a97a-e2f6d110f5ba None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:52.957967 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaef2f-a8d1-41c0-a97a-e2f6d110f5ba None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:52.958243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaaef2f-a8d1-41c0-a97a-e2f6d110f5ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:52.981557 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-daaaef2f-a8d1-41c0-a97a-e2f6d110f5ba None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:52.983542 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-daaaef2f-a8d1-41c0-a97a-e2f6d110f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:53.011431 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed7cc-a7fe-4f3b-8866-2b9d45513265 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:53.013172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-eb7ed7cc-a7fe-4f3b-8866-2b9d45513265 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:53.034697 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:53.049768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1365/2740] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:12:53.059028 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaef2f-a8d1-41c0-a97a-e2f6d110f5ba None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:53.060514 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-daaaef2f-a8d1-41c0-a97a-e2f6d110f5ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:53.076474 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7ed7cc-a7fe-4f3b-8866-2b9d45513265 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:53.080716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a802552-7c3c-4de1-a319-9e099a93bb54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:53.081623 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a802552-7c3c-4de1-a319-9e099a93bb54 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:53.081975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a802552-7c3c-4de1-a319-9e099a93bb54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:53.082407 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a802552-7c3c-4de1-a319-9e099a93bb54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:53.084673 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1a802552-7c3c-4de1-a319-9e099a93bb54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:53.093865 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:53.100142 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a802552-7c3c-4de1-a319-9e099a93bb54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:53.102330 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a802552-7c3c-4de1-a319-9e099a93bb54 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:53.112507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1376/2741] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:12:53.121964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaaef2f-a8d1-41c0-a97a-e2f6d110f5ba None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:53.125640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64283388-af9b-44d4-8c1d-c480a0feb133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:53.126323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64283388-af9b-44d4-8c1d-c480a0feb133 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:53.126602 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64283388-af9b-44d4-8c1d-c480a0feb133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:53.126880 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64283388-af9b-44d4-8c1d-c480a0feb133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:53.136254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64283388-af9b-44d4-8c1d-c480a0feb133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:53.137767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64283388-af9b-44d4-8c1d-c480a0feb133 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:53.147810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1366/2742] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:12:54.086649 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d896bc-b107-4c24-b2ac-c47f177449cc None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:54.087144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d896bc-b107-4c24-b2ac-c47f177449cc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:54.087270 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d896bc-b107-4c24-b2ac-c47f177449cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:54.120652 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-04d896bc-b107-4c24-b2ac-c47f177449cc None None] MFA Rules not processed for user `d6c2f3d4fb12456f88eb5993d83c1bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:54.121822 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-04d896bc-b107-4c24-b2ac-c47f177449cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:54.197646 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1377/2743] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:54.208719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64283388-af9b-44d4-8c1d-c480a0feb133 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:54.210346 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-64283388-af9b-44d4-8c1d-c480a0feb133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:54.291306 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64283388-af9b-44d4-8c1d-c480a0feb133 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:54.294972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31a5ca-8f1c-4a45-95ed-3f749bb09408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:54.295591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31a5ca-8f1c-4a45-95ed-3f749bb09408 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:54.296075 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31a5ca-8f1c-4a45-95ed-3f749bb09408 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:54.296350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31a5ca-8f1c-4a45-95ed-3f749bb09408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:54.314174 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31a5ca-8f1c-4a45-95ed-3f749bb09408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:54.315674 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31a5ca-8f1c-4a45-95ed-3f749bb09408 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:54.326580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1367/2744] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:55.713912 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf2d25-3edd-4869-83c1-2533f877db4d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:55.714486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf2d25-3edd-4869-83c1-2533f877db4d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:55.714486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbf2d25-3edd-4869-83c1-2533f877db4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:55.734032 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-dfbf2d25-3edd-4869-83c1-2533f877db4d None None] MFA Rules not processed for user `d6c2f3d4fb12456f88eb5993d83c1bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:55.735236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dfbf2d25-3edd-4869-83c1-2533f877db4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:55.742369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1378/2745] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:56.641190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31a5ca-8f1c-4a45-95ed-3f749bb09408 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:56.642847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5f31a5ca-8f1c-4a45-95ed-3f749bb09408 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:56.726253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf2d25-3edd-4869-83c1-2533f877db4d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:56.728280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dfbf2d25-3edd-4869-83c1-2533f877db4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:56.746026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbf2d25-3edd-4869-83c1-2533f877db4d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:56.751488 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5373b83b-7460-4d88-84ef-2ba3a13817b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:56.752422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373b83b-7460-4d88-84ef-2ba3a13817b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:56.752570 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31a5ca-8f1c-4a45-95ed-3f749bb09408 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:56.753160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373b83b-7460-4d88-84ef-2ba3a13817b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:56.753588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5373b83b-7460-4d88-84ef-2ba3a13817b4 admin admin] PATH_INFO: `/v3/users/ea32636c7dbc4cb586e8b9021218b8d8` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:56.754638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373b83b-7460-4d88-84ef-2ba3a13817b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea32636c7dbc4cb586e8b9021218b8d8)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:56.756642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5373b83b-7460-4d88-84ef-2ba3a13817b4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:56.759809 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ec548-0a34-448b-9e33-037b10cfe441 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:56.760372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ec548-0a34-448b-9e33-037b10cfe441 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:56.760640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ec548-0a34-448b-9e33-037b10cfe441 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:56.760916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ec548-0a34-448b-9e33-037b10cfe441 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:56.763190 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-033ec548-0a34-448b-9e33-037b10cfe441 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:56.781347 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ec548-0a34-448b-9e33-037b10cfe441 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:56.783360 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ec548-0a34-448b-9e33-037b10cfe441 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:56.795261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1368/2746] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:12:56.813187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5373b83b-7460-4d88-84ef-2ba3a13817b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea32636c7dbc4cb586e8b9021218b8d8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:56.823634 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5373b83b-7460-4d88-84ef-2ba3a13817b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea32636c7dbc4cb586e8b9021218b8d8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:56.839656 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5373b83b-7460-4d88-84ef-2ba3a13817b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea32636c7dbc4cb586e8b9021218b8d8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:56.840364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5373b83b-7460-4d88-84ef-2ba3a13817b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea32636c7dbc4cb586e8b9021218b8d8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:56.847891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5373b83b-7460-4d88-84ef-2ba3a13817b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea32636c7dbc4cb586e8b9021218b8d8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:56.855101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1379/2747] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:12:56 2022] DELETE /identity/v3/users/ea32636c7dbc4cb586e8b9021218b8d8 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:12:57.063073 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ec548-0a34-448b-9e33-037b10cfe441 service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:57.075909 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ec548-0a34-448b-9e33-037b10cfe441 service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:57.153285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833468a-619b-44f6-9259-17ba31e52d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:57.154162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833468a-619b-44f6-9259-17ba31e52d05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:57.154469 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833468a-619b-44f6-9259-17ba31e52d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:57.154815 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833468a-619b-44f6-9259-17ba31e52d05 admin admin] PATH_INFO: `/v3/projects/eaff8fd2efa7454dbf4df0109c383011` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:57.156253 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833468a-619b-44f6-9259-17ba31e52d05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaff8fd2efa7454dbf4df0109c383011)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:57.158561 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833468a-619b-44f6-9259-17ba31e52d05 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:57.166255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:57.213708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c833468a-619b-44f6-9259-17ba31e52d05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaff8fd2efa7454dbf4df0109c383011', 'request_id': 'req-c833468a-619b-44f6-9259-17ba31e52d05'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:57.219079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c833468a-619b-44f6-9259-17ba31e52d05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaff8fd2efa7454dbf4df0109c383011', 'request_id': 'req-c833468a-619b-44f6-9259-17ba31e52d05'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:57.230651 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c833468a-619b-44f6-9259-17ba31e52d05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaff8fd2efa7454dbf4df0109c383011', 'request_id': 'req-c833468a-619b-44f6-9259-17ba31e52d05'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:57.242655 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c833468a-619b-44f6-9259-17ba31e52d05 admin admin] The token cache is being invalidate because project eaff8fd2efa7454dbf4df0109c383011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:12:57.242860 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c833468a-619b-44f6-9259-17ba31e52d05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:57.243523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c833468a-619b-44f6-9259-17ba31e52d05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:12:57.245239 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1369/2748] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:12:57 2022] DELETE /identity/v3/projects/eaff8fd2efa7454dbf4df0109c383011 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:57.250303 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424c395-bf36-4c9b-bd19-50cf6a7541e6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:57.250594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424c395-bf36-4c9b-bd19-50cf6a7541e6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:57.250873 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424c395-bf36-4c9b-bd19-50cf6a7541e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:57.272801 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7424c395-bf36-4c9b-bd19-50cf6a7541e6 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:57.274258 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7424c395-bf36-4c9b-bd19-50cf6a7541e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:57.294664 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:12:57.345941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1380/2749] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:57.353684 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eadeb9-79d1-4772-a764-ce73d0c973a7 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:57.353971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eadeb9-79d1-4772-a764-ce73d0c973a7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:57.354247 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eadeb9-79d1-4772-a764-ce73d0c973a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:57.374657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e7eadeb9-79d1-4772-a764-ce73d0c973a7 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:57.375863 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e7eadeb9-79d1-4772-a764-ce73d0c973a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:57.384270 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1370/2750] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:57.388612 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424c395-bf36-4c9b-bd19-50cf6a7541e6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:57.398830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424c395-bf36-4c9b-bd19-50cf6a7541e6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:57.403264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5199a76-b8d0-4ea7-8282-68afab1d5813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:57.403860 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5199a76-b8d0-4ea7-8282-68afab1d5813 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:57.404135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5199a76-b8d0-4ea7-8282-68afab1d5813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:57.404402 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5199a76-b8d0-4ea7-8282-68afab1d5813 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:57.405083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5199a76-b8d0-4ea7-8282-68afab1d5813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:12:57.405479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5199a76-b8d0-4ea7-8282-68afab1d5813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:57.407063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5199a76-b8d0-4ea7-8282-68afab1d5813 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:57.418336 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1381/2751] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:12:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:12:57.422394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eadeb9-79d1-4772-a764-ce73d0c973a7 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:57.431671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eadeb9-79d1-4772-a764-ce73d0c973a7 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:57.436295 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9654ec8-6c1c-4bc6-bbe2-c6a668b6de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:57.436912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9654ec8-6c1c-4bc6-bbe2-c6a668b6de9a admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:57.437192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9654ec8-6c1c-4bc6-bbe2-c6a668b6de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:57.437497 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9654ec8-6c1c-4bc6-bbe2-c6a668b6de9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:57.438165 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9654ec8-6c1c-4bc6-bbe2-c6a668b6de9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:57.440181 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9654ec8-6c1c-4bc6-bbe2-c6a668b6de9a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:57.468987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1371/2752] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:12:57 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:57.473148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5199a76-b8d0-4ea7-8282-68afab1d5813 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:57.482948 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5199a76-b8d0-4ea7-8282-68afab1d5813 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:57.538806 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b3fb2-f995-46bc-b0f3-1f6b1b1dfbd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:57.539405 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b3fb2-f995-46bc-b0f3-1f6b1b1dfbd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:57.539692 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b3fb2-f995-46bc-b0f3-1f6b1b1dfbd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:57.539964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b3fb2-f995-46bc-b0f3-1f6b1b1dfbd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:57.540616 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b3fb2-f995-46bc-b0f3-1f6b1b1dfbd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:57.542566 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b3fb2-f995-46bc-b0f3-1f6b1b1dfbd5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:57.563998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1382/2753] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:12:57 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:12:57.568238 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9654ec8-6c1c-4bc6-bbe2-c6a668b6de9a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:57.578919 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9654ec8-6c1c-4bc6-bbe2-c6a668b6de9a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:57.584300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16484d25-defa-4e0a-95b4-d674a19326d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:57.585503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484d25-defa-4e0a-95b4-d674a19326d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:57.585783 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484d25-defa-4e0a-95b4-d674a19326d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:57.586053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16484d25-defa-4e0a-95b4-d674a19326d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:57.586750 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16484d25-defa-4e0a-95b4-d674a19326d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:57.588420 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16484d25-defa-4e0a-95b4-d674a19326d9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:57.602629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1372/2754] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:57.603811 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b3fb2-f995-46bc-b0f3-1f6b1b1dfbd5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:57.614033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b3fb2-f995-46bc-b0f3-1f6b1b1dfbd5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:57.619441 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baafd609-5be6-4922-b26c-2034da344750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:57.620074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafd609-5be6-4922-b26c-2034da344750 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:57.620354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafd609-5be6-4922-b26c-2034da344750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:57.620746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baafd609-5be6-4922-b26c-2034da344750 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:57.621477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafd609-5be6-4922-b26c-2034da344750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:57.623066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baafd609-5be6-4922-b26c-2034da344750 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:57.637731 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1383/2755] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:12:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:12:57.638981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16484d25-defa-4e0a-95b4-d674a19326d9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:57.649476 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16484d25-defa-4e0a-95b4-d674a19326d9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:57.654207 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80e3c-90a3-46ff-9e09-782fcf3fbc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:57.654862 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80e3c-90a3-46ff-9e09-782fcf3fbc3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:57.655735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80e3c-90a3-46ff-9e09-782fcf3fbc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:57.656019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb80e3c-90a3-46ff-9e09-782fcf3fbc3c admin admin] PATH_INFO: `/v3/projects/a80a4faad6524aaeb6bc81d5c46182e5/users/1e4ece91578b426da4f0d9166903f06a/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:57.670944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb80e3c-90a3-46ff-9e09-782fcf3fbc3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a80a4faad6524aaeb6bc81d5c46182e5, user_id=1e4ece91578b426da4f0d9166903f06a, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:57.673571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb80e3c-90a3-46ff-9e09-782fcf3fbc3c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:57.688427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1373/2756] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:12:57 2022] PUT /identity/v3/projects/a80a4faad6524aaeb6bc81d5c46182e5/users/1e4ece91578b426da4f0d9166903f06a/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:12:57.693620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ad23d-50cd-44cd-83ad-d4f3aff821e8 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:57.694000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ad23d-50cd-44cd-83ad-d4f3aff821e8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:57.694826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ad23d-50cd-44cd-83ad-d4f3aff821e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:57.715743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-544ad23d-50cd-44cd-83ad-d4f3aff821e8 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:12:57.717101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-544ad23d-50cd-44cd-83ad-d4f3aff821e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:57.820984 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1384/2757] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:12:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:12:57.830692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80e3c-90a3-46ff-9e09-782fcf3fbc3c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:12:57.832425 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1cb80e3c-90a3-46ff-9e09-782fcf3fbc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:12:57.894335 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb80e3c-90a3-46ff-9e09-782fcf3fbc3c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:12:57.897983 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365484-0a22-4f72-897e-edd3ad9a8ce4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:12:57.898622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365484-0a22-4f72-897e-edd3ad9a8ce4 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:12:57.898895 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365484-0a22-4f72-897e-edd3ad9a8ce4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:12:57.899161 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8365484-0a22-4f72-897e-edd3ad9a8ce4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:12:57.908235 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8365484-0a22-4f72-897e-edd3ad9a8ce4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:12:57.909709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8365484-0a22-4f72-897e-edd3ad9a8ce4 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:12:57.919206 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1374/2758] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:12:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:13:02.162150 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310325fc-2b19-42c2-9f78-b68aef5f9d09 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:13:02.162635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310325fc-2b19-42c2-9f78-b68aef5f9d09 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:13:02.162862 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310325fc-2b19-42c2-9f78-b68aef5f9d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:13:02.191932 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-310325fc-2b19-42c2-9f78-b68aef5f9d09 None None] MFA Rules not processed for user `1e4ece91578b426da4f0d9166903f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:13:02.193452 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-310325fc-2b19-42c2-9f78-b68aef5f9d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:13:02.213536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:13:02.281745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1385/2759] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:13:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:13:02.292101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365484-0a22-4f72-897e-edd3ad9a8ce4 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:13:02.292896 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c8365484-0a22-4f72-897e-edd3ad9a8ce4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:13:02.332723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:13:02.387943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8365484-0a22-4f72-897e-edd3ad9a8ce4 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:13:02.404665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecef9458-963c-449e-bce2-a0278886d021 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:13:02.405410 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef9458-963c-449e-bce2-a0278886d021 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:13:02.405670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef9458-963c-449e-bce2-a0278886d021 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:13:02.405942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecef9458-963c-449e-bce2-a0278886d021 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:13:02.419048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef9458-963c-449e-bce2-a0278886d021 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:13:02.420692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecef9458-963c-449e-bce2-a0278886d021 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:13:02.431199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1375/2760] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:13:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:13:04.074015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12eb62-4e72-469b-9b32-3c06c52baf06 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:13:04.074754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12eb62-4e72-469b-9b32-3c06c52baf06 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:13:04.074754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12eb62-4e72-469b-9b32-3c06c52baf06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:13:04.094833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9a12eb62-4e72-469b-9b32-3c06c52baf06 None None] MFA Rules not processed for user `1e4ece91578b426da4f0d9166903f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:13:04.096101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9a12eb62-4e72-469b-9b32-3c06c52baf06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:13:04.103724 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1386/2761] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:13:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:13:12.426031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=19 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:13:13.164065 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd691-a706-4e72-944a-6472e3436375 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:13:13.164415 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd691-a706-4e72-944a-6472e3436375 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:13:13.164778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34bd691-a706-4e72-944a-6472e3436375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:13:13.189088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b34bd691-a706-4e72-944a-6472e3436375 None None] MFA Rules not processed for user `d6c2f3d4fb12456f88eb5993d83c1bd2`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:13:13.190457 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b34bd691-a706-4e72-944a-6472e3436375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:13:13.255160 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1376/2762] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:13:13 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:13:14.089138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=24 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:13:23.244038 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=25 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:13:23.724575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12eb62-4e72-469b-9b32-3c06c52baf06 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:13:23.734586 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12eb62-4e72-469b-9b32-3c06c52baf06 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:13:23.738155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cc7ad7-2178-4d8b-b2b5-9227c3ca750a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:13:23.738762 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc7ad7-2178-4d8b-b2b5-9227c3ca750a service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:13:23.739040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc7ad7-2178-4d8b-b2b5-9227c3ca750a service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:13:23.739311 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cc7ad7-2178-4d8b-b2b5-9227c3ca750a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:13:23.741027 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-27cc7ad7-2178-4d8b-b2b5-9227c3ca750a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:13:23.755038 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc7ad7-2178-4d8b-b2b5-9227c3ca750a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:13:23.756449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cc7ad7-2178-4d8b-b2b5-9227c3ca750a service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:13:23.767503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1387/2763] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:13:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:13:24.378039 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bd691-a706-4e72-944a-6472e3436375 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:13:24.379577 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b34bd691-a706-4e72-944a-6472e3436375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:13:24.392300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34bd691-a706-4e72-944a-6472e3436375 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:13:24.397016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b58b6d-3f52-405d-9ea3-3bdbec3342bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:13:24.398085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b58b6d-3f52-405d-9ea3-3bdbec3342bd service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:13:24.398085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b58b6d-3f52-405d-9ea3-3bdbec3342bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:13:24.398311 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b58b6d-3f52-405d-9ea3-3bdbec3342bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:13:24.400706 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-02b58b6d-3f52-405d-9ea3-3bdbec3342bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:13:24.415572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b58b6d-3f52-405d-9ea3-3bdbec3342bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:13:24.417010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b58b6d-3f52-405d-9ea3-3bdbec3342bd service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:13:24.428299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1377/2764] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:13:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:13:31.443549 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a01b9-524a-471c-aa34-199b877724bf None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:13:31.444039 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a01b9-524a-471c-aa34-199b877724bf None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:13:31.444138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51a01b9-524a-471c-aa34-199b877724bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:13:31.463047 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b51a01b9-524a-471c-aa34-199b877724bf None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:13:31.464222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b51a01b9-524a-471c-aa34-199b877724bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:13:31.517873 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1388/2765] 10.222.0.42 () {58 vars in 1009 bytes} [Mon Aug 1 12:13:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:13:31.564130 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b58b6d-3f52-405d-9ea3-3bdbec3342bd service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:13:31.565620 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-02b58b6d-3f52-405d-9ea3-3bdbec3342bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:13:31.632899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b58b6d-3f52-405d-9ea3-3bdbec3342bd service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:13:31.638503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e5597-f5c2-457d-9bf2-d4d86cacd9e4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:13:31.639048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e5597-f5c2-457d-9bf2-d4d86cacd9e4 service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:13:31.639325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e5597-f5c2-457d-9bf2-d4d86cacd9e4 service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:13:31.639595 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28e5597-f5c2-457d-9bf2-d4d86cacd9e4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:13:31.647465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e5597-f5c2-457d-9bf2-d4d86cacd9e4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:13:31.649053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28e5597-f5c2-457d-9bf2-d4d86cacd9e4 service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:13:31.657794 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1378/2766] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:13:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:13:41.511440 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=31 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:13:41.654475 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=38 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:13:47.008523 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461675a-5500-43d2-a209-7b873f51cac5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:13:47.009574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461675a-5500-43d2-a209-7b873f51cac5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:13:47.009729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461675a-5500-43d2-a209-7b873f51cac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:13:47.028998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0461675a-5500-43d2-a209-7b873f51cac5 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:13:47.030229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0461675a-5500-43d2-a209-7b873f51cac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:13:47.037347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1389/2767] 10.222.0.42 () {58 vars in 967 bytes} [Mon Aug 1 12:13:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:13:47.049461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e5597-f5c2-457d-9bf2-d4d86cacd9e4 service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:13:47.060769 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28e5597-f5c2-457d-9bf2-d4d86cacd9e4 service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:13:47.065935 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2451272-aed1-42f3-8731-5f12828dfba6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:13:47.066586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2451272-aed1-42f3-8731-5f12828dfba6 service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:13:47.066868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2451272-aed1-42f3-8731-5f12828dfba6 service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:13:47.067142 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2451272-aed1-42f3-8731-5f12828dfba6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:13:47.076673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2451272-aed1-42f3-8731-5f12828dfba6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:13:47.078286 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2451272-aed1-42f3-8731-5f12828dfba6 service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:13:47.086892 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1379/2768] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:13:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:13:49.008287 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461675a-5500-43d2-a209-7b873f51cac5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:13:49.009772 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0461675a-5500-43d2-a209-7b873f51cac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:13:49.024712 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461675a-5500-43d2-a209-7b873f51cac5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:13:49.029229 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:13:49.029896 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:13:49.030173 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:13:49.030444 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] PATH_INFO: `/v3/users/d6c2f3d4fb12456f88eb5993d83c1bd2` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:13:49.031622 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6c2f3d4fb12456f88eb5993d83c1bd2)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:13:49.033585 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:13:49.079160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6c2f3d4fb12456f88eb5993d83c1bd2'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:13:49.087226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6c2f3d4fb12456f88eb5993d83c1bd2'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:13:49.099480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6c2f3d4fb12456f88eb5993d83c1bd2'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:13:49.100135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6c2f3d4fb12456f88eb5993d83c1bd2'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:13:49.107494 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6c2f3d4fb12456f88eb5993d83c1bd2'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:13:49.113375 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1390/2769] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:13:49 2022] DELETE /identity/v3/users/d6c2f3d4fb12456f88eb5993d83c1bd2 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:13:49.294484 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2451272-aed1-42f3-8731-5f12828dfba6 service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:13:49.307269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2451272-aed1-42f3-8731-5f12828dfba6 service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:13:49.367824 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:13:49.368498 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:13:49.368770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:13:49.369035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] PATH_INFO: `/v3/projects/508e123caf6245d1aa28ced60d8f36a3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:13:49.370200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] RBAC: Authorizing `identity:delete_project(project_id=508e123caf6245d1aa28ced60d8f36a3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:13:49.372097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:13:49.416545 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '508e123caf6245d1aa28ced60d8f36a3', 'request_id': 'req-3783cce4-13cc-479b-b1a2-2147636a500d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:13:49.421888 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '508e123caf6245d1aa28ced60d8f36a3', 'request_id': 'req-3783cce4-13cc-479b-b1a2-2147636a500d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:13:49.428859 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '508e123caf6245d1aa28ced60d8f36a3', 'request_id': 'req-3783cce4-13cc-479b-b1a2-2147636a500d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:13:49.439543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] The token cache is being invalidate because project 508e123caf6245d1aa28ced60d8f36a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:13:49.439823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:13:49.440440 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:13:49.441944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1380/2770] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:13:49 2022] DELETE /identity/v3/projects/508e123caf6245d1aa28ced60d8f36a3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:13:59.109890 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:13:59.436668 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:14:23.638542 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:14:23.640081 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:23.694885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9032be24-3461-41d2-b9de-cbcc8e95cd28 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:14:23.741776 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f99ee81-d4ae-46b4-8447-4925b6bbb5ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:14:23.742640 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99ee81-d4ae-46b4-8447-4925b6bbb5ee service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:14:23.743484 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99ee81-d4ae-46b4-8447-4925b6bbb5ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:14:23.743783 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f99ee81-d4ae-46b4-8447-4925b6bbb5ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:14:23.745558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1f99ee81-d4ae-46b4-8447-4925b6bbb5ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:23.754646 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99ee81-d4ae-46b4-8447-4925b6bbb5ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:14:23.756057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f99ee81-d4ae-46b4-8447-4925b6bbb5ee service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:14:23.763980 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1391/2771] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:14:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:14:33.760396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=46 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:14:34.924873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:14:34.926599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:35.034152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3783cce4-13cc-479b-b1a2-2147636a500d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:14:35.039754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73deb693-9aed-41c2-addc-9debdf857647 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:14:35.040987 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deb693-9aed-41c2-addc-9debdf857647 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:14:35.041359 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deb693-9aed-41c2-addc-9debdf857647 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:14:35.041707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73deb693-9aed-41c2-addc-9debdf857647 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:14:35.043653 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-73deb693-9aed-41c2-addc-9debdf857647 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:35.057810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73deb693-9aed-41c2-addc-9debdf857647 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:14:35.060164 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73deb693-9aed-41c2-addc-9debdf857647 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:14:35.073182 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1381/2772] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:14:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:14:42.220539 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89fd1-eb48-4c1c-b00f-a88ae962c912 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:14:42.220998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89fd1-eb48-4c1c-b00f-a88ae962c912 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:14:42.221111 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be89fd1-eb48-4c1c-b00f-a88ae962c912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:14:42.269030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9be89fd1-eb48-4c1c-b00f-a88ae962c912 None None] MFA Rules not processed for user `fc14241a25484946a0ecc59c9776ac62`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:14:42.270280 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9be89fd1-eb48-4c1c-b00f-a88ae962c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:42.334264 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1392/2773] 10.222.0.42 () {58 vars in 967 bytes} [Mon Aug 1 12:14:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:14:42.355405 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73deb693-9aed-41c2-addc-9debdf857647 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:14:42.356803 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-73deb693-9aed-41c2-addc-9debdf857647 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:42.445844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73deb693-9aed-41c2-addc-9debdf857647 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:14:42.450817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972ff9c-a4da-45d7-9a54-1c8f077d3ed6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e2dfb83ec65645459d41579b4b036ee5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:14:42.451423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972ff9c-a4da-45d7-9a54-1c8f077d3ed6 service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:14:42.451702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972ff9c-a4da-45d7-9a54-1c8f077d3ed6 service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:14:42.451973 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2972ff9c-a4da-45d7-9a54-1c8f077d3ed6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:14:42.459897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972ff9c-a4da-45d7-9a54-1c8f077d3ed6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:14:42.461540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2972ff9c-a4da-45d7-9a54-1c8f077d3ed6 service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:14:42.469989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1382/2774] 10.222.0.42 () {60 vars in 1384 bytes} [Mon Aug 1 12:14:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 12:14:49.103325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be89fd1-eb48-4c1c-b00f-a88ae962c912 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:14:49.104811 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9be89fd1-eb48-4c1c-b00f-a88ae962c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:49.196560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be89fd1-eb48-4c1c-b00f-a88ae962c912 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:14:49.201174 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:14:49.201851 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:14:49.202132 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:14:49.202404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] PATH_INFO: `/v3/users/988b2fd89b3a49b4abd748d14560be75` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:14:49.203645 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=988b2fd89b3a49b4abd748d14560be75)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:14:49.205531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:14:49.259399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '988b2fd89b3a49b4abd748d14560be75'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.268291 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '988b2fd89b3a49b4abd748d14560be75'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.283022 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '988b2fd89b3a49b4abd748d14560be75'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.284368 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '988b2fd89b3a49b4abd748d14560be75'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.295344 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:14:49.302639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '988b2fd89b3a49b4abd748d14560be75'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.310031 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1393/2775] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:14:49 2022] DELETE /identity/v3/users/988b2fd89b3a49b4abd748d14560be75 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:14:49.496676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972ff9c-a4da-45d7-9a54-1c8f077d3ed6 service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:14:49.507682 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2972ff9c-a4da-45d7-9a54-1c8f077d3ed6 service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:14:49.558304 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:14:49.565278 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:14:49.565939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:14:49.566220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:14:49.566495 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] PATH_INFO: `/v3/projects/159d61af2345483c9f59f57286f45664` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:14:49.567641 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] RBAC: Authorizing `identity:delete_project(project_id=159d61af2345483c9f59f57286f45664)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:14:49.569656 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:14:49.616208 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159d61af2345483c9f59f57286f45664', 'request_id': 'req-2036d606-853e-457d-b496-a91fe6009727'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.622762 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159d61af2345483c9f59f57286f45664', 'request_id': 'req-2036d606-853e-457d-b496-a91fe6009727'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.641528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159d61af2345483c9f59f57286f45664', 'request_id': 'req-2036d606-853e-457d-b496-a91fe6009727'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.653712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] The token cache is being invalidate because project 159d61af2345483c9f59f57286f45664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:14:49.654003 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.654715 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.656223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1383/2776] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:14:49 2022] DELETE /identity/v3/projects/159d61af2345483c9f59f57286f45664 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:14:49.660249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:14:49.661665 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:49.675951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2d3a3d-205c-4510-8ab2-1e4aa250ab45 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:14:49.732758 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da993d01-2f7d-4325-a817-00535d98b98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:14:49.733432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da993d01-2f7d-4325-a817-00535d98b98c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:14:49.733712 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da993d01-2f7d-4325-a817-00535d98b98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:14:49.733983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da993d01-2f7d-4325-a817-00535d98b98c admin admin] PATH_INFO: `/v3/users/ae86b6a6148247d3b25c7534fc4d1898` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:14:49.735261 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da993d01-2f7d-4325-a817-00535d98b98c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae86b6a6148247d3b25c7534fc4d1898)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:14:49.737328 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da993d01-2f7d-4325-a817-00535d98b98c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:14:49.788265 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-da993d01-2f7d-4325-a817-00535d98b98c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae86b6a6148247d3b25c7534fc4d1898'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.795913 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-da993d01-2f7d-4325-a817-00535d98b98c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae86b6a6148247d3b25c7534fc4d1898'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.809185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-da993d01-2f7d-4325-a817-00535d98b98c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae86b6a6148247d3b25c7534fc4d1898'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.809910 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-da993d01-2f7d-4325-a817-00535d98b98c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae86b6a6148247d3b25c7534fc4d1898'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.817073 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-da993d01-2f7d-4325-a817-00535d98b98c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae86b6a6148247d3b25c7534fc4d1898'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:49.823607 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1394/2777] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:14:49 2022] DELETE /identity/v3/users/ae86b6a6148247d3b25c7534fc4d1898 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:14:50.106403 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:14:50.108077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:50.129759 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2036d606-853e-457d-b496-a91fe6009727 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:14:50.193757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:14:50.194884 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:14:50.194884 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:14:50.195114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] PATH_INFO: `/v3/projects/d72a588e42af4dd6a93f644d8fdd8a0c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:14:50.196141 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d72a588e42af4dd6a93f644d8fdd8a0c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:14:50.198131 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:14:50.267389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd72a588e42af4dd6a93f644d8fdd8a0c', 'request_id': 'req-3580c579-0bf0-4b31-948e-afdcd12cbb7c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:50.275301 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd72a588e42af4dd6a93f644d8fdd8a0c', 'request_id': 'req-3580c579-0bf0-4b31-948e-afdcd12cbb7c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:50.283071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd72a588e42af4dd6a93f644d8fdd8a0c', 'request_id': 'req-3580c579-0bf0-4b31-948e-afdcd12cbb7c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:50.295436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] The token cache is being invalidate because project d72a588e42af4dd6a93f644d8fdd8a0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:14:50.295725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:50.296377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:14:50.297946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1384/2778] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:14:50 2022] DELETE /identity/v3/projects/d72a588e42af4dd6a93f644d8fdd8a0c => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:14:51.047702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858cf8-a111-406f-a02b-a5e9e28c3b3c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:14:51.048183 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858cf8-a111-406f-a02b-a5e9e28c3b3c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:14:51.048298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c858cf8-a111-406f-a02b-a5e9e28c3b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:14:51.066644 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7c858cf8-a111-406f-a02b-a5e9e28c3b3c None None] MFA Rules not processed for user `1e4ece91578b426da4f0d9166903f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:14:51.067829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7c858cf8-a111-406f-a02b-a5e9e28c3b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:51.123048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1395/2779] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:14:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:14:51.429219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:14:51.431166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:51.453517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:14:51.493879 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3580c579-0bf0-4b31-948e-afdcd12cbb7c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:14:51.497408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0bf20-3e29-4b1f-948d-67107bab2858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:14:51.498019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0bf20-3e29-4b1f-948d-67107bab2858 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:14:51.498296 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0bf20-3e29-4b1f-948d-67107bab2858 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:14:51.498565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b0bf20-3e29-4b1f-948d-67107bab2858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:14:51.500281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-88b0bf20-3e29-4b1f-948d-67107bab2858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:51.509543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0bf20-3e29-4b1f-948d-67107bab2858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:14:51.510972 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b0bf20-3e29-4b1f-948d-67107bab2858 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:14:51.518928 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1385/2780] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:14:51.842858 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c858cf8-a111-406f-a02b-a5e9e28c3b3c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:14:51.844815 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7c858cf8-a111-406f-a02b-a5e9e28c3b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:51.864079 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:14:51.928798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c858cf8-a111-406f-a02b-a5e9e28c3b3c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:14:51.934024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c76307-5a7b-4665-8a37-3898225f6c8b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:14:51.934589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76307-5a7b-4665-8a37-3898225f6c8b service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:14:51.934866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76307-5a7b-4665-8a37-3898225f6c8b service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:14:51.935148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c76307-5a7b-4665-8a37-3898225f6c8b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:14:51.937993 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-75c76307-5a7b-4665-8a37-3898225f6c8b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:51.951906 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c76307-5a7b-4665-8a37-3898225f6c8b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:14:51.953519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c76307-5a7b-4665-8a37-3898225f6c8b service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:14:51.963904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1396/2781] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:14:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:14:59.279900 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0bf20-3e29-4b1f-948d-67107bab2858 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:14:59.281376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-88b0bf20-3e29-4b1f-948d-67107bab2858 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:59.360890 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b0bf20-3e29-4b1f-948d-67107bab2858 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:14:59.366506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d894df2-418c-48d0-a1ee-156dd5b4d07b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:14:59.367401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d894df2-418c-48d0-a1ee-156dd5b4d07b service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:14:59.367683 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d894df2-418c-48d0-a1ee-156dd5b4d07b service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:14:59.367958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d894df2-418c-48d0-a1ee-156dd5b4d07b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:14:59.369747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3d894df2-418c-48d0-a1ee-156dd5b4d07b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:14:59.381567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d894df2-418c-48d0-a1ee-156dd5b4d07b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:14:59.383211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d894df2-418c-48d0-a1ee-156dd5b4d07b service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:14:59.393663 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1386/2782] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:14:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:15:01.959211 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=25 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:15:09.389255 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=53 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:16:28.560315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748404b3-1fff-4f05-ad7c-35e81d026365 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:16:28.560857 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748404b3-1fff-4f05-ad7c-35e81d026365 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:16:28.560972 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748404b3-1fff-4f05-ad7c-35e81d026365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:16:28.579904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-748404b3-1fff-4f05-ad7c-35e81d026365 None None] MFA Rules not processed for user `1e4ece91578b426da4f0d9166903f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:16:28.581122 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-748404b3-1fff-4f05-ad7c-35e81d026365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:16:28.588066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1397/2783] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:16:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:16:38.574582 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:17:30.957939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d894df2-418c-48d0-a1ee-156dd5b4d07b service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:17:30.969621 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d894df2-418c-48d0-a1ee-156dd5b4d07b service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:17:30.974471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eabad5-351e-439b-b97f-ab8a771c1e09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:17:30.975061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eabad5-351e-439b-b97f-ab8a771c1e09 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:17:30.975337 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eabad5-351e-439b-b97f-ab8a771c1e09 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:17:30.975604 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eabad5-351e-439b-b97f-ab8a771c1e09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:17:30.977339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-14eabad5-351e-439b-b97f-ab8a771c1e09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:17:30.990145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eabad5-351e-439b-b97f-ab8a771c1e09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:17:30.992061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eabad5-351e-439b-b97f-ab8a771c1e09 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:17:31.003800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1387/2784] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:17:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:17:40.999272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:18:01.101711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748404b3-1fff-4f05-ad7c-35e81d026365 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:18:01.103030 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-748404b3-1fff-4f05-ad7c-35e81d026365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:18:01.159678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748404b3-1fff-4f05-ad7c-35e81d026365 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:18:01.163182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436c61a-8641-4e9b-90bd-b2f3f915449f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:18:01.163780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436c61a-8641-4e9b-90bd-b2f3f915449f service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:18:01.164053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436c61a-8641-4e9b-90bd-b2f3f915449f service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:18:01.164319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436c61a-8641-4e9b-90bd-b2f3f915449f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:18:01.166075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4436c61a-8641-4e9b-90bd-b2f3f915449f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:18:01.176875 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436c61a-8641-4e9b-90bd-b2f3f915449f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:18:01.178301 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436c61a-8641-4e9b-90bd-b2f3f915449f service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:18:01.186837 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1398/2785] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:18:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:18:06.932179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eabad5-351e-439b-b97f-ab8a771c1e09 service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:18:06.946492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eabad5-351e-439b-b97f-ab8a771c1e09 service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:18:06.952793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6676376-8ba5-4067-99cb-ebbc6aa9092b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:18:06.953699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6676376-8ba5-4067-99cb-ebbc6aa9092b service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:18:06.954171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6676376-8ba5-4067-99cb-ebbc6aa9092b service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:18:06.954611 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6676376-8ba5-4067-99cb-ebbc6aa9092b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:18:06.957114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e6676376-8ba5-4067-99cb-ebbc6aa9092b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:18:06.972672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6676376-8ba5-4067-99cb-ebbc6aa9092b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:18:06.974435 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6676376-8ba5-4067-99cb-ebbc6aa9092b service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:18:06.986157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1388/2786] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:18:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:18:09.471048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095748dd-56b9-4866-bac8-0a50a26bb196 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:18:09.471559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095748dd-56b9-4866-bac8-0a50a26bb196 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:18:09.471687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095748dd-56b9-4866-bac8-0a50a26bb196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:18:09.491246 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-095748dd-56b9-4866-bac8-0a50a26bb196 None None] MFA Rules not processed for user `1e4ece91578b426da4f0d9166903f06a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:18:09.492433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-095748dd-56b9-4866-bac8-0a50a26bb196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:18:09.499147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1399/2787] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:18:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:18:09.800640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6676376-8ba5-4067-99cb-ebbc6aa9092b service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:18:09.802162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e6676376-8ba5-4067-99cb-ebbc6aa9092b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:18:09.813556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6676376-8ba5-4067-99cb-ebbc6aa9092b service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:18:09.817748 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63a03-52c6-45fc-aa3a-8b48e9e54b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:18:09.818450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63a03-52c6-45fc-aa3a-8b48e9e54b44 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:18:09.818736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63a03-52c6-45fc-aa3a-8b48e9e54b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:18:09.819010 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c63a03-52c6-45fc-aa3a-8b48e9e54b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:18:09.820866 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f9c63a03-52c6-45fc-aa3a-8b48e9e54b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:18:09.830535 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c63a03-52c6-45fc-aa3a-8b48e9e54b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:18:09.831953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c63a03-52c6-45fc-aa3a-8b48e9e54b44 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:18:09.840625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1389/2788] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:18:09 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:18:19.485639 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=29 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:18:19.837017 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=12 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:18:23.038394 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095748dd-56b9-4866-bac8-0a50a26bb196 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:18:23.048001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095748dd-56b9-4866-bac8-0a50a26bb196 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:18:23.052159 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d2d31-9d83-4dab-8599-dc848fee40b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:18:23.052780 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d2d31-9d83-4dab-8599-dc848fee40b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:18:23.053040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d2d31-9d83-4dab-8599-dc848fee40b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:18:23.053334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082d2d31-9d83-4dab-8599-dc848fee40b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:18:23.055216 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-082d2d31-9d83-4dab-8599-dc848fee40b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:18:23.069479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d2d31-9d83-4dab-8599-dc848fee40b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:18:23.070909 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082d2d31-9d83-4dab-8599-dc848fee40b4 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:18:23.081739 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1400/2789] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:18:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:18:23.247094 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63a03-52c6-45fc-aa3a-8b48e9e54b44 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:18:23.255660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c63a03-52c6-45fc-aa3a-8b48e9e54b44 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:18:23.259177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d4527-2139-4c7d-bcfe-930f22377db5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:18:23.259772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d4527-2139-4c7d-bcfe-930f22377db5 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:18:23.260049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d4527-2139-4c7d-bcfe-930f22377db5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:18:23.260321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d4527-2139-4c7d-bcfe-930f22377db5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:18:23.262205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-831d4527-2139-4c7d-bcfe-930f22377db5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:18:23.275154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d4527-2139-4c7d-bcfe-930f22377db5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:18:23.276572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831d4527-2139-4c7d-bcfe-930f22377db5 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:18:23.287842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1390/2790] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:18:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:18:33.076878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=6 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:18:33.282625 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:19:31.638231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d2d31-9d83-4dab-8599-dc848fee40b4 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:31.646823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082d2d31-9d83-4dab-8599-dc848fee40b4 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:31.650556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4247f8-1a8d-4df6-8d06-a6167f36ba47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:31.651159 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4247f8-1a8d-4df6-8d06-a6167f36ba47 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:31.651439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4247f8-1a8d-4df6-8d06-a6167f36ba47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:31.651708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4247f8-1a8d-4df6-8d06-a6167f36ba47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:31.653481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7a4247f8-1a8d-4df6-8d06-a6167f36ba47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:31.663319 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4247f8-1a8d-4df6-8d06-a6167f36ba47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:31.664741 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4247f8-1a8d-4df6-8d06-a6167f36ba47 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:31.672559 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1401/2791] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:19:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:19:41.669075 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=6 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:19:52.428299 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d4527-2139-4c7d-bcfe-930f22377db5 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:52.436952 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d4527-2139-4c7d-bcfe-930f22377db5 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:52.441188 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edec17-5655-42ab-be03-762577e067b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:52.441810 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edec17-5655-42ab-be03-762577e067b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:52.442085 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edec17-5655-42ab-be03-762577e067b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:52.442352 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1edec17-5655-42ab-be03-762577e067b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:52.444088 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f1edec17-5655-42ab-be03-762577e067b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:52.505688 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edec17-5655-42ab-be03-762577e067b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:52.507049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1edec17-5655-42ab-be03-762577e067b0 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:52.516471 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1391/2792] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:19:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:19:55.353187 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4247f8-1a8d-4df6-8d06-a6167f36ba47 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:55.358060 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7a4247f8-1a8d-4df6-8d06-a6167f36ba47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:55.374905 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4247f8-1a8d-4df6-8d06-a6167f36ba47 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:55.380824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177167df-f253-4392-88a0-dc6c52b1c76d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:55.381867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177167df-f253-4392-88a0-dc6c52b1c76d service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:55.381975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177167df-f253-4392-88a0-dc6c52b1c76d service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:55.382249 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177167df-f253-4392-88a0-dc6c52b1c76d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:55.384738 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-177167df-f253-4392-88a0-dc6c52b1c76d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:55.402880 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177167df-f253-4392-88a0-dc6c52b1c76d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:55.404829 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177167df-f253-4392-88a0-dc6c52b1c76d service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:55.411444 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edec17-5655-42ab-be03-762577e067b0 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:55.412507 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f1edec17-5655-42ab-be03-762577e067b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:55.425529 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1402/2793] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:19:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:19:55.429738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1edec17-5655-42ab-be03-762577e067b0 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:55.434530 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c92932-3174-414e-9b34-29db69e65384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:55.435179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c92932-3174-414e-9b34-29db69e65384 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:55.435461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c92932-3174-414e-9b34-29db69e65384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:55.435735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c92932-3174-414e-9b34-29db69e65384 admin admin] PATH_INFO: `/v3/users/1e4ece91578b426da4f0d9166903f06a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:55.437004 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c92932-3174-414e-9b34-29db69e65384 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e4ece91578b426da4f0d9166903f06a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:55.438920 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c92932-3174-414e-9b34-29db69e65384 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:55.498271 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f3c92932-3174-414e-9b34-29db69e65384 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e4ece91578b426da4f0d9166903f06a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:55.499173 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f3c92932-3174-414e-9b34-29db69e65384 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e4ece91578b426da4f0d9166903f06a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:55.512740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f3c92932-3174-414e-9b34-29db69e65384 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e4ece91578b426da4f0d9166903f06a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:55.520289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f3c92932-3174-414e-9b34-29db69e65384 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e4ece91578b426da4f0d9166903f06a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:55.529261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f3c92932-3174-414e-9b34-29db69e65384 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e4ece91578b426da4f0d9166903f06a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:55.540305 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1392/2794] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:19:55 2022] DELETE /identity/v3/users/1e4ece91578b426da4f0d9166903f06a => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:19:55.720984 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177167df-f253-4392-88a0-dc6c52b1c76d service placement] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:55.733236 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177167df-f253-4392-88a0-dc6c52b1c76d service placement] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:55.792512 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c305ee14-b103-4b84-b11a-23be2055b299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:55.793150 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305ee14-b103-4b84-b11a-23be2055b299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:55.793470 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305ee14-b103-4b84-b11a-23be2055b299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:55.793749 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c305ee14-b103-4b84-b11a-23be2055b299 admin admin] PATH_INFO: `/v3/projects/a80a4faad6524aaeb6bc81d5c46182e5` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:55.794934 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305ee14-b103-4b84-b11a-23be2055b299 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a80a4faad6524aaeb6bc81d5c46182e5)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:55.796905 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c305ee14-b103-4b84-b11a-23be2055b299 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:55.843552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c305ee14-b103-4b84-b11a-23be2055b299 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a80a4faad6524aaeb6bc81d5c46182e5', 'request_id': 'req-c305ee14-b103-4b84-b11a-23be2055b299'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:55.849057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c305ee14-b103-4b84-b11a-23be2055b299 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a80a4faad6524aaeb6bc81d5c46182e5', 'request_id': 'req-c305ee14-b103-4b84-b11a-23be2055b299'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:55.855015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c305ee14-b103-4b84-b11a-23be2055b299 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a80a4faad6524aaeb6bc81d5c46182e5', 'request_id': 'req-c305ee14-b103-4b84-b11a-23be2055b299'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:55.867762 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c305ee14-b103-4b84-b11a-23be2055b299 admin admin] The token cache is being invalidate because project a80a4faad6524aaeb6bc81d5c46182e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:19:55.868072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c305ee14-b103-4b84-b11a-23be2055b299 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:55.868697 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c305ee14-b103-4b84-b11a-23be2055b299 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:55.870205 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1403/2795] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:19:55 2022] DELETE /identity/v3/projects/a80a4faad6524aaeb6bc81d5c46182e5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:19:55.875049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43519cb3-7780-480a-9fb7-393552668bef None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:55.875334 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43519cb3-7780-480a-9fb7-393552668bef None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:55.876196 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43519cb3-7780-480a-9fb7-393552668bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:55.895300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-43519cb3-7780-480a-9fb7-393552668bef None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:19:55.896438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-43519cb3-7780-480a-9fb7-393552668bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:55.954431 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1393/2796] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:19:55.962248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba45a2-06ee-4eed-a3a9-c5a69b7d489f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:55.962534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba45a2-06ee-4eed-a3a9-c5a69b7d489f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:55.962802 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba45a2-06ee-4eed-a3a9-c5a69b7d489f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:55.981897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e7ba45a2-06ee-4eed-a3a9-c5a69b7d489f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:19:55.983093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e7ba45a2-06ee-4eed-a3a9-c5a69b7d489f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:55.991786 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1404/2797] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:19:55.995939 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43519cb3-7780-480a-9fb7-393552668bef None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:56.005956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43519cb3-7780-480a-9fb7-393552668bef None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:56.010493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06c0d5-6339-41e4-834f-a4780d572cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:56.011081 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06c0d5-6339-41e4-834f-a4780d572cef admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:56.011356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06c0d5-6339-41e4-834f-a4780d572cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:56.011623 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06c0d5-6339-41e4-834f-a4780d572cef admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:56.012296 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06c0d5-6339-41e4-834f-a4780d572cef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:19:56.012592 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06c0d5-6339-41e4-834f-a4780d572cef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:56.014198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06c0d5-6339-41e4-834f-a4780d572cef admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:56.015624 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:19:56.030211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1394/2798] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:19:56.034427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba45a2-06ee-4eed-a3a9-c5a69b7d489f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:56.043727 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba45a2-06ee-4eed-a3a9-c5a69b7d489f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:56.048931 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025c063-d25f-491e-9dbd-93c585a579ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:56.049574 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025c063-d25f-491e-9dbd-93c585a579ce admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:56.049852 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025c063-d25f-491e-9dbd-93c585a579ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:56.050117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1025c063-d25f-491e-9dbd-93c585a579ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:56.050778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025c063-d25f-491e-9dbd-93c585a579ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:56.052670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1025c063-d25f-491e-9dbd-93c585a579ce admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:56.089088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1405/2799] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:19:56 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:19:56.093289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06c0d5-6339-41e4-834f-a4780d572cef admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:56.103289 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06c0d5-6339-41e4-834f-a4780d572cef admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:56.158971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf290-0b08-4506-ae0f-ff454dc9930e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:56.159517 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf290-0b08-4506-ae0f-ff454dc9930e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:56.160019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf290-0b08-4506-ae0f-ff454dc9930e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:56.160159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcdf290-0b08-4506-ae0f-ff454dc9930e admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:56.160709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdf290-0b08-4506-ae0f-ff454dc9930e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:56.162677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcdf290-0b08-4506-ae0f-ff454dc9930e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:56.184152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1395/2800] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:19:56 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:19:56.188933 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025c063-d25f-491e-9dbd-93c585a579ce admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:56.199138 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1025c063-d25f-491e-9dbd-93c585a579ce admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:56.203714 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c0b7c-c613-4d9b-8b21-924e1243c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:56.204318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c0b7c-c613-4d9b-8b21-924e1243c882 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:56.204598 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c0b7c-c613-4d9b-8b21-924e1243c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:56.204869 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3c0b7c-c613-4d9b-8b21-924e1243c882 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:56.205581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c0b7c-c613-4d9b-8b21-924e1243c882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:56.207167 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3c0b7c-c613-4d9b-8b21-924e1243c882 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:56.217192 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1406/2801] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:19:56.221537 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf290-0b08-4506-ae0f-ff454dc9930e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:56.231305 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcdf290-0b08-4506-ae0f-ff454dc9930e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:56.236540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3c921-a668-4ec5-99e8-bd771acdc59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:56.237132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3c921-a668-4ec5-99e8-bd771acdc59a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:56.237450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3c921-a668-4ec5-99e8-bd771acdc59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:56.237725 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3c921-a668-4ec5-99e8-bd771acdc59a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:56.238411 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3c921-a668-4ec5-99e8-bd771acdc59a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:56.240260 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d3c921-a668-4ec5-99e8-bd771acdc59a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:56.250673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1396/2802] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:19:56.254547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c0b7c-c613-4d9b-8b21-924e1243c882 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:56.264442 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3c0b7c-c613-4d9b-8b21-924e1243c882 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:56.269105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57a100-769c-4ce8-8261-604868553506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:56.269787 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57a100-769c-4ce8-8261-604868553506 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:56.270070 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57a100-769c-4ce8-8261-604868553506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:56.270347 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57a100-769c-4ce8-8261-604868553506 admin admin] PATH_INFO: `/v3/projects/38940b03cb1943dda6e97140fa188a95/users/272c56f789774e3884976059aaec13af/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:56.285381 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57a100-769c-4ce8-8261-604868553506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38940b03cb1943dda6e97140fa188a95, user_id=272c56f789774e3884976059aaec13af, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:56.288045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57a100-769c-4ce8-8261-604868553506 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:56.302340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1407/2803] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:19:56 2022] PUT /identity/v3/projects/38940b03cb1943dda6e97140fa188a95/users/272c56f789774e3884976059aaec13af/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:19:56.312572 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee18611-9ffc-41d3-a1b3-c2f7c6ad5228 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:56.312889 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee18611-9ffc-41d3-a1b3-c2f7c6ad5228 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:56.313189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee18611-9ffc-41d3-a1b3-c2f7c6ad5228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:56.339953 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fee18611-9ffc-41d3-a1b3-c2f7c6ad5228 None None] MFA Rules not processed for user `272c56f789774e3884976059aaec13af`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:19:56.341180 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fee18611-9ffc-41d3-a1b3-c2f7c6ad5228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:56.407220 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1397/2804] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:19:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:19:56.418390 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57a100-769c-4ce8-8261-604868553506 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:56.419999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-de57a100-769c-4ce8-8261-604868553506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:56.427051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:19:56.495248 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57a100-769c-4ce8-8261-604868553506 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:56.500701 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818094bf-38eb-438b-af5b-8da38eafd478 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:56.501367 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818094bf-38eb-438b-af5b-8da38eafd478 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:56.501655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818094bf-38eb-438b-af5b-8da38eafd478 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:56.501927 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818094bf-38eb-438b-af5b-8da38eafd478 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:56.509641 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818094bf-38eb-438b-af5b-8da38eafd478 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:56.511226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818094bf-38eb-438b-af5b-8da38eafd478 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:56.519878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1408/2805] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:19:56 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:19:56.731636 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee18611-9ffc-41d3-a1b3-c2f7c6ad5228 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:56.794632 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee18611-9ffc-41d3-a1b3-c2f7c6ad5228 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:56.799169 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:56.799800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:56.800081 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:56.800355 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] PATH_INFO: `/v3/users/272c56f789774e3884976059aaec13af` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:56.801562 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=272c56f789774e3884976059aaec13af)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:56.803503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:56.805779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:19:56.849805 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '272c56f789774e3884976059aaec13af'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:56.850463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '272c56f789774e3884976059aaec13af'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:56.862442 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '272c56f789774e3884976059aaec13af'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:56.869506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '272c56f789774e3884976059aaec13af'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:56.877268 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '272c56f789774e3884976059aaec13af'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:56.883137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1398/2806] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:19:56 2022] DELETE /identity/v3/users/272c56f789774e3884976059aaec13af => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:19:56.887654 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35891be-67f5-4d91-a5c2-d4eef2a11ed7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:56.887944 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35891be-67f5-4d91-a5c2-d4eef2a11ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:56.888222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35891be-67f5-4d91-a5c2-d4eef2a11ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:56.907713 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d35891be-67f5-4d91-a5c2-d4eef2a11ed7 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:19:56.908914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d35891be-67f5-4d91-a5c2-d4eef2a11ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:56.965783 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1409/2807] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 12:19:56.976051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:56.977469 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:57.033279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ef3c32-303d-411b-9625-304e8e2faf0e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:57.036886 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad0d86-b6e1-4d1f-af3e-7dc210c838e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:57.037523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad0d86-b6e1-4d1f-af3e-7dc210c838e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:57.037800 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad0d86-b6e1-4d1f-af3e-7dc210c838e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:57.038070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad0d86-b6e1-4d1f-af3e-7dc210c838e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:57.046963 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad0d86-b6e1-4d1f-af3e-7dc210c838e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:57.048454 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad0d86-b6e1-4d1f-af3e-7dc210c838e4 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:57.057753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1399/2808] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:19:57.324267 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35891be-67f5-4d91-a5c2-d4eef2a11ed7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:57.325737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d35891be-67f5-4d91-a5c2-d4eef2a11ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:57.338424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35891be-67f5-4d91-a5c2-d4eef2a11ed7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:57.343053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25b253e-01a8-4455-b44e-c89d40132692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:57.343688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b253e-01a8-4455-b44e-c89d40132692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:57.343971 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b253e-01a8-4455-b44e-c89d40132692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:57.344259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25b253e-01a8-4455-b44e-c89d40132692 admin admin] PATH_INFO: `/v3/projects/38940b03cb1943dda6e97140fa188a95` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:57.345455 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b253e-01a8-4455-b44e-c89d40132692 admin admin] RBAC: Authorizing `identity:delete_project(project_id=38940b03cb1943dda6e97140fa188a95)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:57.347397 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25b253e-01a8-4455-b44e-c89d40132692 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:57.394086 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a25b253e-01a8-4455-b44e-c89d40132692 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38940b03cb1943dda6e97140fa188a95', 'request_id': 'req-a25b253e-01a8-4455-b44e-c89d40132692'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:57.399591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a25b253e-01a8-4455-b44e-c89d40132692 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38940b03cb1943dda6e97140fa188a95', 'request_id': 'req-a25b253e-01a8-4455-b44e-c89d40132692'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:57.405788 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a25b253e-01a8-4455-b44e-c89d40132692 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38940b03cb1943dda6e97140fa188a95', 'request_id': 'req-a25b253e-01a8-4455-b44e-c89d40132692'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:57.418828 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a25b253e-01a8-4455-b44e-c89d40132692 admin admin] The token cache is being invalidate because project 38940b03cb1943dda6e97140fa188a95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:19:57.419412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a25b253e-01a8-4455-b44e-c89d40132692 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:57.419716 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a25b253e-01a8-4455-b44e-c89d40132692 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:19:57.421214 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1410/2809] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:19:57 2022] DELETE /identity/v3/projects/38940b03cb1943dda6e97140fa188a95 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:19:57.426820 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34b72-07b9-4c14-a055-0ef257702640 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:57.427107 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34b72-07b9-4c14-a055-0ef257702640 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:57.427381 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34b72-07b9-4c14-a055-0ef257702640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:57.447035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f1e34b72-07b9-4c14-a055-0ef257702640 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:19:57.448234 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f1e34b72-07b9-4c14-a055-0ef257702640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:57.506210 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1400/2810] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:19:57.515186 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebdd21-88dd-4786-8984-3dc6077480d3 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:57.515500 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebdd21-88dd-4786-8984-3dc6077480d3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:57.515769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaebdd21-88dd-4786-8984-3dc6077480d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:57.534900 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-aaebdd21-88dd-4786-8984-3dc6077480d3 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:19:57.536080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-aaebdd21-88dd-4786-8984-3dc6077480d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:57.543753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1411/2811] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:19:57.548339 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e34b72-07b9-4c14-a055-0ef257702640 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:57.558127 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e34b72-07b9-4c14-a055-0ef257702640 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:57.562875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab0901-2428-4d9d-ac98-2ba2421aad77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:57.564057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0901-2428-4d9d-ac98-2ba2421aad77 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:57.564338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0901-2428-4d9d-ac98-2ba2421aad77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:57.564610 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab0901-2428-4d9d-ac98-2ba2421aad77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:57.565365 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab0901-2428-4d9d-ac98-2ba2421aad77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:19:57.565671 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab0901-2428-4d9d-ac98-2ba2421aad77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:57.567274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab0901-2428-4d9d-ac98-2ba2421aad77 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:57.578774 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1401/2812] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:19:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 12:19:57.582998 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebdd21-88dd-4786-8984-3dc6077480d3 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:57.592332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaebdd21-88dd-4786-8984-3dc6077480d3 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:57.597053 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd742a1d-35f2-4505-bfc0-bca2fa3cc3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:57.597679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd742a1d-35f2-4505-bfc0-bca2fa3cc3dc admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:57.597959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd742a1d-35f2-4505-bfc0-bca2fa3cc3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:57.598231 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd742a1d-35f2-4505-bfc0-bca2fa3cc3dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:57.598897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd742a1d-35f2-4505-bfc0-bca2fa3cc3dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:57.600854 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd742a1d-35f2-4505-bfc0-bca2fa3cc3dc admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:57.605307 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:19:57.630572 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1412/2813] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:19:57 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:19:57.634784 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab0901-2428-4d9d-ac98-2ba2421aad77 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:57.644580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab0901-2428-4d9d-ac98-2ba2421aad77 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:57.652328 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:19:57.702622 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede68a5-be42-4c28-803c-ce60284ed473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:57.703236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede68a5-be42-4c28-803c-ce60284ed473 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:57.703516 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede68a5-be42-4c28-803c-ce60284ed473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:57.703793 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bede68a5-be42-4c28-803c-ce60284ed473 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:57.704462 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede68a5-be42-4c28-803c-ce60284ed473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:57.706427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bede68a5-be42-4c28-803c-ce60284ed473 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:57.727523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1402/2814] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:19:57 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:19:57.731747 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd742a1d-35f2-4505-bfc0-bca2fa3cc3dc admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:57.742812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd742a1d-35f2-4505-bfc0-bca2fa3cc3dc admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:57.747351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94cae7-3f39-4706-a3b9-239115101bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:57.747949 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94cae7-3f39-4706-a3b9-239115101bf7 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:57.748223 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94cae7-3f39-4706-a3b9-239115101bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:57.748507 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94cae7-3f39-4706-a3b9-239115101bf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:57.749163 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94cae7-3f39-4706-a3b9-239115101bf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:57.750782 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94cae7-3f39-4706-a3b9-239115101bf7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:57.761076 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1413/2815] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:19:57.765012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede68a5-be42-4c28-803c-ce60284ed473 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:57.774717 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bede68a5-be42-4c28-803c-ce60284ed473 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:57.779159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def7f92-6ffa-4090-8199-54dc0be8830f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:57.779746 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def7f92-6ffa-4090-8199-54dc0be8830f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:57.780021 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def7f92-6ffa-4090-8199-54dc0be8830f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:57.780290 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def7f92-6ffa-4090-8199-54dc0be8830f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:57.780971 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def7f92-6ffa-4090-8199-54dc0be8830f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:57.783103 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8def7f92-6ffa-4090-8199-54dc0be8830f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:57.793414 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1403/2816] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:19:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:19:57.798088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94cae7-3f39-4706-a3b9-239115101bf7 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:57.807936 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94cae7-3f39-4706-a3b9-239115101bf7 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:57.812521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4f583-99c4-4e24-a5b4-e51e3d709e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:57.813172 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4f583-99c4-4e24-a5b4-e51e3d709e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:57.813480 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4f583-99c4-4e24-a5b4-e51e3d709e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:57.813762 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f4f583-99c4-4e24-a5b4-e51e3d709e64 admin admin] PATH_INFO: `/v3/projects/71117b45342147c9845b7a03b755ea6e/users/02344ed2737e4107b378ef6160878c57/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:57.827969 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4f583-99c4-4e24-a5b4-e51e3d709e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71117b45342147c9845b7a03b755ea6e, user_id=02344ed2737e4107b378ef6160878c57, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:57.830668 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f4f583-99c4-4e24-a5b4-e51e3d709e64 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:57.843272 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1414/2817] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:19:57 2022] PUT /identity/v3/projects/71117b45342147c9845b7a03b755ea6e/users/02344ed2737e4107b378ef6160878c57/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:19:57.853954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08401f-a749-4e44-b8ee-cc27c030b5f8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:57.854233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08401f-a749-4e44-b8ee-cc27c030b5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:57.854499 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c08401f-a749-4e44-b8ee-cc27c030b5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:57.882849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1c08401f-a749-4e44-b8ee-cc27c030b5f8 None None] MFA Rules not processed for user `02344ed2737e4107b378ef6160878c57`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:19:57.884120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1c08401f-a749-4e44-b8ee-cc27c030b5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:57.946193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1404/2818] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:19:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:19:57.950636 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4f583-99c4-4e24-a5b4-e51e3d709e64 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:58.011225 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f4f583-99c4-4e24-a5b4-e51e3d709e64 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:58.015778 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d73f-44c4-4abd-bb9d-f7058c51ebc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:58.016401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d73f-44c4-4abd-bb9d-f7058c51ebc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.016683 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d73f-44c4-4abd-bb9d-f7058c51ebc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.016959 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d73f-44c4-4abd-bb9d-f7058c51ebc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.017658 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485d73f-44c4-4abd-bb9d-f7058c51ebc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:58.019565 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485d73f-44c4-4abd-bb9d-f7058c51ebc8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:58.045905 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1415/2819] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:19:57 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:19:58.050712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08401f-a749-4e44-b8ee-cc27c030b5f8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:58.061327 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c08401f-a749-4e44-b8ee-cc27c030b5f8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:58.117647 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264ca83-8f3b-4a59-a0db-38bb69a57e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:58.118254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264ca83-8f3b-4a59-a0db-38bb69a57e17 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.118535 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264ca83-8f3b-4a59-a0db-38bb69a57e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.118801 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c264ca83-8f3b-4a59-a0db-38bb69a57e17 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.119465 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264ca83-8f3b-4a59-a0db-38bb69a57e17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:58.121384 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c264ca83-8f3b-4a59-a0db-38bb69a57e17 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:58.142923 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1405/2820] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:19:58 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:19:58.147016 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d73f-44c4-4abd-bb9d-f7058c51ebc8 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:58.157683 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d73f-44c4-4abd-bb9d-f7058c51ebc8 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:58.162904 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03566547-781c-4484-8d99-817778efa09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:58.163503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566547-781c-4484-8d99-817778efa09c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.163784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566547-781c-4484-8d99-817778efa09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.164205 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03566547-781c-4484-8d99-817778efa09c admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.164897 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03566547-781c-4484-8d99-817778efa09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:58.166521 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03566547-781c-4484-8d99-817778efa09c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:58.177976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1416/2821] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:19:58.181846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264ca83-8f3b-4a59-a0db-38bb69a57e17 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:58.191871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c264ca83-8f3b-4a59-a0db-38bb69a57e17 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:58.196430 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f00805b-a85c-48b7-ab34-145dd010dc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:58.197029 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00805b-a85c-48b7-ab34-145dd010dc7f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.197325 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00805b-a85c-48b7-ab34-145dd010dc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.197603 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f00805b-a85c-48b7-ab34-145dd010dc7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.198290 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00805b-a85c-48b7-ab34-145dd010dc7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:58.199872 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f00805b-a85c-48b7-ab34-145dd010dc7f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:58.201897 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:19:58.211338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1406/2822] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:19:58.215305 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03566547-781c-4484-8d99-817778efa09c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:58.225820 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03566547-781c-4484-8d99-817778efa09c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:58.230393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e59cd6-7e05-4f44-a35d-897443aaa698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:58.231042 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e59cd6-7e05-4f44-a35d-897443aaa698 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.231322 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e59cd6-7e05-4f44-a35d-897443aaa698 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.231594 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e59cd6-7e05-4f44-a35d-897443aaa698 admin admin] PATH_INFO: `/v3/projects/be0670fa463a46778a2d1de82db0ad24/users/9d5b2af69b454db3a9b1748cfcaa619a/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.246052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e59cd6-7e05-4f44-a35d-897443aaa698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be0670fa463a46778a2d1de82db0ad24, user_id=9d5b2af69b454db3a9b1748cfcaa619a, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:58.248688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e59cd6-7e05-4f44-a35d-897443aaa698 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:58.261354 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1417/2823] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:19:58 2022] PUT /identity/v3/projects/be0670fa463a46778a2d1de82db0ad24/users/9d5b2af69b454db3a9b1748cfcaa619a/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:19:58.271904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1a561-efb9-462d-8a26-95dc0a8dd801 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.272191 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1a561-efb9-462d-8a26-95dc0a8dd801 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.272467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e1a561-efb9-462d-8a26-95dc0a8dd801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.300450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-93e1a561-efb9-462d-8a26-95dc0a8dd801 None None] MFA Rules not processed for user `9d5b2af69b454db3a9b1748cfcaa619a`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:19:58.301684 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-93e1a561-efb9-462d-8a26-95dc0a8dd801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:58.363587 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1407/2824] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:19:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:19:58.368520 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e59cd6-7e05-4f44-a35d-897443aaa698 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:58.434436 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e59cd6-7e05-4f44-a35d-897443aaa698 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:58.439178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb9e87-b681-49a9-83c7-b837fb4f1f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:58.439785 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb9e87-b681-49a9-83c7-b837fb4f1f8b admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.440059 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb9e87-b681-49a9-83c7-b837fb4f1f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.440325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb9e87-b681-49a9-83c7-b837fb4f1f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.441010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb9e87-b681-49a9-83c7-b837fb4f1f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:58.443056 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb9e87-b681-49a9-83c7-b837fb4f1f8b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:58.447514 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:19:58.471450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1418/2825] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:19:58 2022] POST /identity/v3/projects => generated 387 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:19:58.475614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1a561-efb9-462d-8a26-95dc0a8dd801 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:58.486079 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e1a561-efb9-462d-8a26-95dc0a8dd801 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:58.544199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e9613-566f-4f99-8117-e83ce62c423e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:58.544814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e9613-566f-4f99-8117-e83ce62c423e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.545093 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e9613-566f-4f99-8117-e83ce62c423e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.545394 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861e9613-566f-4f99-8117-e83ce62c423e admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.546061 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e9613-566f-4f99-8117-e83ce62c423e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:58.547995 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861e9613-566f-4f99-8117-e83ce62c423e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:58.570059 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1408/2826] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:19:58 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:19:58.575754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb9e87-b681-49a9-83c7-b837fb4f1f8b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:58.586576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb9e87-b681-49a9-83c7-b837fb4f1f8b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:58.591147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ff32e-8e92-4f3e-bafe-bc06f9a52299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:58.591754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ff32e-8e92-4f3e-bafe-bc06f9a52299 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.592033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ff32e-8e92-4f3e-bafe-bc06f9a52299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.592301 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063ff32e-8e92-4f3e-bafe-bc06f9a52299 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.592992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ff32e-8e92-4f3e-bafe-bc06f9a52299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:58.594659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063ff32e-8e92-4f3e-bafe-bc06f9a52299 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:58.605290 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1419/2827] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:19:58.609373 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e9613-566f-4f99-8117-e83ce62c423e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:58.623881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861e9613-566f-4f99-8117-e83ce62c423e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:58.632623 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8a7bb-a04c-49a3-a593-87c2f85136e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:58.633274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8a7bb-a04c-49a3-a593-87c2f85136e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.633581 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8a7bb-a04c-49a3-a593-87c2f85136e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.633854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d8a7bb-a04c-49a3-a593-87c2f85136e4 admin admin] PATH_INFO: `/v3/projects/bdd42a3d491e43faac640e2615bcc9f9/users/ba669409d7d649a6a55f0209782ab2ab/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.649091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8a7bb-a04c-49a3-a593-87c2f85136e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd42a3d491e43faac640e2615bcc9f9, user_id=ba669409d7d649a6a55f0209782ab2ab, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:58.651779 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d8a7bb-a04c-49a3-a593-87c2f85136e4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:58.665245 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1409/2828] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:19:58 2022] PUT /identity/v3/projects/bdd42a3d491e43faac640e2615bcc9f9/users/ba669409d7d649a6a55f0209782ab2ab/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:19:58.669185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ff32e-8e92-4f3e-bafe-bc06f9a52299 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:58.679638 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063ff32e-8e92-4f3e-bafe-bc06f9a52299 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:58.735770 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb696d-3ca7-406c-bc16-7a538975c29c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:58.736379 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb696d-3ca7-406c-bc16-7a538975c29c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.736659 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb696d-3ca7-406c-bc16-7a538975c29c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.736929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb696d-3ca7-406c-bc16-7a538975c29c admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.737650 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb696d-3ca7-406c-bc16-7a538975c29c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:58.739242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cb696d-3ca7-406c-bc16-7a538975c29c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:58.749066 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1420/2829] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:19:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 12:19:58.753443 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8a7bb-a04c-49a3-a593-87c2f85136e4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:58.763515 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d8a7bb-a04c-49a3-a593-87c2f85136e4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:58.768170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e665c8-306e-4be2-be94-b27acbdedcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:58.768755 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e665c8-306e-4be2-be94-b27acbdedcc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.769016 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e665c8-306e-4be2-be94-b27acbdedcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.769285 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e665c8-306e-4be2-be94-b27acbdedcc3 admin admin] PATH_INFO: `/v3/projects/bdd42a3d491e43faac640e2615bcc9f9/users/ba669409d7d649a6a55f0209782ab2ab/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.771264 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e665c8-306e-4be2-be94-b27acbdedcc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdd42a3d491e43faac640e2615bcc9f9, user_id=ba669409d7d649a6a55f0209782ab2ab, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:58.773959 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e665c8-306e-4be2-be94-b27acbdedcc3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:58.784491 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1410/2830] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:19:58 2022] PUT /identity/v3/projects/bdd42a3d491e43faac640e2615bcc9f9/users/ba669409d7d649a6a55f0209782ab2ab/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:19:58.847008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e9e9-b2e0-4b2e-9aa1-486558d5527e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:58.847289 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e9e9-b2e0-4b2e-9aa1-486558d5527e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:58.847560 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5628e9e9-b2e0-4b2e-9aa1-486558d5527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:58.874466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-5628e9e9-b2e0-4b2e-9aa1-486558d5527e None None] MFA Rules not processed for user `ba669409d7d649a6a55f0209782ab2ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:19:58.875684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5628e9e9-b2e0-4b2e-9aa1-486558d5527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:58.942706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1421/2831] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:19:58 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:19:58.953254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e665c8-306e-4be2-be94-b27acbdedcc3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:58.956295 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a5e665c8-306e-4be2-be94-b27acbdedcc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:59.000673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:19:59.016801 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e665c8-306e-4be2-be94-b27acbdedcc3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:59.020588 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57004-6d04-44b4-8744-5b2518d8ebae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:59.021152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57004-6d04-44b4-8744-5b2518d8ebae service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:59.021461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57004-6d04-44b4-8744-5b2518d8ebae service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:59.021735 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f57004-6d04-44b4-8744-5b2518d8ebae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:59.033575 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f57004-6d04-44b4-8744-5b2518d8ebae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:59.035023 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f57004-6d04-44b4-8744-5b2518d8ebae service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:59.044723 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1411/2832] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:19:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:19:59.539789 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628e9e9-b2e0-4b2e-9aa1-486558d5527e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:19:59.541259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5628e9e9-b2e0-4b2e-9aa1-486558d5527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:19:59.553091 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5628e9e9-b2e0-4b2e-9aa1-486558d5527e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:19:59.556627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f67170-055c-4b80-b1a8-c5ddc2eeed97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:19:59.557230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f67170-055c-4b80-b1a8-c5ddc2eeed97 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:19:59.557538 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f67170-055c-4b80-b1a8-c5ddc2eeed97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:19:59.557812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f67170-055c-4b80-b1a8-c5ddc2eeed97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:19:59.610126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:19:59.614632 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f67170-055c-4b80-b1a8-c5ddc2eeed97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:19:59.616135 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f67170-055c-4b80-b1a8-c5ddc2eeed97 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:19:59.625956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1422/2833] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:19:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:20:03.621675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57004-6d04-44b4-8744-5b2518d8ebae service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:03.630262 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f57004-6d04-44b4-8744-5b2518d8ebae service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:03.633811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0873d7d5-cb7e-451c-a6ba-a2f13eca7902 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:03.634403 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873d7d5-cb7e-451c-a6ba-a2f13eca7902 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:03.634676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873d7d5-cb7e-451c-a6ba-a2f13eca7902 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:03.634943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0873d7d5-cb7e-451c-a6ba-a2f13eca7902 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:03.690751 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873d7d5-cb7e-451c-a6ba-a2f13eca7902 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:03.692194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0873d7d5-cb7e-451c-a6ba-a2f13eca7902 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:03.700949 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1412/2834] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:20:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:20:05.791445 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f67170-055c-4b80-b1a8-c5ddc2eeed97 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:05.852723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f67170-055c-4b80-b1a8-c5ddc2eeed97 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:05.857315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:05.857951 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:05.858234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:05.858510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] PATH_INFO: `/v3/users/02344ed2737e4107b378ef6160878c57` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:05.860159 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02344ed2737e4107b378ef6160878c57)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:05.862113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:05.907008 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02344ed2737e4107b378ef6160878c57'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:05.914190 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02344ed2737e4107b378ef6160878c57'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:05.926569 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02344ed2737e4107b378ef6160878c57'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:05.927299 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02344ed2737e4107b378ef6160878c57'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:05.933993 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02344ed2737e4107b378ef6160878c57'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:05.940337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1423/2835] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:20:05 2022] DELETE /identity/v3/users/02344ed2737e4107b378ef6160878c57 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:05.944777 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc2215-e23e-4374-b1ef-2308dba4cefd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:05.945251 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc2215-e23e-4374-b1ef-2308dba4cefd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:05.945372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fc2215-e23e-4374-b1ef-2308dba4cefd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:05.963839 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b5fc2215-e23e-4374-b1ef-2308dba4cefd None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:05.965269 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b5fc2215-e23e-4374-b1ef-2308dba4cefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:06.023053 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1413/2836] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:06.033206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:06.034619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:06.094497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b122705-c885-478f-9b39-7dd8b013dac6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:06.098078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207517d2-e964-443d-8566-a0a21eea2942 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:06.098687 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207517d2-e964-443d-8566-a0a21eea2942 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:06.098964 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207517d2-e964-443d-8566-a0a21eea2942 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:06.099232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207517d2-e964-443d-8566-a0a21eea2942 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:06.108087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207517d2-e964-443d-8566-a0a21eea2942 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:06.110401 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207517d2-e964-443d-8566-a0a21eea2942 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:06.121161 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1424/2837] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:20:06.389031 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc2215-e23e-4374-b1ef-2308dba4cefd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:06.390503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b5fc2215-e23e-4374-b1ef-2308dba4cefd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:06.404756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fc2215-e23e-4374-b1ef-2308dba4cefd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:06.410171 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:06.410818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:06.411096 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:06.411368 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] PATH_INFO: `/v3/projects/71117b45342147c9845b7a03b755ea6e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:06.412548 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71117b45342147c9845b7a03b755ea6e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:06.414554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:06.462274 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71117b45342147c9845b7a03b755ea6e', 'request_id': 'req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:06.467832 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71117b45342147c9845b7a03b755ea6e', 'request_id': 'req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:06.475847 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71117b45342147c9845b7a03b755ea6e', 'request_id': 'req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:06.487117 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] The token cache is being invalidate because project 71117b45342147c9845b7a03b755ea6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:20:06.487423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:06.488058 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:06.489849 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1414/2838] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:20:06 2022] DELETE /identity/v3/projects/71117b45342147c9845b7a03b755ea6e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:06.493894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207517d2-e964-443d-8566-a0a21eea2942 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:06.503325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207517d2-e964-443d-8566-a0a21eea2942 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:06.514503 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:06.560973 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:06.561578 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:06.561859 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:06.562134 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] PATH_INFO: `/v3/users/9d5b2af69b454db3a9b1748cfcaa619a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:06.563302 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d5b2af69b454db3a9b1748cfcaa619a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:06.565234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:06.609941 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d5b2af69b454db3a9b1748cfcaa619a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:06.618256 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d5b2af69b454db3a9b1748cfcaa619a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:06.630486 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d5b2af69b454db3a9b1748cfcaa619a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:06.631124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d5b2af69b454db3a9b1748cfcaa619a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:06.637891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d5b2af69b454db3a9b1748cfcaa619a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:06.649753 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1425/2839] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:20:06 2022] DELETE /identity/v3/users/9d5b2af69b454db3a9b1748cfcaa619a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:06.925312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:06.926753 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:06.937048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:06.942778 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bccb44-c5a0-4dc0-b2fa-ef19a2e33852 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:07.002193 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:07.002877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:07.003099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:07.003369 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] PATH_INFO: `/v3/projects/be0670fa463a46778a2d1de82db0ad24` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:07.004546 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=be0670fa463a46778a2d1de82db0ad24)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:07.006567 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:07.052123 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be0670fa463a46778a2d1de82db0ad24', 'request_id': 'req-2969c149-66e4-4178-8255-0155ebd38b8e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.057586 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be0670fa463a46778a2d1de82db0ad24', 'request_id': 'req-2969c149-66e4-4178-8255-0155ebd38b8e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.065191 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be0670fa463a46778a2d1de82db0ad24', 'request_id': 'req-2969c149-66e4-4178-8255-0155ebd38b8e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.076040 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] The token cache is being invalidate because project be0670fa463a46778a2d1de82db0ad24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:20:07.076323 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.076946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.079070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1415/2840] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:20:06 2022] DELETE /identity/v3/projects/be0670fa463a46778a2d1de82db0ad24 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:07.083080 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:07.084536 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:07.097072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5703e39-e16b-40b1-9ac1-f25ff8c6f0eb admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:07.153755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4f4091-329a-4cdf-ab91-6550c78769d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:07.154443 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f4091-329a-4cdf-ab91-6550c78769d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:07.154728 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f4091-329a-4cdf-ab91-6550c78769d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:07.155001 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4f4091-329a-4cdf-ab91-6550c78769d9 admin admin] PATH_INFO: `/v3/users/ba669409d7d649a6a55f0209782ab2ab` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:07.156184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f4091-329a-4cdf-ab91-6550c78769d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba669409d7d649a6a55f0209782ab2ab)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:07.158126 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4f4091-329a-4cdf-ab91-6550c78769d9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:07.196259 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:07.207043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ec4f4091-329a-4cdf-ab91-6550c78769d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba669409d7d649a6a55f0209782ab2ab'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.213828 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ec4f4091-329a-4cdf-ab91-6550c78769d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba669409d7d649a6a55f0209782ab2ab'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.225499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ec4f4091-329a-4cdf-ab91-6550c78769d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba669409d7d649a6a55f0209782ab2ab'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.226117 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ec4f4091-329a-4cdf-ab91-6550c78769d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba669409d7d649a6a55f0209782ab2ab'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.232755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ec4f4091-329a-4cdf-ab91-6550c78769d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba669409d7d649a6a55f0209782ab2ab'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.238983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1426/2841] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:20:07 2022] DELETE /identity/v3/users/ba669409d7d649a6a55f0209782ab2ab => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:07.521194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:07.522739 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:07.535946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969c149-66e4-4178-8255-0155ebd38b8e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:07.592119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:07.592694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:07.592977 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:07.593252 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a admin admin] PATH_INFO: `/v3/projects/bdd42a3d491e43faac640e2615bcc9f9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:07.594943 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdd42a3d491e43faac640e2615bcc9f9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:07.596874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:07.634284 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:07.644534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdd42a3d491e43faac640e2615bcc9f9', 'request_id': 'req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.650090 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdd42a3d491e43faac640e2615bcc9f9', 'request_id': 'req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.658659 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdd42a3d491e43faac640e2615bcc9f9', 'request_id': 'req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.669744 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a admin admin] The token cache is being invalidate because project bdd42a3d491e43faac640e2615bcc9f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:20:07.670034 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.670699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-49a1ed1a-e1b6-4a93-ac95-a6a387a6ab5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:07.672757 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1416/2842] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:20:07 2022] DELETE /identity/v3/projects/bdd42a3d491e43faac640e2615bcc9f9 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:07.679194 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b34d56-20f3-4db0-b84d-a23461deef07 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:07.679479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b34d56-20f3-4db0-b84d-a23461deef07 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:07.679745 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b34d56-20f3-4db0-b84d-a23461deef07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:07.698686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-57b34d56-20f3-4db0-b84d-a23461deef07 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:07.699867 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-57b34d56-20f3-4db0-b84d-a23461deef07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:07.760199 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1427/2843] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:07.768521 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15481fe4-0c65-44b1-96ed-a3f2e2ebf946 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:07.768804 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15481fe4-0c65-44b1-96ed-a3f2e2ebf946 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:07.769077 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15481fe4-0c65-44b1-96ed-a3f2e2ebf946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:07.790177 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-15481fe4-0c65-44b1-96ed-a3f2e2ebf946 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:07.791362 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-15481fe4-0c65-44b1-96ed-a3f2e2ebf946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:07.799938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1417/2844] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:07.804155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b34d56-20f3-4db0-b84d-a23461deef07 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:07.814449 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b34d56-20f3-4db0-b84d-a23461deef07 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:07.821620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4787cae-ddba-43a9-9117-426c49b5ce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:07.822222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787cae-ddba-43a9-9117-426c49b5ce2f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:07.822510 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787cae-ddba-43a9-9117-426c49b5ce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:07.822769 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4787cae-ddba-43a9-9117-426c49b5ce2f admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:07.823450 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4787cae-ddba-43a9-9117-426c49b5ce2f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:20:07.823750 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4787cae-ddba-43a9-9117-426c49b5ce2f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:07.825372 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4787cae-ddba-43a9-9117-426c49b5ce2f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:07.837525 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1428/2845] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:20:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:20:07.841547 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15481fe4-0c65-44b1-96ed-a3f2e2ebf946 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:07.851326 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15481fe4-0c65-44b1-96ed-a3f2e2ebf946 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:07.855857 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a28177-f46a-4472-988e-3d3a960512ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:07.856453 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a28177-f46a-4472-988e-3d3a960512ea admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:07.856732 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a28177-f46a-4472-988e-3d3a960512ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:07.856998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a28177-f46a-4472-988e-3d3a960512ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:07.857697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a28177-f46a-4472-988e-3d3a960512ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:07.859646 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a28177-f46a-4472-988e-3d3a960512ea admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:07.886200 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1418/2846] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:20:07 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:20:07.890282 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4787cae-ddba-43a9-9117-426c49b5ce2f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:07.900567 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4787cae-ddba-43a9-9117-426c49b5ce2f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:07.955465 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ca2ed-82a4-4bb0-a23d-214923ce119e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:07.956072 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ca2ed-82a4-4bb0-a23d-214923ce119e admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:07.956350 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ca2ed-82a4-4bb0-a23d-214923ce119e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:07.956621 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07ca2ed-82a4-4bb0-a23d-214923ce119e admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:07.957271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ca2ed-82a4-4bb0-a23d-214923ce119e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:07.959213 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07ca2ed-82a4-4bb0-a23d-214923ce119e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:07.980546 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1429/2847] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:20:07 2022] POST /identity/v3/users => generated 305 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:20:07.984599 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a28177-f46a-4472-988e-3d3a960512ea admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:07.995101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a28177-f46a-4472-988e-3d3a960512ea admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:07.999672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df16df-337d-4432-804d-018bcd2db61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:08.000265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df16df-337d-4432-804d-018bcd2db61b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:08.000540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df16df-337d-4432-804d-018bcd2db61b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:08.000811 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24df16df-337d-4432-804d-018bcd2db61b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:08.001525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df16df-337d-4432-804d-018bcd2db61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:08.003106 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24df16df-337d-4432-804d-018bcd2db61b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:08.136287 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1419/2848] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:08.140364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ca2ed-82a4-4bb0-a23d-214923ce119e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:08.150956 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07ca2ed-82a4-4bb0-a23d-214923ce119e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:08.155592 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a58fe91-bc68-4883-a11f-98385ffe2ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:08.156193 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58fe91-bc68-4883-a11f-98385ffe2ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:08.157061 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58fe91-bc68-4883-a11f-98385ffe2ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:08.157363 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a58fe91-bc68-4883-a11f-98385ffe2ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:08.158058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58fe91-bc68-4883-a11f-98385ffe2ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:08.159642 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a58fe91-bc68-4883-a11f-98385ffe2ebf admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:08.170887 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1430/2849] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:08.174956 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df16df-337d-4432-804d-018bcd2db61b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:08.184707 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24df16df-337d-4432-804d-018bcd2db61b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:08.189461 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988eae7-4480-400f-9d1d-b1eab1a7d992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:08.190101 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988eae7-4480-400f-9d1d-b1eab1a7d992 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:08.190375 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988eae7-4480-400f-9d1d-b1eab1a7d992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:08.190646 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988eae7-4480-400f-9d1d-b1eab1a7d992 admin admin] PATH_INFO: `/v3/projects/f6389d925e9b4e10896810d9fa9a870c/users/ae630e32a3114d549819fde03c666635/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:08.205356 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988eae7-4480-400f-9d1d-b1eab1a7d992 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6389d925e9b4e10896810d9fa9a870c, user_id=ae630e32a3114d549819fde03c666635, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:08.208054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a988eae7-4480-400f-9d1d-b1eab1a7d992 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:08.221066 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1420/2850] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:20:08 2022] PUT /identity/v3/projects/f6389d925e9b4e10896810d9fa9a870c/users/ae630e32a3114d549819fde03c666635/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:08.233495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1720a-291f-4ca0-bf63-2845b4840442 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:08.233784 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1720a-291f-4ca0-bf63-2845b4840442 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:08.234057 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c1720a-291f-4ca0-bf63-2845b4840442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:08.261422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-79c1720a-291f-4ca0-bf63-2845b4840442 None None] MFA Rules not processed for user `ae630e32a3114d549819fde03c666635`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:08.262620 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-79c1720a-291f-4ca0-bf63-2845b4840442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:08.271346 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:08.330253 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1431/2851] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:08.334768 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988eae7-4480-400f-9d1d-b1eab1a7d992 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:08.394338 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988eae7-4480-400f-9d1d-b1eab1a7d992 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:08.398870 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cbc7d-6690-4996-97f4-58b7b00a04e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:08.399479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cbc7d-6690-4996-97f4-58b7b00a04e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:08.399751 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cbc7d-6690-4996-97f4-58b7b00a04e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:08.400017 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5cbc7d-6690-4996-97f4-58b7b00a04e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:08.400676 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cbc7d-6690-4996-97f4-58b7b00a04e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:08.402908 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5cbc7d-6690-4996-97f4-58b7b00a04e6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:08.429267 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1421/2852] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:20:08 2022] POST /identity/v3/projects => generated 407 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:20:08.433285 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1720a-291f-4ca0-bf63-2845b4840442 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:08.444466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c1720a-291f-4ca0-bf63-2845b4840442 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:08.499155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414cba7-6477-4f1c-979b-fccba6ee53da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:08.499770 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414cba7-6477-4f1c-979b-fccba6ee53da admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:08.500558 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414cba7-6477-4f1c-979b-fccba6ee53da admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:08.500833 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414cba7-6477-4f1c-979b-fccba6ee53da admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:08.501581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414cba7-6477-4f1c-979b-fccba6ee53da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:08.503516 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414cba7-6477-4f1c-979b-fccba6ee53da admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:08.524845 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1432/2853] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:20:08 2022] POST /identity/v3/users => generated 310 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:20:08.528933 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cbc7d-6690-4996-97f4-58b7b00a04e6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:08.539145 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5cbc7d-6690-4996-97f4-58b7b00a04e6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:08.543702 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7057ede-4b29-4513-bcae-a11ebaeee7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:08.544279 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7057ede-4b29-4513-bcae-a11ebaeee7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:08.544556 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7057ede-4b29-4513-bcae-a11ebaeee7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:08.544825 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7057ede-4b29-4513-bcae-a11ebaeee7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:08.545612 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7057ede-4b29-4513-bcae-a11ebaeee7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:08.547207 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7057ede-4b29-4513-bcae-a11ebaeee7b5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:08.556814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1422/2854] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:08.560636 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414cba7-6477-4f1c-979b-fccba6ee53da admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:08.571602 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414cba7-6477-4f1c-979b-fccba6ee53da admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:08.576508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264418c-cf73-429e-a2e6-d69ff83ada01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:08.577160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264418c-cf73-429e-a2e6-d69ff83ada01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:08.577481 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264418c-cf73-429e-a2e6-d69ff83ada01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:08.577757 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6264418c-cf73-429e-a2e6-d69ff83ada01 admin admin] PATH_INFO: `/v3/projects/ee8d52aef12e4f01812e759fcc2efefb/users/77cc2c1f12ac466c960b274842465036/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:08.592848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264418c-cf73-429e-a2e6-d69ff83ada01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8d52aef12e4f01812e759fcc2efefb, user_id=77cc2c1f12ac466c960b274842465036, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:08.595575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6264418c-cf73-429e-a2e6-d69ff83ada01 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:08.608112 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1433/2855] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:20:08 2022] PUT /identity/v3/projects/ee8d52aef12e4f01812e759fcc2efefb/users/77cc2c1f12ac466c960b274842465036/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:08.612662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7057ede-4b29-4513-bcae-a11ebaeee7b5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:08.623132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7057ede-4b29-4513-bcae-a11ebaeee7b5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:08.657829 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:08.685037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c1f8b-01a5-448d-9eb0-ebb1fa23cf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:08.685686 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1f8b-01a5-448d-9eb0-ebb1fa23cf3f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:08.685964 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1f8b-01a5-448d-9eb0-ebb1fa23cf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:08.686233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c1f8b-01a5-448d-9eb0-ebb1fa23cf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:08.686916 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1f8b-01a5-448d-9eb0-ebb1fa23cf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:08.689172 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c1f8b-01a5-448d-9eb0-ebb1fa23cf3f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:08.698841 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1423/2856] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:08.703052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264418c-cf73-429e-a2e6-d69ff83ada01 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:08.713278 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6264418c-cf73-429e-a2e6-d69ff83ada01 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:08.717886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b70ca2-08fa-4b54-9dd5-b9fb8eb4717a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:08.718543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70ca2-08fa-4b54-9dd5-b9fb8eb4717a admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:08.718826 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70ca2-08fa-4b54-9dd5-b9fb8eb4717a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:08.719101 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b70ca2-08fa-4b54-9dd5-b9fb8eb4717a admin admin] PATH_INFO: `/v3/projects/ee8d52aef12e4f01812e759fcc2efefb/users/77cc2c1f12ac466c960b274842465036/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:08.721013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b70ca2-08fa-4b54-9dd5-b9fb8eb4717a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee8d52aef12e4f01812e759fcc2efefb, user_id=77cc2c1f12ac466c960b274842465036, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:08.723672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b70ca2-08fa-4b54-9dd5-b9fb8eb4717a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:08.733707 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1434/2857] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:20:08 2022] PUT /identity/v3/projects/ee8d52aef12e4f01812e759fcc2efefb/users/77cc2c1f12ac466c960b274842465036/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:08.744281 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd604d19-3d9f-4225-917b-0272783fc982 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:08.744570 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd604d19-3d9f-4225-917b-0272783fc982 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:08.744842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd604d19-3d9f-4225-917b-0272783fc982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:08.776881 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fd604d19-3d9f-4225-917b-0272783fc982 None None] MFA Rules not processed for user `77cc2c1f12ac466c960b274842465036`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:08.778449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fd604d19-3d9f-4225-917b-0272783fc982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:08.844138 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1424/2858] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:08 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:08.854855 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b70ca2-08fa-4b54-9dd5-b9fb8eb4717a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:08.856515 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b0b70ca2-08fa-4b54-9dd5-b9fb8eb4717a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:08.914790 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b70ca2-08fa-4b54-9dd5-b9fb8eb4717a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:08.918422 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e0ca6-a709-4d5b-815e-a777fbc78237 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:08.919024 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e0ca6-a709-4d5b-815e-a777fbc78237 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:08.919304 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e0ca6-a709-4d5b-815e-a777fbc78237 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:08.919576 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e0ca6-a709-4d5b-815e-a777fbc78237 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:08.928970 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e0ca6-a709-4d5b-815e-a777fbc78237 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:08.930448 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e0ca6-a709-4d5b-815e-a777fbc78237 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:08.940417 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1435/2859] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:20:08 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:20:09.088854 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd604d19-3d9f-4225-917b-0272783fc982 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:09.098869 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd604d19-3d9f-4225-917b-0272783fc982 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:09.102419 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c72677-e061-4274-860c-82952c023f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:09.103023 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c72677-e061-4274-860c-82952c023f96 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:09.103300 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c72677-e061-4274-860c-82952c023f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:09.103571 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c72677-e061-4274-860c-82952c023f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:09.160736 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c72677-e061-4274-860c-82952c023f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:09.162212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c72677-e061-4274-860c-82952c023f96 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:09.170942 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1425/2860] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:20:09 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:20:14.403902 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e0ca6-a709-4d5b-815e-a777fbc78237 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:14.409348 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:14.474171 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e0ca6-a709-4d5b-815e-a777fbc78237 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:14.478760 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:14.479393 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:14.479673 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:14.479943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] PATH_INFO: `/v3/users/ae630e32a3114d549819fde03c666635` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:14.481242 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae630e32a3114d549819fde03c666635)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:14.484554 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:14.538090 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae630e32a3114d549819fde03c666635'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:14.546579 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae630e32a3114d549819fde03c666635'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:14.558866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae630e32a3114d549819fde03c666635'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:14.559492 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae630e32a3114d549819fde03c666635'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:14.566801 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae630e32a3114d549819fde03c666635'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:14.572589 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1436/2861] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:20:14 2022] DELETE /identity/v3/users/ae630e32a3114d549819fde03c666635 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:14.577100 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a8461-f737-417c-a99d-28989b17be76 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:14.577637 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a8461-f737-417c-a99d-28989b17be76 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:14.577742 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2a8461-f737-417c-a99d-28989b17be76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:14.596283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6c2a8461-f737-417c-a99d-28989b17be76 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:14.597523 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6c2a8461-f737-417c-a99d-28989b17be76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:14.644251 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:14.655396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1426/2862] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:14.668513 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:14.669967 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:14.727146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0693509-d079-4c01-a850-1edb9ec857f8 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:14.730873 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361438a-426b-43d2-89b3-efe31e9fb42d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:14.731485 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361438a-426b-43d2-89b3-efe31e9fb42d service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:14.731761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361438a-426b-43d2-89b3-efe31e9fb42d service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:14.732029 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d361438a-426b-43d2-89b3-efe31e9fb42d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:14.741779 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361438a-426b-43d2-89b3-efe31e9fb42d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:14.743215 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d361438a-426b-43d2-89b3-efe31e9fb42d service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:14.753104 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1437/2863] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:20:15.023677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a8461-f737-417c-a99d-28989b17be76 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:15.025189 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6c2a8461-f737-417c-a99d-28989b17be76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:15.037981 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2a8461-f737-417c-a99d-28989b17be76 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:15.042626 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:15.043294 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:15.043574 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:15.043842 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] PATH_INFO: `/v3/projects/f6389d925e9b4e10896810d9fa9a870c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:15.045002 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6389d925e9b4e10896810d9fa9a870c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:15.046998 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:15.094698 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6389d925e9b4e10896810d9fa9a870c', 'request_id': 'req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.100770 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6389d925e9b4e10896810d9fa9a870c', 'request_id': 'req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.108071 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6389d925e9b4e10896810d9fa9a870c', 'request_id': 'req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.120591 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] The token cache is being invalidate because project f6389d925e9b4e10896810d9fa9a870c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:20:15.120831 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.121534 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.123186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1427/2864] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:20:15 2022] DELETE /identity/v3/projects/f6389d925e9b4e10896810d9fa9a870c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:15.127677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361438a-426b-43d2-89b3-efe31e9fb42d service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:15.137489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d361438a-426b-43d2-89b3-efe31e9fb42d service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:15.171034 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:15.207058 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dff76ac-0764-4cc0-a4e4-8dc0bb32dcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:15.207708 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff76ac-0764-4cc0-a4e4-8dc0bb32dcaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:15.207983 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff76ac-0764-4cc0-a4e4-8dc0bb32dcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:15.208252 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dff76ac-0764-4cc0-a4e4-8dc0bb32dcaf admin admin] PATH_INFO: `/v3/users/77cc2c1f12ac466c960b274842465036` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:15.209457 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff76ac-0764-4cc0-a4e4-8dc0bb32dcaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=77cc2c1f12ac466c960b274842465036)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:15.211359 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dff76ac-0764-4cc0-a4e4-8dc0bb32dcaf admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:15.255230 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4dff76ac-0764-4cc0-a4e4-8dc0bb32dcaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '77cc2c1f12ac466c960b274842465036'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.262361 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4dff76ac-0764-4cc0-a4e4-8dc0bb32dcaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '77cc2c1f12ac466c960b274842465036'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.273903 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4dff76ac-0764-4cc0-a4e4-8dc0bb32dcaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '77cc2c1f12ac466c960b274842465036'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.274529 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4dff76ac-0764-4cc0-a4e4-8dc0bb32dcaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '77cc2c1f12ac466c960b274842465036'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.281425 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4dff76ac-0764-4cc0-a4e4-8dc0bb32dcaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '77cc2c1f12ac466c960b274842465036'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.287761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1438/2865] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:20:15 2022] DELETE /identity/v3/users/77cc2c1f12ac466c960b274842465036 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:15.563966 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:15.565479 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:15.580712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950fc5b-6c65-4bb6-9f06-3af52daa4df4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:15.637478 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410048f-0efb-49c0-8237-177ba107012c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:15.638037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410048f-0efb-49c0-8237-177ba107012c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:15.638312 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410048f-0efb-49c0-8237-177ba107012c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:15.638582 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410048f-0efb-49c0-8237-177ba107012c admin admin] PATH_INFO: `/v3/projects/ee8d52aef12e4f01812e759fcc2efefb` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:15.639730 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410048f-0efb-49c0-8237-177ba107012c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee8d52aef12e4f01812e759fcc2efefb)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:15.642170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410048f-0efb-49c0-8237-177ba107012c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:15.687005 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f410048f-0efb-49c0-8237-177ba107012c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee8d52aef12e4f01812e759fcc2efefb', 'request_id': 'req-f410048f-0efb-49c0-8237-177ba107012c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.693064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f410048f-0efb-49c0-8237-177ba107012c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee8d52aef12e4f01812e759fcc2efefb', 'request_id': 'req-f410048f-0efb-49c0-8237-177ba107012c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.700018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f410048f-0efb-49c0-8237-177ba107012c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee8d52aef12e4f01812e759fcc2efefb', 'request_id': 'req-f410048f-0efb-49c0-8237-177ba107012c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.711670 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f410048f-0efb-49c0-8237-177ba107012c admin admin] The token cache is being invalidate because project ee8d52aef12e4f01812e759fcc2efefb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:20:15.711954 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f410048f-0efb-49c0-8237-177ba107012c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.712574 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f410048f-0efb-49c0-8237-177ba107012c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:15.714092 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1428/2866] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:20:15 2022] DELETE /identity/v3/projects/ee8d52aef12e4f01812e759fcc2efefb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:15.718891 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304c002-3fd9-4a25-8235-f8944160166e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:15.719400 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304c002-3fd9-4a25-8235-f8944160166e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:15.719497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304c002-3fd9-4a25-8235-f8944160166e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:15.738479 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0304c002-3fd9-4a25-8235-f8944160166e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:15.739946 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0304c002-3fd9-4a25-8235-f8944160166e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:15.797477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1439/2867] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:15.805376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659fb85-1f03-4dd7-8f1b-2c088881d18e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:15.805601 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659fb85-1f03-4dd7-8f1b-2c088881d18e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:15.805871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5659fb85-1f03-4dd7-8f1b-2c088881d18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:15.825162 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5659fb85-1f03-4dd7-8f1b-2c088881d18e None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:15.826371 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5659fb85-1f03-4dd7-8f1b-2c088881d18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:15.834740 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1429/2868] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:15.838765 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304c002-3fd9-4a25-8235-f8944160166e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:15.848201 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304c002-3fd9-4a25-8235-f8944160166e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:15.852726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6e08-4558-4ff7-ae8d-cdf4bf84c0c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:15.853351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6e08-4558-4ff7-ae8d-cdf4bf84c0c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:15.853627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6e08-4558-4ff7-ae8d-cdf4bf84c0c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:15.853888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ee6e08-4558-4ff7-ae8d-cdf4bf84c0c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:15.854562 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee6e08-4558-4ff7-ae8d-cdf4bf84c0c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:20:15.854857 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee6e08-4558-4ff7-ae8d-cdf4bf84c0c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:15.856426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ee6e08-4558-4ff7-ae8d-cdf4bf84c0c9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:15.867862 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1440/2869] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:20:15.872099 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659fb85-1f03-4dd7-8f1b-2c088881d18e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:15.876874 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:15.882855 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5659fb85-1f03-4dd7-8f1b-2c088881d18e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:15.888605 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af934098-ab6b-402a-84c3-d872a1e792f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:15.889152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af934098-ab6b-402a-84c3-d872a1e792f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:15.889489 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af934098-ab6b-402a-84c3-d872a1e792f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:15.889767 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af934098-ab6b-402a-84c3-d872a1e792f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:15.890438 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af934098-ab6b-402a-84c3-d872a1e792f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:15.892955 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af934098-ab6b-402a-84c3-d872a1e792f7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:15.920012 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1430/2870] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:20:15 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:20:15.924082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6e08-4558-4ff7-ae8d-cdf4bf84c0c9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:15.934004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ee6e08-4558-4ff7-ae8d-cdf4bf84c0c9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:15.964432 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:15.993439 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e579c7-aab2-4e89-9aba-f46e150a4402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:15.994078 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e579c7-aab2-4e89-9aba-f46e150a4402 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:15.994362 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e579c7-aab2-4e89-9aba-f46e150a4402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:15.994637 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e579c7-aab2-4e89-9aba-f46e150a4402 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:15.995302 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e579c7-aab2-4e89-9aba-f46e150a4402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:15.997255 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e579c7-aab2-4e89-9aba-f46e150a4402 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.018332 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1441/2871] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:20:15 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:20:16.022439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af934098-ab6b-402a-84c3-d872a1e792f7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.032662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af934098-ab6b-402a-84c3-d872a1e792f7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:16.037254 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635eee5-de80-44e9-9a9c-2de2e980bf7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:16.037877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635eee5-de80-44e9-9a9c-2de2e980bf7b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.038157 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635eee5-de80-44e9-9a9c-2de2e980bf7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.038426 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9635eee5-de80-44e9-9a9c-2de2e980bf7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.039121 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635eee5-de80-44e9-9a9c-2de2e980bf7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:16.040694 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9635eee5-de80-44e9-9a9c-2de2e980bf7b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.050807 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1431/2872] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:16.054458 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e579c7-aab2-4e89-9aba-f46e150a4402 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.064830 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e579c7-aab2-4e89-9aba-f46e150a4402 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:16.069473 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113207bc-d517-459e-80f7-261c1d2fc01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:16.070068 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113207bc-d517-459e-80f7-261c1d2fc01a admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.070351 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113207bc-d517-459e-80f7-261c1d2fc01a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.070627 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113207bc-d517-459e-80f7-261c1d2fc01a admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.071342 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113207bc-d517-459e-80f7-261c1d2fc01a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:16.072919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113207bc-d517-459e-80f7-261c1d2fc01a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.083226 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1442/2873] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:16.087032 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635eee5-de80-44e9-9a9c-2de2e980bf7b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.097018 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9635eee5-de80-44e9-9a9c-2de2e980bf7b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:16.101646 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019d4b7-b628-4c60-849b-d530522e7c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:16.102303 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019d4b7-b628-4c60-849b-d530522e7c90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.102570 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019d4b7-b628-4c60-849b-d530522e7c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.102844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019d4b7-b628-4c60-849b-d530522e7c90 admin admin] PATH_INFO: `/v3/projects/6a9ca4cabb014b1196f4b75ac6a49ba9/users/756c1c3862b24d3583718e5508842869/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.118198 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019d4b7-b628-4c60-849b-d530522e7c90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a9ca4cabb014b1196f4b75ac6a49ba9, user_id=756c1c3862b24d3583718e5508842869, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:16.121026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019d4b7-b628-4c60-849b-d530522e7c90 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.135152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1432/2874] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:20:16 2022] PUT /identity/v3/projects/6a9ca4cabb014b1196f4b75ac6a49ba9/users/756c1c3862b24d3583718e5508842869/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:16.146595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010da28-0fce-42ed-b941-b77d9a873bde None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.146824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010da28-0fce-42ed-b941-b77d9a873bde None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.147095 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b010da28-0fce-42ed-b941-b77d9a873bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.174323 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b010da28-0fce-42ed-b941-b77d9a873bde None None] MFA Rules not processed for user `756c1c3862b24d3583718e5508842869`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:16.175662 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b010da28-0fce-42ed-b941-b77d9a873bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:16.243339 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1443/2875] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:16.247993 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019d4b7-b628-4c60-849b-d530522e7c90 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.309037 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019d4b7-b628-4c60-849b-d530522e7c90 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:16.314377 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2e5a8-be6a-426f-8030-8ad2598028b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:16.314990 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2e5a8-be6a-426f-8030-8ad2598028b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.315293 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2e5a8-be6a-426f-8030-8ad2598028b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.315565 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d2e5a8-be6a-426f-8030-8ad2598028b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.316233 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2e5a8-be6a-426f-8030-8ad2598028b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:16.318236 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d2e5a8-be6a-426f-8030-8ad2598028b4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.344449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1433/2876] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:20:16 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:20:16.348701 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010da28-0fce-42ed-b941-b77d9a873bde None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.359293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b010da28-0fce-42ed-b941-b77d9a873bde None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:16.415885 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8666c-5629-4c5f-b875-773c3a2d09b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:16.416424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8666c-5629-4c5f-b875-773c3a2d09b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.416706 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8666c-5629-4c5f-b875-773c3a2d09b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.416982 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe8666c-5629-4c5f-b875-773c3a2d09b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.417679 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8666c-5629-4c5f-b875-773c3a2d09b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:16.419590 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe8666c-5629-4c5f-b875-773c3a2d09b1 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.441004 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1444/2877] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:20:16 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:20:16.444915 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2e5a8-be6a-426f-8030-8ad2598028b4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.454982 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d2e5a8-be6a-426f-8030-8ad2598028b4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:16.459467 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41906d3f-12e3-45dc-acb1-a765e1ab3103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:16.460057 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41906d3f-12e3-45dc-acb1-a765e1ab3103 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.460330 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41906d3f-12e3-45dc-acb1-a765e1ab3103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.460596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41906d3f-12e3-45dc-acb1-a765e1ab3103 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.461276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41906d3f-12e3-45dc-acb1-a765e1ab3103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:16.462885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41906d3f-12e3-45dc-acb1-a765e1ab3103 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.473493 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1434/2878] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:16.477334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8666c-5629-4c5f-b875-773c3a2d09b1 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.488051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe8666c-5629-4c5f-b875-773c3a2d09b1 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:16.493088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a5152-e00c-4fe5-93fa-7a318f5a173b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:16.493785 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a5152-e00c-4fe5-93fa-7a318f5a173b admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.494059 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a5152-e00c-4fe5-93fa-7a318f5a173b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.494326 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a5152-e00c-4fe5-93fa-7a318f5a173b admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.495048 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a5152-e00c-4fe5-93fa-7a318f5a173b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:16.496701 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a5152-e00c-4fe5-93fa-7a318f5a173b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.506968 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1445/2879] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:16.511098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41906d3f-12e3-45dc-acb1-a765e1ab3103 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.520738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41906d3f-12e3-45dc-acb1-a765e1ab3103 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:16.525391 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4482-6a0b-4293-b20f-eff16f82ab55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:16.526064 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4482-6a0b-4293-b20f-eff16f82ab55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.526343 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4482-6a0b-4293-b20f-eff16f82ab55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.526615 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07da4482-6a0b-4293-b20f-eff16f82ab55 admin admin] PATH_INFO: `/v3/projects/56e917a87e034c7e8fadf59dbe8f4b28/users/1a73b669499448deb33914c36bd235d0/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.541386 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da4482-6a0b-4293-b20f-eff16f82ab55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56e917a87e034c7e8fadf59dbe8f4b28, user_id=1a73b669499448deb33914c36bd235d0, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:16.543994 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07da4482-6a0b-4293-b20f-eff16f82ab55 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.557476 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1435/2880] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:20:16 2022] PUT /identity/v3/projects/56e917a87e034c7e8fadf59dbe8f4b28/users/1a73b669499448deb33914c36bd235d0/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:16.567699 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed2cf9-cc84-4507-8aeb-3a51dfc9da00 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.567984 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed2cf9-cc84-4507-8aeb-3a51dfc9da00 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.568281 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ed2cf9-cc84-4507-8aeb-3a51dfc9da00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.596591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d4ed2cf9-cc84-4507-8aeb-3a51dfc9da00 None None] MFA Rules not processed for user `1a73b669499448deb33914c36bd235d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:16.597858 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d4ed2cf9-cc84-4507-8aeb-3a51dfc9da00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:16.605777 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:16.662643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1446/2881] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:16.667237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4482-6a0b-4293-b20f-eff16f82ab55 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.729899 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:16.736947 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07da4482-6a0b-4293-b20f-eff16f82ab55 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:16.742081 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17475c29-2c96-4f66-a2ff-4cb81851912f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:16.742709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17475c29-2c96-4f66-a2ff-4cb81851912f admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.742988 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17475c29-2c96-4f66-a2ff-4cb81851912f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.743265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17475c29-2c96-4f66-a2ff-4cb81851912f admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.743912 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17475c29-2c96-4f66-a2ff-4cb81851912f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:16.745871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17475c29-2c96-4f66-a2ff-4cb81851912f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.772125 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1436/2882] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:20:16 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:20:16.776283 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed2cf9-cc84-4507-8aeb-3a51dfc9da00 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.788228 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ed2cf9-cc84-4507-8aeb-3a51dfc9da00 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:16.843534 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca97f7a-8bac-4355-8350-788e688e91e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:16.844144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca97f7a-8bac-4355-8350-788e688e91e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.844421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca97f7a-8bac-4355-8350-788e688e91e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.844695 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca97f7a-8bac-4355-8350-788e688e91e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.845975 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca97f7a-8bac-4355-8350-788e688e91e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:16.847911 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca97f7a-8bac-4355-8350-788e688e91e9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.868478 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1447/2883] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:20:16 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:20:16.872580 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17475c29-2c96-4f66-a2ff-4cb81851912f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.882962 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17475c29-2c96-4f66-a2ff-4cb81851912f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:16.887593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fd4a4-ad27-4549-bcda-8afbc6492f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:16.888191 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fd4a4-ad27-4549-bcda-8afbc6492f58 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.888469 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fd4a4-ad27-4549-bcda-8afbc6492f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.888738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10fd4a4-ad27-4549-bcda-8afbc6492f58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.889469 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fd4a4-ad27-4549-bcda-8afbc6492f58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:16.891070 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10fd4a4-ad27-4549-bcda-8afbc6492f58 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.901814 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1437/2884] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:16.905798 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca97f7a-8bac-4355-8350-788e688e91e9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.916124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca97f7a-8bac-4355-8350-788e688e91e9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:16.920761 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad3a25-53a1-4391-ba12-03a1dc7f97c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:16.921377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3a25-53a1-4391-ba12-03a1dc7f97c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:16.921657 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3a25-53a1-4391-ba12-03a1dc7f97c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:16.921928 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ad3a25-53a1-4391-ba12-03a1dc7f97c6 admin admin] PATH_INFO: `/v3/projects/7eb714a388f94030be053f57ef2dc4c0/users/201afd578cfc4706b8abc665eac4775d/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:16.936357 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad3a25-53a1-4391-ba12-03a1dc7f97c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb714a388f94030be053f57ef2dc4c0, user_id=201afd578cfc4706b8abc665eac4775d, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:16.939071 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ad3a25-53a1-4391-ba12-03a1dc7f97c6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:16.951992 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1448/2885] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:20:16 2022] PUT /identity/v3/projects/7eb714a388f94030be053f57ef2dc4c0/users/201afd578cfc4706b8abc665eac4775d/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:16.956500 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fd4a4-ad27-4549-bcda-8afbc6492f58 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:16.966613 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10fd4a4-ad27-4549-bcda-8afbc6492f58 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:17.021222 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc23971-6b1e-4de5-8354-65ff27454784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:17.021920 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc23971-6b1e-4de5-8354-65ff27454784 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:17.022194 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc23971-6b1e-4de5-8354-65ff27454784 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:17.022463 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc23971-6b1e-4de5-8354-65ff27454784 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:17.023146 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc23971-6b1e-4de5-8354-65ff27454784 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:17.024722 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc23971-6b1e-4de5-8354-65ff27454784 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:17.034712 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1438/2886] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:17.038821 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad3a25-53a1-4391-ba12-03a1dc7f97c6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:17.048718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ad3a25-53a1-4391-ba12-03a1dc7f97c6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:17.053147 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0db3c-fb6e-4083-b24b-715f35746019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:17.053825 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0db3c-fb6e-4083-b24b-715f35746019 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:17.054094 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0db3c-fb6e-4083-b24b-715f35746019 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:17.054364 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0db3c-fb6e-4083-b24b-715f35746019 admin admin] PATH_INFO: `/v3/projects/7eb714a388f94030be053f57ef2dc4c0/users/201afd578cfc4706b8abc665eac4775d/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:17.056277 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0db3c-fb6e-4083-b24b-715f35746019 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb714a388f94030be053f57ef2dc4c0, user_id=201afd578cfc4706b8abc665eac4775d, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:17.058934 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0db3c-fb6e-4083-b24b-715f35746019 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:17.068723 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1449/2887] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:20:17 2022] PUT /identity/v3/projects/7eb714a388f94030be053f57ef2dc4c0/users/201afd578cfc4706b8abc665eac4775d/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:17.079934 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53909f-1b45-43a1-8a64-4680f171f08f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:17.080219 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53909f-1b45-43a1-8a64-4680f171f08f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:17.080490 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff53909f-1b45-43a1-8a64-4680f171f08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:17.109472 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ff53909f-1b45-43a1-8a64-4680f171f08f None None] MFA Rules not processed for user `201afd578cfc4706b8abc665eac4775d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:17.110680 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ff53909f-1b45-43a1-8a64-4680f171f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:17.177882 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1439/2888] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:17.190003 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0db3c-fb6e-4083-b24b-715f35746019 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:17.191678 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1cd0db3c-fb6e-4083-b24b-715f35746019 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:17.248045 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0db3c-fb6e-4083-b24b-715f35746019 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:17.252222 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41291145-7d09-4d25-9094-3ab331b4abb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:17.252824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41291145-7d09-4d25-9094-3ab331b4abb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:17.253100 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41291145-7d09-4d25-9094-3ab331b4abb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:17.253399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41291145-7d09-4d25-9094-3ab331b4abb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:17.266010 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:17.312144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41291145-7d09-4d25-9094-3ab331b4abb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:17.314122 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41291145-7d09-4d25-9094-3ab331b4abb3 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:17.322952 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1450/2889] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:20:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:20:18.810540 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53909f-1b45-43a1-8a64-4680f171f08f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:18.812009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ff53909f-1b45-43a1-8a64-4680f171f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:18.824372 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff53909f-1b45-43a1-8a64-4680f171f08f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:18.827876 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d87fd-02bf-4c70-844a-42b0c495b07d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:18.828474 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d87fd-02bf-4c70-844a-42b0c495b07d service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:18.828747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d87fd-02bf-4c70-844a-42b0c495b07d service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:18.829665 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d87fd-02bf-4c70-844a-42b0c495b07d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:18.875358 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:18.886627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d87fd-02bf-4c70-844a-42b0c495b07d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:18.888044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d87fd-02bf-4c70-844a-42b0c495b07d service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:18.897503 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1440/2890] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:20:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:20:19.407836 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41291145-7d09-4d25-9094-3ab331b4abb3 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:19.416591 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41291145-7d09-4d25-9094-3ab331b4abb3 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:19.420204 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d5bf5d-277b-4b17-adb9-a8cdf4abf1e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00d506205722431ba2995956c7981735', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:19.420808 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5bf5d-277b-4b17-adb9-a8cdf4abf1e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:19.421088 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5bf5d-277b-4b17-adb9-a8cdf4abf1e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:19.421399 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d5bf5d-277b-4b17-adb9-a8cdf4abf1e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:19.430922 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5bf5d-277b-4b17-adb9-a8cdf4abf1e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:19.432334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d5bf5d-277b-4b17-adb9-a8cdf4abf1e7 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:19.442360 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1451/2891] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:20:19 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:20:23.295951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d87fd-02bf-4c70-844a-42b0c495b07d service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:23.356979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d87fd-02bf-4c70-844a-42b0c495b07d service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:23.361492 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:23.362118 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:23.362397 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:23.362672 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] PATH_INFO: `/v3/users/756c1c3862b24d3583718e5508842869` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:23.363829 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=756c1c3862b24d3583718e5508842869)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:23.366048 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:23.411186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '756c1c3862b24d3583718e5508842869'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:23.411823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '756c1c3862b24d3583718e5508842869'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:23.423197 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '756c1c3862b24d3583718e5508842869'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:23.429786 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '756c1c3862b24d3583718e5508842869'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:23.437212 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '756c1c3862b24d3583718e5508842869'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:23.443460 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1441/2892] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:20:23 2022] DELETE /identity/v3/users/756c1c3862b24d3583718e5508842869 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:23.447914 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da2067-ddb3-488d-b2df-daa5f33f213f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:23.448402 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da2067-ddb3-488d-b2df-daa5f33f213f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:23.448511 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24da2067-ddb3-488d-b2df-daa5f33f213f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:23.467537 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-24da2067-ddb3-488d-b2df-daa5f33f213f None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:23.468737 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-24da2067-ddb3-488d-b2df-daa5f33f213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:23.525542 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1452/2893] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:23.535230 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:23.536607 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:23.593033 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b361d1df-ae17-4212-9c9b-da91a11857e6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:23.596598 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c00b6-deef-4457-aef1-68d66c3023b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:23.597201 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c00b6-deef-4457-aef1-68d66c3023b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:23.597502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c00b6-deef-4457-aef1-68d66c3023b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:23.597785 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653c00b6-deef-4457-aef1-68d66c3023b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:23.606506 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c00b6-deef-4457-aef1-68d66c3023b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:23.607921 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653c00b6-deef-4457-aef1-68d66c3023b7 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:23.618154 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1442/2894] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:20:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:20:23.882625 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da2067-ddb3-488d-b2df-daa5f33f213f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:23.884144 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-24da2067-ddb3-488d-b2df-daa5f33f213f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:23.896702 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24da2067-ddb3-488d-b2df-daa5f33f213f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:23.901220 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:23.901874 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:23.902149 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:23.902420 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] PATH_INFO: `/v3/projects/6a9ca4cabb014b1196f4b75ac6a49ba9` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:23.903588 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a9ca4cabb014b1196f4b75ac6a49ba9)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:23.905515 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:23.952570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a9ca4cabb014b1196f4b75ac6a49ba9', 'request_id': 'req-14c56941-39ab-49e0-88a1-e980332444d4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:23.958127 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a9ca4cabb014b1196f4b75ac6a49ba9', 'request_id': 'req-14c56941-39ab-49e0-88a1-e980332444d4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:23.964184 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a9ca4cabb014b1196f4b75ac6a49ba9', 'request_id': 'req-14c56941-39ab-49e0-88a1-e980332444d4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:23.976476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] The token cache is being invalidate because project 6a9ca4cabb014b1196f4b75ac6a49ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:20:23.976755 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:23.977404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:23.978886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1453/2895] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:20:23 2022] DELETE /identity/v3/projects/6a9ca4cabb014b1196f4b75ac6a49ba9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:23.983043 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c00b6-deef-4457-aef1-68d66c3023b7 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:23.993573 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653c00b6-deef-4457-aef1-68d66c3023b7 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:24.001090 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:24.049350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:24.050005 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:24.050283 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:24.050554 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] PATH_INFO: `/v3/users/1a73b669499448deb33914c36bd235d0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:24.051697 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a73b669499448deb33914c36bd235d0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:24.053643 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:24.096449 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a73b669499448deb33914c36bd235d0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.097009 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a73b669499448deb33914c36bd235d0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.108407 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a73b669499448deb33914c36bd235d0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.115914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a73b669499448deb33914c36bd235d0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.122878 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a73b669499448deb33914c36bd235d0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.128846 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1443/2896] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:20:23 2022] DELETE /identity/v3/users/1a73b669499448deb33914c36bd235d0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:24.408677 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:24.410137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:24.423834 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c56941-39ab-49e0-88a1-e980332444d4 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:24.451286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:24.486556 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:24.487189 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:24.487466 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:24.487734 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] PATH_INFO: `/v3/projects/56e917a87e034c7e8fadf59dbe8f4b28` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:24.488872 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] RBAC: Authorizing `identity:delete_project(project_id=56e917a87e034c7e8fadf59dbe8f4b28)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:24.491643 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:24.537185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56e917a87e034c7e8fadf59dbe8f4b28', 'request_id': 'req-11f3a3b1-2f39-4c40-be86-d7ae4067596f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.542489 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56e917a87e034c7e8fadf59dbe8f4b28', 'request_id': 'req-11f3a3b1-2f39-4c40-be86-d7ae4067596f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.548413 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56e917a87e034c7e8fadf59dbe8f4b28', 'request_id': 'req-11f3a3b1-2f39-4c40-be86-d7ae4067596f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.560037 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] The token cache is being invalidate because project 56e917a87e034c7e8fadf59dbe8f4b28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:20:24.560318 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.560929 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.562457 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1454/2897] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:20:24 2022] DELETE /identity/v3/projects/56e917a87e034c7e8fadf59dbe8f4b28 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:20:24.566629 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:24.568038 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:24.581117 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06898ecd-953f-45aa-9ff4-b37e6457ecc6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:24.637137 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b29465-f3cc-4fab-af3d-87eeca189a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:24.637728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b29465-f3cc-4fab-af3d-87eeca189a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:24.638007 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b29465-f3cc-4fab-af3d-87eeca189a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:24.638276 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b29465-f3cc-4fab-af3d-87eeca189a78 admin admin] PATH_INFO: `/v3/users/201afd578cfc4706b8abc665eac4775d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:24.639423 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b29465-f3cc-4fab-af3d-87eeca189a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=201afd578cfc4706b8abc665eac4775d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:24.641861 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b29465-f3cc-4fab-af3d-87eeca189a78 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:24.674965 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:24.689623 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a4b29465-f3cc-4fab-af3d-87eeca189a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201afd578cfc4706b8abc665eac4775d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.690272 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a4b29465-f3cc-4fab-af3d-87eeca189a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201afd578cfc4706b8abc665eac4775d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.701864 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a4b29465-f3cc-4fab-af3d-87eeca189a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201afd578cfc4706b8abc665eac4775d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.709388 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a4b29465-f3cc-4fab-af3d-87eeca189a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201afd578cfc4706b8abc665eac4775d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.716606 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a4b29465-f3cc-4fab-af3d-87eeca189a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201afd578cfc4706b8abc665eac4775d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:24.727108 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1444/2898] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:20:24 2022] DELETE /identity/v3/users/201afd578cfc4706b8abc665eac4775d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:24.994119 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:24.995690 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:25.009009 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f3a3b1-2f39-4c40-be86-d7ae4067596f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:25.064722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43f44c7-4e33-41b3-be18-772963082f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:25.065385 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f44c7-4e33-41b3-be18-772963082f96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:25.065667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f44c7-4e33-41b3-be18-772963082f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:25.065937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43f44c7-4e33-41b3-be18-772963082f96 admin admin] PATH_INFO: `/v3/projects/7eb714a388f94030be053f57ef2dc4c0` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:25.067082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f44c7-4e33-41b3-be18-772963082f96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb714a388f94030be053f57ef2dc4c0)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:25.068981 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43f44c7-4e33-41b3-be18-772963082f96 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:25.112626 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e43f44c7-4e33-41b3-be18-772963082f96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb714a388f94030be053f57ef2dc4c0', 'request_id': 'req-e43f44c7-4e33-41b3-be18-772963082f96'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:25.118670 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e43f44c7-4e33-41b3-be18-772963082f96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb714a388f94030be053f57ef2dc4c0', 'request_id': 'req-e43f44c7-4e33-41b3-be18-772963082f96'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:25.119976 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:25.127404 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e43f44c7-4e33-41b3-be18-772963082f96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb714a388f94030be053f57ef2dc4c0', 'request_id': 'req-e43f44c7-4e33-41b3-be18-772963082f96'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:25.139775 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e43f44c7-4e33-41b3-be18-772963082f96 admin admin] The token cache is being invalidate because project 7eb714a388f94030be053f57ef2dc4c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:20:25.140063 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e43f44c7-4e33-41b3-be18-772963082f96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:25.140691 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e43f44c7-4e33-41b3-be18-772963082f96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:20:25.142232 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1455/2899] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:20:24 2022] DELETE /identity/v3/projects/7eb714a388f94030be053f57ef2dc4c0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 12:20:25.149015 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb30477-642c-4eff-8fdd-c729afe399f3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:25.149370 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb30477-642c-4eff-8fdd-c729afe399f3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:25.149627 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb30477-642c-4eff-8fdd-c729afe399f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:25.168524 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5eb30477-642c-4eff-8fdd-c729afe399f3 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:25.169808 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5eb30477-642c-4eff-8fdd-c729afe399f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:25.228035 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1445/2900] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:25.236433 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90fd7-ad81-4a1d-a5b2-015bd414fbd5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:25.236722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90fd7-ad81-4a1d-a5b2-015bd414fbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:25.236993 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a90fd7-ad81-4a1d-a5b2-015bd414fbd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:25.257082 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-33a90fd7-ad81-4a1d-a5b2-015bd414fbd5 None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:25.258325 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-33a90fd7-ad81-4a1d-a5b2-015bd414fbd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:25.266251 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1456/2901] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:25.270376 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb30477-642c-4eff-8fdd-c729afe399f3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:25.279958 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb30477-642c-4eff-8fdd-c729afe399f3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:25.285673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb335ba0-1620-4c4e-b5f4-9dd504336718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:25.285843 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb335ba0-1620-4c4e-b5f4-9dd504336718 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:25.286129 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb335ba0-1620-4c4e-b5f4-9dd504336718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:25.286406 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb335ba0-1620-4c4e-b5f4-9dd504336718 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:25.287097 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb335ba0-1620-4c4e-b5f4-9dd504336718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 12:20:25.287401 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb335ba0-1620-4c4e-b5f4-9dd504336718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:25.289020 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb335ba0-1620-4c4e-b5f4-9dd504336718 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:25.301316 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1446/2902] 10.222.0.42 () {58 vars in 1153 bytes} [Mon Aug 1 12:20:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 12:20:25.305718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a90fd7-ad81-4a1d-a5b2-015bd414fbd5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:25.315601 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a90fd7-ad81-4a1d-a5b2-015bd414fbd5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:25.320269 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2afd3-6d56-4341-93d6-c9890adc6413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:25.320871 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2afd3-6d56-4341-93d6-c9890adc6413 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:25.321155 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2afd3-6d56-4341-93d6-c9890adc6413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:25.321471 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda2afd3-6d56-4341-93d6-c9890adc6413 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:25.322124 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2afd3-6d56-4341-93d6-c9890adc6413 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:25.324021 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda2afd3-6d56-4341-93d6-c9890adc6413 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:25.350355 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1457/2903] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:20:25 2022] POST /identity/v3/projects => generated 371 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:20:25.354544 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb335ba0-1620-4c4e-b5f4-9dd504336718 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:25.365054 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb335ba0-1620-4c4e-b5f4-9dd504336718 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:25.420708 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2d7c3-a153-4902-bf37-facdc00bf9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:25.421243 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d7c3-a153-4902-bf37-facdc00bf9c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:25.421549 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d7c3-a153-4902-bf37-facdc00bf9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:25.421818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2d7c3-a153-4902-bf37-facdc00bf9c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:25.422951 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2d7c3-a153-4902-bf37-facdc00bf9c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:25.424863 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2d7c3-a153-4902-bf37-facdc00bf9c0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:25.446439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1447/2904] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:20:25 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:20:25.450801 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2afd3-6d56-4341-93d6-c9890adc6413 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:25.461043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda2afd3-6d56-4341-93d6-c9890adc6413 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:25.465686 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ac97a-173f-4890-96ff-c68a8e32a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:25.466290 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ac97a-173f-4890-96ff-c68a8e32a23e admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:25.466570 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ac97a-173f-4890-96ff-c68a8e32a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:25.466840 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8ac97a-173f-4890-96ff-c68a8e32a23e admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:25.467527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ac97a-173f-4890-96ff-c68a8e32a23e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:25.469113 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8ac97a-173f-4890-96ff-c68a8e32a23e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:25.479331 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1458/2905] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:25.483174 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2d7c3-a153-4902-bf37-facdc00bf9c0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:25.494709 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2d7c3-a153-4902-bf37-facdc00bf9c0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:25.499389 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36471e61-8d67-430b-9521-662ef063abe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:25.499980 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36471e61-8d67-430b-9521-662ef063abe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:25.500258 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36471e61-8d67-430b-9521-662ef063abe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:25.500531 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36471e61-8d67-430b-9521-662ef063abe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:25.501218 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36471e61-8d67-430b-9521-662ef063abe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:25.502917 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36471e61-8d67-430b-9521-662ef063abe1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:25.513439 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1448/2906] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:25.517676 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ac97a-173f-4890-96ff-c68a8e32a23e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:25.527530 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8ac97a-173f-4890-96ff-c68a8e32a23e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:25.532595 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad011b1-67a5-4609-b444-5fd0f6d4fabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:25.533240 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad011b1-67a5-4609-b444-5fd0f6d4fabf admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:25.533619 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad011b1-67a5-4609-b444-5fd0f6d4fabf admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:25.533889 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad011b1-67a5-4609-b444-5fd0f6d4fabf admin admin] PATH_INFO: `/v3/projects/ded64eaa4a064fc5b717fe0c5ffafba7/users/9ae3f89ef2f94ee89f1bbf27937b49fa/roles/251e50fd870c48f3a02b69587144b7bf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:25.550175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad011b1-67a5-4609-b444-5fd0f6d4fabf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ded64eaa4a064fc5b717fe0c5ffafba7, user_id=9ae3f89ef2f94ee89f1bbf27937b49fa, role_id=251e50fd870c48f3a02b69587144b7bf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:25.552977 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad011b1-67a5-4609-b444-5fd0f6d4fabf admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:25.566881 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1459/2907] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:20:25 2022] PUT /identity/v3/projects/ded64eaa4a064fc5b717fe0c5ffafba7/users/9ae3f89ef2f94ee89f1bbf27937b49fa/roles/251e50fd870c48f3a02b69587144b7bf => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:25.571926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc899e82-9fa0-4efc-b96c-c32a089860cd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:25.572400 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc899e82-9fa0-4efc-b96c-c32a089860cd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:25.572509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc899e82-9fa0-4efc-b96c-c32a089860cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:25.591616 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bc899e82-9fa0-4efc-b96c-c32a089860cd None None] MFA Rules not processed for user `2ba23ee634e9487f8436a5c9c29e0eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:25.592821 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bc899e82-9fa0-4efc-b96c-c32a089860cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:25.602628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:25.652877 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1449/2908] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:25.663146 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad011b1-67a5-4609-b444-5fd0f6d4fabf admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:25.664839 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3ad011b1-67a5-4609-b444-5fd0f6d4fabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:25.720593 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad011b1-67a5-4609-b444-5fd0f6d4fabf admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:25.724160 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ffa27-c12b-44da-b55b-e2f3e4b8c345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:25.724768 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ffa27-c12b-44da-b55b-e2f3e4b8c345 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:25.725043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ffa27-c12b-44da-b55b-e2f3e4b8c345 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:25.725334 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707ffa27-c12b-44da-b55b-e2f3e4b8c345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:25.734137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ffa27-c12b-44da-b55b-e2f3e4b8c345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:25.736185 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707ffa27-c12b-44da-b55b-e2f3e4b8c345 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:25.745797 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1460/2909] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:20:29.666261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67839541-4add-42da-bef8-fe1f950fec83 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:29.666261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67839541-4add-42da-bef8-fe1f950fec83 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:29.666878 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67839541-4add-42da-bef8-fe1f950fec83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:29.700660 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-67839541-4add-42da-bef8-fe1f950fec83 None None] MFA Rules not processed for user `9ae3f89ef2f94ee89f1bbf27937b49fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:29.702166 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-67839541-4add-42da-bef8-fe1f950fec83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:29.777450 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1450/2910] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:29.782052 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ffa27-c12b-44da-b55b-e2f3e4b8c345 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:29.791919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707ffa27-c12b-44da-b55b-e2f3e4b8c345 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:29.796613 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485684a-b1cf-45fd-9d9a-42221774b446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:29.797224 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485684a-b1cf-45fd-9d9a-42221774b446 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:29.798015 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485684a-b1cf-45fd-9d9a-42221774b446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:29.798288 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485684a-b1cf-45fd-9d9a-42221774b446 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:29.798955 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485684a-b1cf-45fd-9d9a-42221774b446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:29.800866 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485684a-b1cf-45fd-9d9a-42221774b446 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:29.830337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1461/2911] 10.222.0.42 () {60 vars in 1153 bytes} [Mon Aug 1 12:20:29 2022] POST /identity/v3/projects => generated 373 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 12:20:29.834422 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67839541-4add-42da-bef8-fe1f950fec83 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:29.845999 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67839541-4add-42da-bef8-fe1f950fec83 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:29.912319 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e555d83-a42c-446c-9a9e-5bf05bcbeb31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:29.912704 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e555d83-a42c-446c-9a9e-5bf05bcbeb31 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:29.912978 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e555d83-a42c-446c-9a9e-5bf05bcbeb31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:29.913244 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e555d83-a42c-446c-9a9e-5bf05bcbeb31 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:29.914119 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e555d83-a42c-446c-9a9e-5bf05bcbeb31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:29.916044 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e555d83-a42c-446c-9a9e-5bf05bcbeb31 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:29.949835 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1451/2912] 10.222.0.42 () {60 vars in 1144 bytes} [Mon Aug 1 12:20:29 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 12:20:29.951206 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485684a-b1cf-45fd-9d9a-42221774b446 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:29.961903 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485684a-b1cf-45fd-9d9a-42221774b446 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:29.966519 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393e4fc-d944-4135-a564-c05a2704e64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:29.967134 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393e4fc-d944-4135-a564-c05a2704e64f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:29.967412 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393e4fc-d944-4135-a564-c05a2704e64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:29.967684 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d393e4fc-d944-4135-a564-c05a2704e64f admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:29.968376 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393e4fc-d944-4135-a564-c05a2704e64f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:29.970667 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d393e4fc-d944-4135-a564-c05a2704e64f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:29.981746 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1462/2913] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:29.986628 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e555d83-a42c-446c-9a9e-5bf05bcbeb31 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:29.997290 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e555d83-a42c-446c-9a9e-5bf05bcbeb31 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:30.002938 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e55f4-8add-4c31-8e00-aa21bbd91bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:30.003596 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e55f4-8add-4c31-8e00-aa21bbd91bef admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:30.003875 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e55f4-8add-4c31-8e00-aa21bbd91bef admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:30.004152 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5e55f4-8add-4c31-8e00-aa21bbd91bef admin admin] PATH_INFO: `/v3/projects/c8fa2529466645908f2c77439e828a09/users/2f6db63653284bd1b027795d2319e3db/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:30.020314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e55f4-8add-4c31-8e00-aa21bbd91bef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fa2529466645908f2c77439e828a09, user_id=2f6db63653284bd1b027795d2319e3db, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:30.023051 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5e55f4-8add-4c31-8e00-aa21bbd91bef admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:30.037192 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1452/2914] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:20:29 2022] PUT /identity/v3/projects/c8fa2529466645908f2c77439e828a09/users/2f6db63653284bd1b027795d2319e3db/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:30.041421 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393e4fc-d944-4135-a564-c05a2704e64f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:30.052293 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d393e4fc-d944-4135-a564-c05a2704e64f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:30.102133 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:30.114153 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dccf7-6e24-45dd-9af6-219a0cb87480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:30.115033 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dccf7-6e24-45dd-9af6-219a0cb87480 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:30.115315 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dccf7-6e24-45dd-9af6-219a0cb87480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:30.115610 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dccf7-6e24-45dd-9af6-219a0cb87480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:30.116298 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dccf7-6e24-45dd-9af6-219a0cb87480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:30.117937 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508dccf7-6e24-45dd-9af6-219a0cb87480 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:30.127847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1463/2915] 10.222.0.42 () {58 vars in 1122 bytes} [Mon Aug 1 12:20:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 12:20:30.132026 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e55f4-8add-4c31-8e00-aa21bbd91bef admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:30.142221 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5e55f4-8add-4c31-8e00-aa21bbd91bef admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:30.146752 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83291c34-44f2-409f-8c85-eea3754da037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:30.147396 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83291c34-44f2-409f-8c85-eea3754da037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:30.147673 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83291c34-44f2-409f-8c85-eea3754da037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:30.147944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83291c34-44f2-409f-8c85-eea3754da037 admin admin] PATH_INFO: `/v3/projects/c8fa2529466645908f2c77439e828a09/users/2f6db63653284bd1b027795d2319e3db/roles/0195bf688a7e464e8ff594afe80b050e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:30.149903 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83291c34-44f2-409f-8c85-eea3754da037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fa2529466645908f2c77439e828a09, user_id=2f6db63653284bd1b027795d2319e3db, role_id=0195bf688a7e464e8ff594afe80b050e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:30.152542 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83291c34-44f2-409f-8c85-eea3754da037 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:30.158491 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:30.164391 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1453/2916] 10.222.0.42 () {60 vars in 1483 bytes} [Mon Aug 1 12:20:30 2022] PUT /identity/v3/projects/c8fa2529466645908f2c77439e828a09/users/2f6db63653284bd1b027795d2319e3db/roles/0195bf688a7e464e8ff594afe80b050e => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:20:34.925151 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b329642-a1da-427d-a04d-432e2eb150f3 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:34.925718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b329642-a1da-427d-a04d-432e2eb150f3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:34.925718 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b329642-a1da-427d-a04d-432e2eb150f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:34.955392 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0b329642-a1da-427d-a04d-432e2eb150f3 None None] MFA Rules not processed for user `2f6db63653284bd1b027795d2319e3db`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:34.956605 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0b329642-a1da-427d-a04d-432e2eb150f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:35.028647 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1464/2917] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:35.046918 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83291c34-44f2-409f-8c85-eea3754da037 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:35.049427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-83291c34-44f2-409f-8c85-eea3754da037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:35.126302 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83291c34-44f2-409f-8c85-eea3754da037 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:35.131818 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25083dad-a847-416c-99f8-147de89810fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:35.132445 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25083dad-a847-416c-99f8-147de89810fc service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:35.132727 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25083dad-a847-416c-99f8-147de89810fc service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:35.132996 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25083dad-a847-416c-99f8-147de89810fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:35.189223 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25083dad-a847-416c-99f8-147de89810fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:35.190836 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25083dad-a847-416c-99f8-147de89810fc service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:35.200871 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1454/2918] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:20:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:20:36.193901 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4e7f6-83c6-4cda-a894-2b76dfc96a4b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:36.194377 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4e7f6-83c6-4cda-a894-2b76dfc96a4b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:36.194476 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4e7f6-83c6-4cda-a894-2b76dfc96a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:36.213915 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-49f4e7f6-83c6-4cda-a894-2b76dfc96a4b None None] MFA Rules not processed for user `9ae3f89ef2f94ee89f1bbf27937b49fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 12:20:36.215109 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-49f4e7f6-83c6-4cda-a894-2b76dfc96a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:36.221930 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1465/2919] 10.222.0.42 () {58 vars in 958 bytes} [Mon Aug 1 12:20:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 12:20:45.196692 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=57 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:46.208685 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=42 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:20:54.295159 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25083dad-a847-416c-99f8-147de89810fc service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:20:54.296696 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-25083dad-a847-416c-99f8-147de89810fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:54.373509 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25083dad-a847-416c-99f8-147de89810fc service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:20:54.378979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4496967-24ac-4bbb-b49b-06526b078060 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:20:54.379593 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4496967-24ac-4bbb-b49b-06526b078060 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:20:54.379873 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4496967-24ac-4bbb-b49b-06526b078060 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:20:54.380147 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4496967-24ac-4bbb-b49b-06526b078060 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:20:54.381905 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e4496967-24ac-4bbb-b49b-06526b078060 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:20:54.393737 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4496967-24ac-4bbb-b49b-06526b078060 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:20:54.395318 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4496967-24ac-4bbb-b49b-06526b078060 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:20:54.405086 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1455/2920] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:20:54 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:21:03.062000 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4e7f6-83c6-4cda-a894-2b76dfc96a4b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:21:03.064040 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-49f4e7f6-83c6-4cda-a894-2b76dfc96a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:21:03.082128 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4e7f6-83c6-4cda-a894-2b76dfc96a4b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:21:03.087726 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168655da-ddbf-4180-a2b7-30ac49260e04 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:21:03.088340 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168655da-ddbf-4180-a2b7-30ac49260e04 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:21:03.088618 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168655da-ddbf-4180-a2b7-30ac49260e04 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:21:03.088892 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168655da-ddbf-4180-a2b7-30ac49260e04 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:21:03.090709 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-168655da-ddbf-4180-a2b7-30ac49260e04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:21:03.103894 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168655da-ddbf-4180-a2b7-30ac49260e04 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:21:03.105531 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168655da-ddbf-4180-a2b7-30ac49260e04 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:21:03.116396 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1466/2921] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:21:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:21:04.400901 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=32 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:21:06.251265 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4496967-24ac-4bbb-b49b-06526b078060 service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:21:06.305728 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4496967-24ac-4bbb-b49b-06526b078060 service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:21:06.309022 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb726f51-ac23-447c-a638-40a93c742c32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:21:06.309662 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb726f51-ac23-447c-a638-40a93c742c32 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:21:06.309935 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb726f51-ac23-447c-a638-40a93c742c32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:21:06.310199 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb726f51-ac23-447c-a638-40a93c742c32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:21:06.319773 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb726f51-ac23-447c-a638-40a93c742c32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:21:06.321214 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb726f51-ac23-447c-a638-40a93c742c32 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:21:06.331049 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1456/2922] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:21:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:21:13.111673 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=6 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:21:16.326412 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=26 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:22:32.887278 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168655da-ddbf-4180-a2b7-30ac49260e04 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:22:32.889196 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-168655da-ddbf-4180-a2b7-30ac49260e04 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:22:32.974043 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168655da-ddbf-4180-a2b7-30ac49260e04 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:22:32.979459 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adc025-1aa0-435e-8ea0-7aaf6e9468ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:22:32.980084 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adc025-1aa0-435e-8ea0-7aaf6e9468ff service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:22:32.980357 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adc025-1aa0-435e-8ea0-7aaf6e9468ff service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:22:32.980628 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50adc025-1aa0-435e-8ea0-7aaf6e9468ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:22:32.982477 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-50adc025-1aa0-435e-8ea0-7aaf6e9468ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:22:32.995286 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adc025-1aa0-435e-8ea0-7aaf6e9468ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:22:32.996888 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50adc025-1aa0-435e-8ea0-7aaf6e9468ff service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:22:33.006824 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1467/2923] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:22:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:22:43.002515 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=37 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:23:35.109553 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb726f51-ac23-447c-a638-40a93c742c32 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:23:35.140179 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb726f51-ac23-447c-a638-40a93c742c32 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:23:35.143867 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15a36e-0715-4923-a7bc-c141774a28a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:23:35.144543 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15a36e-0715-4923-a7bc-c141774a28a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:23:35.144848 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15a36e-0715-4923-a7bc-c141774a28a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:23:35.145114 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce15a36e-0715-4923-a7bc-c141774a28a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:23:35.146863 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ce15a36e-0715-4923-a7bc-c141774a28a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:23:35.179314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15a36e-0715-4923-a7bc-c141774a28a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:23:35.180756 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce15a36e-0715-4923-a7bc-c141774a28a7 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:23:35.201113 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1457/2924] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:23:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:23:36.389234 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adc025-1aa0-435e-8ea0-7aaf6e9468ff service placement] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:23:36.390682 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-50adc025-1aa0-435e-8ea0-7aaf6e9468ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:23:36.416115 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50adc025-1aa0-435e-8ea0-7aaf6e9468ff service placement] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:23:36.421754 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60488e74-20c7-49c5-ac86-7e8aec6c30a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:23:36.422238 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60488e74-20c7-49c5-ac86-7e8aec6c30a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:23:36.422499 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60488e74-20c7-49c5-ac86-7e8aec6c30a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:23:36.422773 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60488e74-20c7-49c5-ac86-7e8aec6c30a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:23:36.424543 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-60488e74-20c7-49c5-ac86-7e8aec6c30a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:23:36.439943 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60488e74-20c7-49c5-ac86-7e8aec6c30a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:23:36.441426 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60488e74-20c7-49c5-ac86-7e8aec6c30a1 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:23:36.453527 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1468/2925] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:23:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:23:45.198277 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=27 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:23:46.447635 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=11 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:23:48.333823 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15a36e-0715-4923-a7bc-c141774a28a7 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:23:48.342408 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce15a36e-0715-4923-a7bc-c141774a28a7 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:23:48.346477 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2b584-6e8a-4cca-bc41-332d5ac89f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:23:48.347076 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2b584-6e8a-4cca-bc41-332d5ac89f36 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:23:48.347350 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2b584-6e8a-4cca-bc41-332d5ac89f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:23:48.347614 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de2b584-6e8a-4cca-bc41-332d5ac89f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:23:48.349436 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5de2b584-6e8a-4cca-bc41-332d5ac89f36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:23:48.358850 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2b584-6e8a-4cca-bc41-332d5ac89f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:23:48.360261 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de2b584-6e8a-4cca-bc41-332d5ac89f36 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:23:48.368907 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1458/2926] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:23:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:23:48.484547 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60488e74-20c7-49c5-ac86-7e8aec6c30a1 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:23:48.493427 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60488e74-20c7-49c5-ac86-7e8aec6c30a1 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:23:48.497074 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae79a8-3268-4b5b-99d4-e59ec7b728ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:23:48.497717 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae79a8-3268-4b5b-99d4-e59ec7b728ce service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:23:48.497999 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae79a8-3268-4b5b-99d4-e59ec7b728ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:23:48.498271 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcae79a8-3268-4b5b-99d4-e59ec7b728ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:23:48.500051 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bcae79a8-3268-4b5b-99d4-e59ec7b728ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:23:48.510137 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae79a8-3268-4b5b-99d4-e59ec7b728ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:23:48.511571 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcae79a8-3268-4b5b-99d4-e59ec7b728ce service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:23:48.520369 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1469/2927] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:23:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:23:48.602914 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2b584-6e8a-4cca-bc41-332d5ac89f36 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:23:48.612186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de2b584-6e8a-4cca-bc41-332d5ac89f36 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:23:48.616427 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a3ff3-c351-4581-8fda-d355696e2fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:23:48.617104 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a3ff3-c351-4581-8fda-d355696e2fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:23:48.617486 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a3ff3-c351-4581-8fda-d355696e2fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:23:48.617856 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594a3ff3-c351-4581-8fda-d355696e2fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:23:48.619675 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-594a3ff3-c351-4581-8fda-d355696e2fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:23:48.633186 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a3ff3-c351-4581-8fda-d355696e2fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:23:48.634639 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594a3ff3-c351-4581-8fda-d355696e2fbd service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:23:48.646216 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1459/2928] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:23:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:23:58.516182 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=6 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:23:58.640719 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=12 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:24:35.268026 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae79a8-3268-4b5b-99d4-e59ec7b728ce service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:24:35.276672 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcae79a8-3268-4b5b-99d4-e59ec7b728ce service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:24:35.280279 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4a200-6a75-4b5e-8594-ad85a9c5d9f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:24:35.280883 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4a200-6a75-4b5e-8594-ad85a9c5d9f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:24:35.281162 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4a200-6a75-4b5e-8594-ad85a9c5d9f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:24:35.281468 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c4a200-6a75-4b5e-8594-ad85a9c5d9f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:24:35.283210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b1c4a200-6a75-4b5e-8594-ad85a9c5d9f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:24:35.293451 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4a200-6a75-4b5e-8594-ad85a9c5d9f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:24:35.294878 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c4a200-6a75-4b5e-8594-ad85a9c5d9f5 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:24:35.303210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1470/2929] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:24:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:24:45.299337 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=6 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:25:39.004819 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a3ff3-c351-4581-8fda-d355696e2fbd service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:25:39.014132 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594a3ff3-c351-4581-8fda-d355696e2fbd service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:25:39.017677 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53b53b-979c-4b07-9803-0c4bc1f0e36e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:25:39.018314 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53b53b-979c-4b07-9803-0c4bc1f0e36e service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:25:39.018590 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53b53b-979c-4b07-9803-0c4bc1f0e36e service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:25:39.018858 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53b53b-979c-4b07-9803-0c4bc1f0e36e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:25:39.026900 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53b53b-979c-4b07-9803-0c4bc1f0e36e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:25:39.028374 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53b53b-979c-4b07-9803-0c4bc1f0e36e service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:25:39.036926 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1460/2930] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:25:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:25:39.912210 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4a200-6a75-4b5e-8594-ad85a9c5d9f5 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:25:39.929528 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c4a200-6a75-4b5e-8594-ad85a9c5d9f5 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:25:39.936178 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341875d1-7c31-42d4-ba2a-4f98dfb7212c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f85279b6b3474c77be0d8d569feea5f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:25:39.936877 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341875d1-7c31-42d4-ba2a-4f98dfb7212c service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:25:39.937217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341875d1-7c31-42d4-ba2a-4f98dfb7212c service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:25:39.937581 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341875d1-7c31-42d4-ba2a-4f98dfb7212c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:25:39.939414 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-341875d1-7c31-42d4-ba2a-4f98dfb7212c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:25:39.953148 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341875d1-7c31-42d4-ba2a-4f98dfb7212c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:25:39.955585 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341875d1-7c31-42d4-ba2a-4f98dfb7212c service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:25:39.967688 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1471/2931] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:25:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 12:25:43.748885 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53b53b-979c-4b07-9803-0c4bc1f0e36e service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:25:43.757817 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53b53b-979c-4b07-9803-0c4bc1f0e36e service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:25:43.761502 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed76483-fe34-4b4e-9e77-60aa90d49b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2afb18a441549e3b853966ea1ad286e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:25:43.762098 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed76483-fe34-4b4e-9e77-60aa90d49b75 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:25:43.762378 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed76483-fe34-4b4e-9e77-60aa90d49b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:25:43.762650 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed76483-fe34-4b4e-9e77-60aa90d49b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:25:43.832772 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed76483-fe34-4b4e-9e77-60aa90d49b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:25:43.834237 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed76483-fe34-4b4e-9e77-60aa90d49b75 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:25:43.853690 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1461/2932] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:25:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:25:46.928508 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341875d1-7c31-42d4-ba2a-4f98dfb7212c service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:25:46.941227 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341875d1-7c31-42d4-ba2a-4f98dfb7212c service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:25:46.947374 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369015d-5d7b-4881-bcac-6046a6a6d424 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:25:46.948083 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369015d-5d7b-4881-bcac-6046a6a6d424 service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:25:46.948552 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369015d-5d7b-4881-bcac-6046a6a6d424 service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:25:46.948823 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369015d-5d7b-4881-bcac-6046a6a6d424 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:25:46.950886 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b369015d-5d7b-4881-bcac-6046a6a6d424 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:25:46.963812 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369015d-5d7b-4881-bcac-6046a6a6d424 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:25:46.965722 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369015d-5d7b-4881-bcac-6046a6a6d424 service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:25:46.990217 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1472/2933] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:25:46 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:25:50.100321 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed76483-fe34-4b4e-9e77-60aa90d49b75 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:25:50.112140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed76483-fe34-4b4e-9e77-60aa90d49b75 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:25:50.117355 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379440e4-00e7-4df7-8b75-879269a80db8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:25:50.118038 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379440e4-00e7-4df7-8b75-879269a80db8 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:25:50.118404 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379440e4-00e7-4df7-8b75-879269a80db8 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:25:50.118738 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379440e4-00e7-4df7-8b75-879269a80db8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:25:50.120989 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-379440e4-00e7-4df7-8b75-879269a80db8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:25:50.135195 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379440e4-00e7-4df7-8b75-879269a80db8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:25:50.137122 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379440e4-00e7-4df7-8b75-879269a80db8 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:25:50.155979 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1462/2934] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:25:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:25:50.170848 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369015d-5d7b-4881-bcac-6046a6a6d424 service placement] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:25:50.190297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369015d-5d7b-4881-bcac-6046a6a6d424 service placement] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:25:50.196105 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:25:50.196744 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:25:50.197013 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:25:50.197321 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] PATH_INFO: `/v3/users/9ae3f89ef2f94ee89f1bbf27937b49fa` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:25:50.198495 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ae3f89ef2f94ee89f1bbf27937b49fa)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:25:50.200986 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:25:50.255497 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ae3f89ef2f94ee89f1bbf27937b49fa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.265175 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ae3f89ef2f94ee89f1bbf27937b49fa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.277835 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ae3f89ef2f94ee89f1bbf27937b49fa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.278464 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ae3f89ef2f94ee89f1bbf27937b49fa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.286711 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ae3f89ef2f94ee89f1bbf27937b49fa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.292847 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1473/2935] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:25:50 2022] DELETE /identity/v3/users/9ae3f89ef2f94ee89f1bbf27937b49fa => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:25:50.478140 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379440e4-00e7-4df7-8b75-879269a80db8 service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:25:50.489082 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379440e4-00e7-4df7-8b75-879269a80db8 service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:25:50.551944 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:25:50.552578 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:25:50.552853 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:25:50.553120 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] PATH_INFO: `/v3/projects/ded64eaa4a064fc5b717fe0c5ffafba7` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:25:50.554280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ded64eaa4a064fc5b717fe0c5ffafba7)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:25:50.556170 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:25:50.602091 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ded64eaa4a064fc5b717fe0c5ffafba7', 'request_id': 'req-74381190-eb15-4cb5-a74c-08e4fd32c13f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.603946 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:25:50.608520 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ded64eaa4a064fc5b717fe0c5ffafba7', 'request_id': 'req-74381190-eb15-4cb5-a74c-08e4fd32c13f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.616525 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ded64eaa4a064fc5b717fe0c5ffafba7', 'request_id': 'req-74381190-eb15-4cb5-a74c-08e4fd32c13f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.640729 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] The token cache is being invalidate because project ded64eaa4a064fc5b717fe0c5ffafba7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:25:50.641019 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.641868 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.643640 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1463/2936] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:25:50 2022] DELETE /identity/v3/projects/ded64eaa4a064fc5b717fe0c5ffafba7 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:25:50.648218 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:25:50.649919 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:25:50.663832 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d3adeb-3f7a-4204-846b-5a40ad34b72f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:25:50.719575 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:25:50.720247 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:25:50.720526 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:25:50.720796 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] PATH_INFO: `/v3/users/2f6db63653284bd1b027795d2319e3db` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:25:50.721990 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6db63653284bd1b027795d2319e3db)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:25:50.723907 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:25:50.772244 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6db63653284bd1b027795d2319e3db'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.773905 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:25:50.780729 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6db63653284bd1b027795d2319e3db'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.793655 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6db63653284bd1b027795d2319e3db'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.794297 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6db63653284bd1b027795d2319e3db'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.801087 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6db63653284bd1b027795d2319e3db'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:50.806841 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1474/2937] 10.222.0.42 () {58 vars in 1224 bytes} [Mon Aug 1 12:25:50 2022] DELETE /identity/v3/users/2f6db63653284bd1b027795d2319e3db => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:25:50.980657 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:25:50.982240 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:25:50.998747 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74381190-eb15-4cb5-a74c-08e4fd32c13f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:25:51.054638 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d95af8c-eda7-452e-9113-ea7a0580a819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ba23ee634e9487f8436a5c9c29e0eb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '541ab528aad34615a3714dea6d3cccb9', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:25:51.055205 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95af8c-eda7-452e-9113-ea7a0580a819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:25:51.055482 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95af8c-eda7-452e-9113-ea7a0580a819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:25:51.055754 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d95af8c-eda7-452e-9113-ea7a0580a819 admin admin] PATH_INFO: `/v3/projects/c8fa2529466645908f2c77439e828a09` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:25:51.056904 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95af8c-eda7-452e-9113-ea7a0580a819 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fa2529466645908f2c77439e828a09)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:25:51.058844 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d95af8c-eda7-452e-9113-ea7a0580a819 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:25:51.105280 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0d95af8c-eda7-452e-9113-ea7a0580a819 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fa2529466645908f2c77439e828a09', 'request_id': 'req-0d95af8c-eda7-452e-9113-ea7a0580a819'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:51.111017 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0d95af8c-eda7-452e-9113-ea7a0580a819 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fa2529466645908f2c77439e828a09', 'request_id': 'req-0d95af8c-eda7-452e-9113-ea7a0580a819'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:51.118211 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0d95af8c-eda7-452e-9113-ea7a0580a819 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fa2529466645908f2c77439e828a09', 'request_id': 'req-0d95af8c-eda7-452e-9113-ea7a0580a819'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:51.129413 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0d95af8c-eda7-452e-9113-ea7a0580a819 admin admin] The token cache is being invalidate because project c8fa2529466645908f2c77439e828a09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 12:25:51.129699 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0d95af8c-eda7-452e-9113-ea7a0580a819 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:51.130333 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0d95af8c-eda7-452e-9113-ea7a0580a819 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 12:25:51.131822 dv-cinder-850320-2-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1464/2938] 10.222.0.42 () {58 vars in 1233 bytes} [Mon Aug 1 12:25:50 2022] DELETE /identity/v3/projects/c8fa2529466645908f2c77439e828a09 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 12:26:00.803411 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=12 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:26:01.126528 dv-cinder-850320-2-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=62,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 12:27:34.893380 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 12:27:34.894856 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:27:34.961972 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc7b42f-7927-4783-bcb5-7fa98d06862c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 12:27:35.021808 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f79a0-67aa-4b37-86c5-f9c17048eac0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35b5e545d75d40d0abb9c8d996e3b4a0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '99857fcf20fd4cb8b7def2bc2de521bc', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 12:27:35.022419 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f79a0-67aa-4b37-86c5-f9c17048eac0 service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 12:27:35.022727 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f79a0-67aa-4b37-86c5-f9c17048eac0 service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 12:27:35.023093 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f79a0-67aa-4b37-86c5-f9c17048eac0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 12:27:35.025290 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3f5f79a0-67aa-4b37-86c5-f9c17048eac0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 12:27:35.036759 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f79a0-67aa-4b37-86c5-f9c17048eac0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 12:27:35.038424 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f79a0-67aa-4b37-86c5-f9c17048eac0 service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 12:27:35.048743 dv-cinder-850320-2-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1475/2939] 10.222.0.42 () {60 vars in 1365 bytes} [Mon Aug 1 12:27:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 12:27:45.044563 dv-cinder-850320-2-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=58 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}